Failed installing scrapy

sudo pip3 install scrapy

When I’m installing scrapy in my computer, this is the error I’m getting:

Command “/usr/bin/python3 -u -c “import setuptools, tokenize;file=‘/tmp/pip-build-xfj07fck/cffi/setup.py’;exec(compile(getattr(tokenize, ‘open’, open)(file).read().replace(‘\r\n’, ‘\n’), file, ‘exec’))” install --record /tmp/pip-h3d3uz53-record/install-record.txt --single-version-externally-managed --compile” failed with error code 1 in /tmp/pip-build-xfj07fck/cffi/

Screenshots

My computer runs on Deepin Linux OS (15.1). I already tried upgrading setuptools: sudo pip3 install --upgrade setuptools. Still getting the same error. Thank you in advance for helping!

[redapple]

@AFAgarap , you need a few dev headers packages installed on your machine to install Scrapy.

Here’s an example Dockerfile using Ubuntu 14.04: https://gist.github.com/redapple/cd9c31eeab8c4d5ea9eef7b200c3d4d0

Deepin looks Debian-based, so you should be good with:

apt-get install -y \
    python3 \
    python-dev \
    python3-dev

for cryptography dependency:

apt-get install -y \
    build-essential \
    libssl-dev \
    libffi-dev

for lxml

apt-get install -y \
    libxml2-dev \
    libxslt-dev

[redapple]

Thanks for the heads up! Happy scraping