centOS7上安装scrape

1、首先安装epel扩展源

sudo yum -y install epel-release

2、如果系统中安装有audit这个包请先移除，它会影响到Scrapy的安装

#yum remove audit

3、然后安装python-pip

sudo yum -y install python-pip

4、安装依赖包

#yum install -y python-devel gcc libffi-devel openssl-devel libxslt-devel libxml2-devel

5、升级pip到8.1.2

pip install --upgrade pip

6、升级setuptools25.1.4 pip install --upgrade setuptools

7、配置scrape的环境变量

vi /etc/profile

export LD_LIBRARY_PATH=/usr/local/lib

8、清除cache sudo yum clean all