python中安装Scrapy模块依赖包汇总
作者:lon.y@qq.com 时间:2023-11-08 07:06:25
本地虚拟环境开发完成之后,上线过程中需要一一安装依赖包,做个记录如下:
CentOS 安装python3.5.3
wget https://www.python.org/ftp/python/3.5.3/Python-3.5.3.tgz
tar -xf Python-3.5.3.tgz cd Python-3.5.3
./configure --prefix=/usr/local/python353 make & make install
完成安装python3.5.3,在不删除系统自带的python2.x情况下,做几个软链:
#做python3软链
ln -s /usr/local/python353/bin/python3 /usr/local/bin/
#pip3软链
ln -s /usr/local/python353/bin/pip3 /usr/local/bin/
上传程序,安装scrapy及其依赖包:
#user agent包
pip3 install fake-useragent -i https://pypi.douban.com/simple/
#pymysql包
pip3 install pymysql -i https://pypi.douban.com/simple/
#PooledDB依赖包
pip3 install DBUtils -i https://pypi.douban.com/simple/
#PIL模块依赖包
pip3 install Image -i https://pypi.douban.com/simple/
在Centos系统中安装过程中,出现一个较为淡疼的问题:系统没有安装sqlite3,故此一直提示:
解决上面问题,下载sqlite3
sudo wget http://www.sqlite.org/2017/sqlite-autoconf-3190300.tar.gz
编译安装:
tar zxvf sqlite-autoconf-3190300.tar.gz cd sqlite-autoconf-3190300
./configure --prefix=/usr/local/sqlite3
make && make install
重新编译Python,找到Python3.5.3的安装文件路径,编辑setup.py脚本,找到 “sqlite3”
sqlite_inc_paths = [ '/usr/include',
'/usr/include/sqlite',
'/usr/include/sqlite3',
'/usr/local/include',
'/usr/local/include/sqlite',
'/usr/local/include/sqlite3',
]
在最后一行加入sqlite3编译安装路径,如下:
sqlite_inc_paths = [ '/usr/include',
'/usr/include/sqlite',
'/usr/include/sqlite3',
'/usr/local/include',
'/usr/local/include/sqlite',
'/usr/local/include/sqlite3',
'/usr/local/sqlite3',
]
重新编译Python3.5.3:
./configure --prefix=/usr/local/python353
make && make install
标签:Scrapy,依赖包
![](/images/zang.png)
![](/images/jiucuo.png)
猜你喜欢
Python模块_PyLibTiff读取tif文件的实例
2023-04-11 03:22:06
MySQL从命令行导入SQL脚本时出现中文乱码的解决方法
2024-01-27 11:04:46
深入了解和应用Python 装饰器 @decorator
2024-01-02 09:20:05
![](https://img.aspxhome.com/file/2023/2/72152_0s.jpg)
SQL 多表连接查询实现语句
2024-01-16 07:37:24
python 哈希表实现简单python字典代码实例
2023-12-28 06:11:32
jQuery 1.3.3 新功能[译]
2009-06-04 12:23:00
node.js 使用ejs模板引擎时后缀换成.html
2024-05-08 09:36:40
python里面单双下划线的区别详解
2023-03-22 12:39:22
![](https://img.aspxhome.com/file/2023/4/70644_0s.png)
防止别人iframe的js
2008-09-26 17:19:00
MySQL数据库闭包Closure Table表实现示例
2024-01-21 23:29:24
![](https://img.aspxhome.com/file/2023/3/121263_0s.png)
一篇文章入门Python生态系统(Python新手入门指导)
2023-11-03 01:12:00
![](https://img.aspxhome.com/file/2023/8/101698_0s.png)
js实现登录注册框手机号和验证码校验(前端部分)
2023-09-13 02:41:37
sql server使用公用表表达式CTE通过递归方式编写通用函数自动生成连续数字和日期
2024-01-24 15:34:17
![](https://img.aspxhome.com/file/2023/1/110951_0s.png)
mysql 8.0.18 压缩包安装及忘记密码重置所遇到的坑
2024-01-28 18:01:35
![](https://img.aspxhome.com/file/2023/5/102375_0s.jpg)
tab(标签)在使用时的禁忌
2009-04-16 13:06:00
![](https://img.aspxhome.com/file/UploadPic/20094/16/01-33s.jpg)
SqlServer创建自动收缩事务日志任务的图文教程
2024-01-23 23:44:40
![](https://img.aspxhome.com/file/2023/9/119249_0s.png)
IDEA连接不上MySQL端口号占用的解决
2024-01-24 14:49:21
![](https://img.aspxhome.com/file/2023/2/93912_0s.jpg)
简单的Vue SSR的示例代码
2023-07-02 17:08:46
![](https://img.aspxhome.com/file/2023/9/139949_0s.jpg)
ASP.NET 2.0中Gridview控件高级技巧图文教程
2007-08-07 15:46:00
![](https://img.aspxhome.com/file/UploadPic/20078/7/20078716342529s.gif)
了解WEB页面工具语言XML(六)展望
2008-09-05 17:19:00