mac安装scrapy并创建项目的实例讲解
作者:蜡笔小心丶 时间:2021-05-17 21:21:05
最近刚好在学习python+scrapy的爬虫技术,因为mac是自带python2.7的,所以安装3.5版本有两种方法,一种是升级,一种是额外安装3.5版本。
升级就不用说了,讲讲额外安装的版本吧~~~
因为python是有自带版本的,最开始安装的时候都会有一种“ 会不会冲突 ”的感觉。
其实安装3.5版本也就是在官网上直接下载之后安装,和普通的mac软件安装方式是一样的~~
https://www.python.org/downloads/release/python-353/
安装完成之后,不会覆盖原来的python,会在 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5文件中
在终端直接输入 python 会执行python2.7版本
python
Python 2.7.12 (default, Jun 29 2016, 14:05:02)
[GCC 4.2.1 Compatible Apple LLVM 7.3.0 (clang-703.0.31)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>>
在终端直接输入 python3 则会执行python3.5版本
python3
Python 3.5.3 (v3.5.3:1880cb95a742, Jan 16 2017, 08:49:46)
[GCC 4.2.1 (Apple Inc. build 5666) (dot 3)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>>
接下来就可以开始安装scrapy了
python3.5中会自带 pip,所以不需要额外安装了,可以直接在终端输入 pip3 --version查看版本和路径
pip3 --version
pip 9.0.1 from /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages (python 3.5)
使用 pip3 安装scrapy
pip3 install Scrapy
这里的Scrapy一定要首字母大写,不然会在安装的过程中报错~~
Collecting scrapy
Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa2c88>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/
Retrying (Retry(total=3, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa29e8>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/
Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa2630>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/
Retrying (Retry(total=1, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa2f28>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/
Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa2be0>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/
Could not find a version that satisfies the requirement scrapy (from versions: )
No matching distribution found for scrapy
安装成功之后,可以直接在终端上输入 scrapy 查看版本号及使用
Scrapy 1.4.0 - no active project
Usage:
scrapy <command> [options] [args]
Available commands:
bench Run quick benchmark test
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
[ more ] More commands available when run from project directory
Use "scrapy <command> -h" to see more info about a command
在pycharm中是没有直接创建scrapy项目的,可以使用 scrapy 命令手动新建项目
scrapy startproject ArticleSpider(ArticleSpider为项目名称)
来源:https://blog.csdn.net/u011615787/article/details/72628920
标签:mac,安装,scrapy
![](/images/zang.png)
![](/images/jiucuo.png)
猜你喜欢
python上下文管理器协议的实现
2023-08-28 18:32:18
js放大缩小容器:仿动画
2008-02-15 11:34:00
详解Python的Django框架中的templates设置
2021-12-15 15:16:06
python实现词法分析器
2022-09-12 15:03:18
![](https://img.aspxhome.com/file/2023/6/93956_0s.png)
X/HTML5 v.s. XHTML2(I)
2008-06-17 18:00:00
Python 数据类型--集合set
2021-11-23 21:17:54
![](https://img.aspxhome.com/file/2023/4/68494_0s.png)
解决PyCharm同目录下导入模块会报错的问题
2023-06-12 22:39:55
用XML创建可排序、分页的数据显示页面
2008-04-22 18:25:00
使用python将最新的测试报告以附件的形式发到指定邮箱
2022-08-24 14:59:16
![](https://img.aspxhome.com/file/2023/5/96925_0s.png)
python版百度语音识别功能
2023-02-28 09:56:34
![](https://img.aspxhome.com/file/2023/3/75303_0s.jpg)
重新认识ASP之后的我在想"是时候改变了"
2008-05-08 13:10:00
如何用python给数据加上高斯噪声
2023-06-13 18:18:04
oracle初始化参数设置
2010-07-31 12:47:00
关于numpy和torch.tensor的张量的操作
2023-12-30 23:35:25
基于python实现高速视频传输程序
2022-04-01 02:14:17
python fabric实现远程操作和部署示例
2021-07-18 14:22:14
Python+Tableau广东省人口普查可视化的实现
2022-02-12 21:53:59
![](https://img.aspxhome.com/file/2023/4/83764_0s.gif)
Win7的IIS7中ASP获得的系统日期格式为斜杠的解决办法
2012-12-04 19:57:33
三谈Iframe自适应高度
2010-08-03 13:04:00
php官方微信接口大全(微信支付、微信红包、微信摇一摇、微信小店)
2023-10-17 14:16:56