Python爬取股票交易数据并可视化展示
作者:松鼠爱吃饼干 时间:2022-02-06 13:13:22
开发环境
解释器版本: python 3.8
代码编辑器: pycharm 2021.2
第三方模块
requests: pip install requests
csv
爬虫案例的步骤
1.确定url地址(链接地址)
2.发送网络请求
3.数据解析(筛选数据)
4.数据的保存(数据库(mysql\mongodb\redis), 本地文件)
爬虫程序全部代码
分析网页
打开开发者工具,搜索关键字,找到正确url
导入模块
import requests # 发送网络请求
import csv
请求数据
url = f'https://xueqiu.com/service/v5/stock/screener/quote/list?page=1&size=30&order=desc&order_by=amount&exchange=CN&market=CN&type=sha&_=1637908787379'
# 伪装
headers = {
# 浏览器伪装
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.45 Safari/537.36'
}
response = requests.get(url, headers=headers)
json_data = response.json()
解析数据
data_list = json_data['data']['list']
for data in data_list:
data1 = data['symbol']
data2 = data['name']
data3 = data['current']
data4 = data['chg']
data5 = data['percent']
data6 = data['current_year_percent']
data7 = data['volume']
data8 = data['amount']
data9 = data['turnover_rate']
data10 = data['pe_ttm']
data11 = data['dividend_yield']
data12 = data['market_capital']
print(data1, data2, data3, data4, data5, data6, data7, data8, data9, data10, data11, data12)
data_dict = {
'股票代码': data1,
'股票名称': data2,
'当前价': data3,
'涨跌额': data4,
'涨跌幅': data5,
'年初至今': data6,
'成交量': data7,
'成交额': data8,
'换手率': data9,
'市盈率(TTM)': data10,
'股息率': data11,
'市值': data12,
}
csv_write.writerow(data_dict)
翻页
对比1、2、3页数据url,找到规律
for page in range(1, 56):
url = f'https://xueqiu.com/service/v5/stock/screener/quote/list?page={page}&size=30&order=desc&order_by=amount&exchange=CN&market=CN&type=sha&_=1637908787379'
保存数据
file = open('data2.csv', mode='a', encoding='utf-8', newline='')
csv_write = csv.DictWriter(file, fieldnames=['股票代码','股票名称','当前价','涨跌额','涨跌幅','年初至今','成交量','成交额','换手率','市盈率(TTM)','股息率','市值'])
csv_write.writeheader()
file.close()
实现效果
数据可视化全部代码
导入数据
import pandas as pd
from pyecharts import options as opts
from pyecharts.charts import Bar
读取数据
data_df = pd.read_csv('data2.csv')
df = data_df.dropna()
df1 = df[['股票名称', '成交量']]
df2 = df1.iloc[:20]
print(df2['股票名称'].values)
print(df2['成交量'].values)
可视化图表
c = (
Bar()
.add_xaxis(list(df2['股票名称']))
.add_yaxis("股票成交量情况", list(df2['成交量']))
.set_global_opts(
title_opts=opts.TitleOpts(title="成交量图表 - Volume chart"),
datazoom_opts=opts.DataZoomOpts(),
)
.render("data.html")
)
print('数据可视化结果完成,请在当前目录下查找打开 data.html 文件!')
效果展示
来源:https://blog.csdn.net/m0_48405781/article/details/121640081
标签:Python,股票,数据爬取,可视化
![](/images/zang.png)
![](/images/jiucuo.png)
猜你喜欢
详解python数据结构之栈stack
2023-02-12 17:48:56
![](https://img.aspxhome.com/file/2023/6/78806_0s.png)
python orm 框架中sqlalchemy用法实例详解
2021-04-22 18:03:28
网页设计之关于素材和言志
2008-03-23 13:46:00
![](https://img.aspxhome.com/file/UploadPic/20083/23/200832313514542s.gif)
利用location.hash实现跨域iframe自适应高宽
2009-08-02 20:31:00
xhtml有哪些块级元素
2009-12-06 11:58:00
asp下查询xml的实现代码
2011-04-19 10:37:00
Python爬取APP下载链接的实现方法
2022-04-10 02:12:27
![](https://img.aspxhome.com/file/2023/9/100789_0s.png)
Python画图高斯分布的示例
2023-02-07 09:09:14
python 使用xlsxwriter循环向excel中插入数据和图片的操作
2023-01-30 15:08:47
![](https://img.aspxhome.com/file/2023/9/78779_0s.jpg)
源码解析python的内存回收机制
2023-05-19 18:12:16
Django项目中动态设置静态文件路径的全过程
2021-07-12 00:52:24
![](https://img.aspxhome.com/file/2023/9/126909_0s.jpg)
SQL Serve数据库到DB2连接服务器的实现过程全解
2010-08-31 15:06:00
[翻译]标记语言和样式手册 Chapter 8 再谈清单
2008-01-29 13:16:00
![](https://img.aspxhome.com/file/UploadPic/20081/29/2008129133019614s.jpg)
提高JavaScript执行效率的23个实用技巧
2023-08-15 18:38:12
Windows环境下Python3.6.8 importError: DLLload failed:找不到指定的模块
2022-08-07 23:03:11
![](https://img.aspxhome.com/file/2023/4/95594_0s.jpg)
sqlserver 2000中创建用户的图文方法
2012-03-26 18:26:39
python中利用h5py模块读取h5文件中的主键方法
2022-07-26 12:02:36
Python计算信息熵实例
2022-08-17 16:13:39
![](https://img.aspxhome.com/file/2023/0/103300_0s.jpg)
Python 文件与文件对象及文件打开关闭
2021-06-16 16:08:44
python正则表达式对字符串的查找匹配
2022-02-21 12:39:50