用Python爬取LOL所有的英雄信息以及英雄皮肤的示例代码
作者:阿壮Jonsson 时间:2021-07-29 00:54:25
实现思路:分为两部分,第一部分,获取网页上数据并使用xlwt生成excel(当然你也可以选择保存到数据库),第二部分获取网页数据使用IO流将图片保存到本地
一、爬取所有英雄属性并生成excel
1.代码
import json
import requests
import xlwt
# 设置头部信息,防止被检测出是爬虫
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36'
}
url = "https://game.gtimg.cn/images/lol/act/img/js/heroList/hero_list.js"
response = requests.get(url=url, headers=headers).text
loads = json.loads(response)
dic = loads['hero']
# 创建一个workbook 设置编码
workbook = xlwt.Workbook(encoding='utf-8')
# 创建一个worksheet
worksheet = workbook.add_sheet('LOL')
try:
for i in range(len(dic)):
# 设置单元格宽度大小
worksheet.col(i).width = 4000
# 设置单元格高度大小
style = xlwt.easyxf('font:height 300')
worksheet.row(i).set_style(style)
# 第一行用于写入表头
if i == 0:
worksheet.write(i, 0, '编号')
worksheet.write(i, 1, '名称')
worksheet.write(i, 2, '英文名')
worksheet.write(i, 3, '中文名')
worksheet.write(i, 4, '角色')
worksheet.write(i, 5, '物攻')
worksheet.write(i, 6, '物防')
worksheet.write(i, 7, '魔攻')
worksheet.write(i, 8, '魔防')
continue
worksheet.write(i, 0, dic[i - 1]['heroId'])
worksheet.write(i, 1, dic[i - 1]['name'])
worksheet.write(i, 2, dic[i - 1]['alias'])
worksheet.write(i, 3, dic[i - 1]['title'])
roles_ = dic[i - 1]['roles']
roles = []
for data in roles_:
if 'mage' == data:
roles.append('法师')
if 'tank' == data:
roles.append('坦克')
if 'fighter' == data:
roles.append('战士')
if 'marksman' == data:
roles.append('ADC')
if 'assassin' == data:
roles.append('刺客')
if 'support' == data:
roles.append('辅助')
worksheet.write(i, 4, str(roles))
worksheet.write(i, 5, dic[i - 1]['attack'])
worksheet.write(i, 6, dic[i - 1]['defense'])
worksheet.write(i, 7, dic[i - 1]['magic'])
worksheet.write(i, 8, dic[i - 1]['difficulty'])
# 保存
workbook.save('C:\\Users\\Jonsson\\Desktop\\lol.xls')
except Exception as e:
print(e)
2.效果
二、爬取所有英雄皮肤并保存到本地
1.代码
import json
import os
import requests
import xlwt
# 设置头部信息,防止被检测出是爬虫
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36'
}
url = "https://game.gtimg.cn/images/lol/act/img/js/heroList/hero_list.js"
# 请求英雄列表的url地址
response = requests.get(url=url, headers=headers).text
loads = json.loads(response)
dic = loads['hero']
for data in dic:
id_ = data['heroId']
skinUrl = 'https://game.gtimg.cn/images/lol/act/img/js/hero/%s.js' % id_
# 请求每个英雄皮肤的url地址
skinResponse = requests.get(url=skinUrl, headers=headers).text
json_loads = json.loads(skinResponse)
hero_ = json_loads['hero']
save_path = './skin/%s-%s-%s' % (hero_["heroId"], hero_['name'], hero_['title'])
# 文件夹不存在,则创建文件夹
folder = os.path.exists(save_path)
if not folder:
os.makedirs(save_path)
skins_ = json_loads['skins']
for data in skins_:
if data['chromas'] == '0':
content = requests.get(url=data['mainImg'], headers=headers).content
try:
with open('%s/%s.jpg' % (save_path, data['name']), "wb") as f:
print("正在下载英雄:%s 皮肤名称:%s ..." % (hero_['name'], data['name']))
f.write(content)
except Exception as e:
print('下载失败')
print(e)
2.效果
来源:https://blog.csdn.net/y1534414425/article/details/107247322
标签:Python,爬取,LOL,英雄
![](/images/zang.png)
![](/images/jiucuo.png)
猜你喜欢
一个将半角"转换为中文"的asp函数
2007-09-19 11:47:00
Python文本特征抽取与向量化算法学习
2023-07-19 09:44:29
![](https://img.aspxhome.com/file/2023/1/81501_0s.jpg)
IIS服务器中部署PHP案例详解
2023-06-11 19:17:42
![](https://img.aspxhome.com/file/2023/1/55541_0s.jpg)
keras模型保存为tensorflow的二进制模型方式
2022-12-21 07:20:08
不支持RSS,如何跟踪网站的内容更新?
2008-09-08 12:38:00
php从文件夹随机读取文件的方法
2023-11-21 16:38:35
基于python实现MUI区域滚动
2023-11-04 02:38:52
![](https://img.aspxhome.com/file/2023/6/79396_0s.png)
python创建与遍历List二维列表的方法
2023-04-29 13:07:48
ASP用csDrawGraph组件制作饼图、柱状图
2008-04-25 22:58:00
![](https://img.aspxhome.com/file/UploadPic/up/2008042523153992.gif)
详细讲解如何删除Access数据库中的空记录
2008-11-28 14:58:00
最详细的python工具Anaconda+Pycharm安装教程
2022-01-15 10:20:30
![](https://img.aspxhome.com/file/2023/2/75262_0s.png)
如何用CocosCreator制作微信小游戏
2023-08-23 16:00:02
![](https://img.aspxhome.com/file/2023/7/56117_0s.png)
随Linux开机自动启动mysql
2009-12-29 10:14:00
如何在Access 2007数据库中添加附件
2008-11-21 12:32:00
php简单实现批量上传图片的方法
2023-11-20 13:55:53
ASP编程入门进阶(十四):Browser & Linkin
2008-06-12 07:08:00
php过滤器使用详解
2023-06-13 01:52:23
可能被你忽略的 JavaScript 代码陷阱
2009-12-26 18:16:00
无忧贴子管理器(ListView组件)
2009-01-02 17:56:00
Django中modelform组件实例用法总结
2023-09-28 14:35:49
![](https://img.aspxhome.com/file/2023/2/63222_0s.png)