Python全面解析json数据并保存为csv文件
作者:Hello 时间:2021-02-14 03:26:26
解析json数据并保存为csv文件
首先导入两个包:
import json
import pandas as pd
打开json 文件并读取:
with open('2.json', encoding='utf-8') as f:
line = f.readline()
d = json.loads(line)
f.close()
读取的json数据会以字典的形势保存,按照字典的读取方式获取自己想要的数据:
datas_x = []
datas_y = []
for dss in d:
datas_x.append(float(dss["pos"]["x"]))
datas_y.append(float(dss["pos"]["z"]))
将数据保存到列表中,然后创建pandas的DataFrame,DataFrame是由多种类型的列构成的二维标签数据结构。
path_x = pd.Series(datas_x)
path_y = pd.Series(datas_y)
path_df = pd.DataFrame()
path_df['pathx'] = path_x
path_df['pathy'] = path_y
最后将数据保存到csv中。
filepath = "E:\\python\\python\\2021\\202104\\0409\\path_data.csv"
path_df.to_csv(filepath, index=False, header=False)
完整代码
import json
import pandas as pd
filepath = "E:\\python\\python\\2021\\202104\\0409\\path_data.csv"
with open('2.json', encoding='utf-8') as f:
line = f.readline()
d = json.loads(line)
f.close()
datas_x = []
datas_y = []
for dss in d:
datas_x.append(float(dss["pos"]["x"]))
datas_y.append(float(dss["pos"]["z"]))
path_x = pd.Series(datas_x)
path_y = pd.Series(datas_y)
path_df = pd.DataFrame()
path_df['pathx'] = path_x
path_df['pathy'] = path_y
path_df.to_csv(filepath, index=False, header=False)
将json任意行文件转为csv文件并保存
将json格式的前3000条数据存入csv
json格式类型:
{"address": "华山路31号", "addressExtend": "屯溪老街", "amenities": [1, 2, 3, 5, 10, 12], "brandName": null, "businessZoneList": null, "cityCode": 1004, "cityName": "黄山", "coverImageUrl": "https://img20.360buyimg.com/hotel/jfs/t16351/270/1836534312/106914/9b443bc4/5a68e68aN23bfaeda.jpg", "districtName": "屯溪区", "geoInfo": {"distance": 3669, "name": "市中心", "type": 1, "typeName": "市中心"}, "grade": 5, "hotelId": 328618, "location": {"lat": "29.717982", "lon": "118.299707"}, "name": "黄山国际大酒店", "payMode": [1, 2], "price": 362, "priceStatus": 1, "promotion": [103], "saleType": 1, "score": 4.8, "star": 5, "themes": [3, 2, 4], "totalComments": 133}
{"address": "金城镇 珠山82号", "addressExtend": "", "amenities": null, "brandName": null, "businessZoneList": [{"businessZoneId": 2384, "businessZoneName": "金门机场", "poiType": null}], "cityCode": 1174, "cityName": "泉州", "coverImageUrl": null, "districtName": null, "geoInfo": {"distance": 63229, "name": "市中心", "type": 1, "typeName": "市中心"}, "grade": 2, "hotelId": 763319, "location": {"lat": "24.396442", "lon": "118.314335"}, "name": "金门珠山82号民宿", "payMode": null, "price": null, "priceStatus": 1, "promotion": null, "saleType": 0, "score": null, "star": 0, "themes": [], "totalComments": null}
json转为csv
import csv
import json
import codecs
'''
将json文件格式转为csv文件格式并保存。
'''
class Json_Csv():
#初始化方法,创建csv文件。
def __init__(self):
self.save_csv = open('D:/hotels_out.csv', 'w', encoding='utf-8', newline='')
self.write_csv = csv.writer(self.save_csv, delimiter=',') #以,为分隔符
def trans(self,filename):
with codecs.open(filename,'r',encoding='utf-8') as f:
read=f.readlines()
flag=True
for index,info in enumerate(read):
data=json.loads(info)
if index <3000: #读取json文件的前3000行写入csv文件 。要是想写入全部,则去掉判断。
if flag: #截断第一行当做head
keys=list(data.keys()) #将得到的keys用列表的形式封装好,才能写入csv
self.write_csv.writerow(keys)
flag=False #释放
value=list(data.values()) #写入values,也要是列表形式
self.write_csv.writerow(value)
self.save_csv.close() #写完就关闭
if __name__=='__main__':
json_csv=Json_Csv()
path='D:/hotels.txt'
json_csv.trans(path)
以上为个人经验,希望能给大家一个参考,也希望大家多多支持脚本之家。
来源:https://blog.csdn.net/weixin_45081640/article/details/117357087
标签:Python,json数据,csv文件
![](/images/zang.png)
![](/images/jiucuo.png)
猜你喜欢
网页制作前台之javascript
2013-07-23 08:32:59
Python打工人必备之windows倒计时锁屏功能的实现
2021-01-18 04:21:21
Python 中闭包与装饰器案例详解
2021-08-08 12:28:32
![](https://img.aspxhome.com/file/2023/2/84992_0s.png)
python 字典中文key处理,读取,比较方法
2021-11-30 20:42:36
![](https://img.aspxhome.com/file/2023/4/72094_0s.jpg)
sqlserver清空service broker中的队列的语句分享
2011-09-30 11:33:35
Python使用Opencv打开笔记本电脑摄像头报错解问题及解决
2022-12-02 10:32:01
Dreamweaver滑动菜单的制作[图]
2007-11-08 12:43:00
![](https://img.aspxhome.com/file/UploadPic/20072/200723113814365s.gif)
golang copy函数使用的坑
2023-07-09 19:53:44
微信小程序 云开发模糊查询实现解析
2023-08-24 14:47:57
MySQL数据库的23个特别注意事项
2010-08-08 14:43:00
完美解决ARIMA模型中plot_acf画不出图的问题
2023-07-13 14:17:34
![](https://img.aspxhome.com/file/2023/1/61761_0s.jpg)
什么是gzip,人肉gzip?
2008-11-20 13:01:00
Python 统计Jira的bug 并发送邮件功能
2021-03-24 05:44:24
![](https://img.aspxhome.com/file/2023/3/83783_0s.jpg)
Python shapefile转GeoJson的2种方式实例
2023-02-20 01:07:52
![](https://img.aspxhome.com/file/2023/7/71427_0s.jpg)
Python中csv模块的基本使用教程
2021-06-20 21:49:55
![](https://img.aspxhome.com/file/2023/2/92232_0s.jpg)
JAVA正则表达式校验qq号码的方法
2023-08-09 02:54:25
![](https://img.aspxhome.com/file/2023/6/64936_0s.png)
Python及PyCharm下载与安装教程
2022-10-04 08:19:54
![](https://img.aspxhome.com/file/2023/3/90433_0s.png)
CSS和HTML与前端技术层图示
2010-04-05 21:54:00
![](https://img.aspxhome.com/file/UploadPic/20104/5/200851918234142177801-87s.gif)
Python的函数的一些高阶特性
2022-06-04 15:06:28
Python collections.deque双边队列原理详解
2022-02-21 04:25:00
![](https://img.aspxhome.com/file/2023/0/90890_0s.png)