pandas 数据归一化以及行删除例程的方法
作者:夜月xl 时间:2022-05-23 09:11:23
如下所示:
#coding:utf8
import pandas as pd
import numpy as np
from pandas import Series,DataFrame
# 如果有id列,则需先删除id列再进行对应操作,最后再补上
# 统计的时候不需要用到id列,删除的时候需要考虑
# delete row
def row_del(df, num_percent, label_len = 0):
#print list(df.count(axis=1))
col_num = len(list(list(df.values)[1])) - label_len # -1为考虑带标签
if col_num<0:
print 'Error'
#print int(col_num*num_percent)
return df.dropna(axis=0, how='any', thresh=int(col_num*num_percent))
# 如果有字符串类型,则报错
# data normalization -1 to 1
# label_col: 不需考虑的类标,可以为字符串或字符串列表
# 数值类型统一到float64
def data_normalization(df, label_col = []):
lab_len = len(label_col)
print label_col
if lab_len>0:
df_temp = df.drop(label_col, axis = 1)
df_lab = df[label_col]
print df_lab
else:
df_temp = df
max_val = list(df_temp.max(axis=0))
min_val = list(df_temp.min(axis=0))
mean_val = list((df_temp.max(axis=0) + df_temp.min(axis=0)) / 2)
nan_values = df_temp.isnull().values
row_num = len(list(df_temp.values))
col_num = len(list(df_temp.values)[1])
for rn in range(row_num):
#data_values_r = list(data_values[rn])
nan_values_r = list(nan_values[rn])
for cn in range(col_num):
if nan_values_r[cn] == False:
df_temp.values[rn][cn] = 2 * (df_temp.values[rn][cn] - mean_val[cn])/(max_val[cn] - min_val[cn])
else:
print 'Wrong'
for index,lab in enumerate(label_col):
df_temp.insert(index, lab, df_lab[lab])
return df_temp
# 创建一个带有缺失值的数据框:
df = pd.DataFrame(np.random.randn(5,3), index=list('abcde'), columns=['one','two','three'])
df.ix[1,:-1]=np.nan
df.ix[1:-1,2]=np.nan
df.ix[0,0]=int(1)
df.ix[2,2]='abc'
# 查看一下数据内容:
print '\ndf1'
print df
print row_del(df, 0.8)
print '-------------------------'
df = data_normalization(df, ['two', 'three'])
print df
print df.dtypes
print (type(df.ix[2,2]))
来源:https://blog.csdn.net/u013045749/article/details/47019493
标签:pandas,数据,归一化
![](/images/zang.png)
![](/images/jiucuo.png)
猜你喜欢
python3实现网页版raspberry pi(树莓派)小车控制
2021-05-05 05:35:18
![](https://img.aspxhome.com/file/2023/3/101283_0s.jpg)
设计和企业文化
2009-03-28 10:35:00
有效网页表单的八条规则[译]
2009-06-01 10:29:00
![](https://img.aspxhome.com/file/UploadPic/20096/1/01-18s.png)
Python实现计算图像RGB均值方式
2024-01-01 20:50:31
![](https://img.aspxhome.com/file/2023/3/99513_0s.jpg)
Python人工智能之混合高斯模型运动目标检测详解分析
2021-11-01 21:28:43
![](https://img.aspxhome.com/file/2023/8/92418_0s.jpg)
php中json 序列化为 [] 的弊端
2023-05-25 00:14:30
Mysql入门系列:MYSQL日志文件维护
2008-11-24 13:10:00
![](https://img.aspxhome.com/file/UploadPic/200811/20081129183218725.jpg)
基于keras中import keras.backend as K的含义说明
2023-04-28 08:43:27
统一的品牌设计
2008-08-07 12:53:00
![](https://img.aspxhome.com/file/UploadPic/20088/7/200887125533323s.jpg)
Pycharm更换python解释器的方法
2023-03-23 10:02:58
记得使用try+catch
2010-01-29 12:48:00
浅谈pycharm使用及设置方法
2023-12-18 21:17:47
![](https://img.aspxhome.com/file/2023/9/118769_0s.png)
python实现图像识别功能
2023-08-09 08:45:00
框架iframe子页面,自适应高度方法
2008-06-07 13:31:00
asp dictionary对象的用法
2011-04-14 11:09:00
详解Python time库的使用
2021-06-06 07:18:02
![](https://img.aspxhome.com/file/2023/4/95484_0s.png)
Python爬虫 bilibili视频弹幕提取过程详解
2023-07-05 06:41:25
![](https://img.aspxhome.com/file/2023/7/101567_0s.png)
前端也应关注安全
2009-03-16 17:02:00
jQuery技巧
2009-09-27 12:28:00
Oracle性能究极优化
2010-07-30 13:02:00