有关csv格式的数据转换成libsvm格式的数据

需要传入一个pandas的DataFrame格式的数据,将其转换为libsvm格式的数据
代码如下

# -*- coding: utf-8 -*-
"""
Created on Sat May 13 21:50:03 2017


@author: Administrator
"""
import pandas as pd 
import time
def df2ffm(df, fp):
        '''
        Convert pandas.DataFrame to data format that libffm can directly use


        @Args:
            df: pandas.DataFrame to be converted
            fp: save libffm format data to fp<filepath>
        '''
        now = time.time()
        print('Format Converting begin in time:...',now)
        columns = df.columns.values
        d = len(columns)
        feature_index = [i for i in range(d)]
        field_index = [0]*d
        field = []
        for col in columns:
            field.append(col.split('_')[0])
        index = -1
        for i in range(d):
            if i==0 or field[i]!=field[i-1]:
                index+=1
            field_index[i] = index


        with open(fp, 'w') as f:
            for row in df.values:
                line =str(int(row[0]))
                for i in range(1, len(row)):
                    if row[i]!=0:
                        line += " %d:%d" % (feature_index[i], row[i])
                line+='\n'
                f.write(line)
        print('finish convert,the cost time is ',time.time()-now)
        print('[Done]')
        print()

def main():
    df = pd.read_csv(r'E:\tencent\input\train1.csv')
    df = df.fillna(0) 
    fp = r'E:\tencent\output\train.csv' 
    df2ffm(df,fp)


if __name__ == '__main__':
    main()
评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值