【算法比赛】主流机器学习/深度学习模型代码模板

最新推荐文章于 2024-08-11 02:25:31 发布

alicelmx

最新推荐文章于 2024-08-11 02:25:31 发布

阅读量1.4k

点赞数 1

分类专栏：算法比赛相关文章标签：算法比赛机器学习 kaggle 天池

本文链接：https://blog.csdn.net/alicelmx/article/details/84063460

版权

这篇博客分享了算法比赛中常用的机器学习和深度学习模型代码，包括Logistic Regression, LightGBM, XGBoost以及Keras的二分类和多分类应用。还针对正负样本不均衡的问题提供了调整样本比例、过采样、欠采样等解决方案，并推荐了相关框架imbalanced-learn。" 86578003,8025395,MT6750芯片详解与开发资源分享,"['联发科芯片', 'MT6750数据表', 'MT6750规格书', '手机芯片', '处理器技术']

摘要由CSDN通过智能技术生成

摘要

最近又开始混乱且忙碌的科研学习，双十一过后，钱包空了，就再不想买买买了，打比赛的议程又提上来了，首先给大家分享两个非常非常非常好的repo，昨天晚上才发现的，又请教了一个博士点经验，踏踏实实准备，浮躁的心就能沉淀下来～

更新最新最全的算法比赛信息：https://github.com/iphysresearch/DataSciComp
各种比赛的top解决方案：https://github.com/Smilexuhc/Data-Competition-TopSolution

一定要多交流多交流，算法岗没有想想的这么难的！
这个就相当于作文模板，稍微改改就能拿来使用啦～

Preprocess

# 通用的预处理框架

import pandas as pd
import numpy as np
import scipy as sp

# 文件读取
def read_csv_file(f, logging=False):
    print("==========读取数据=========")
    data =  pd.read_csv(f)
    if logging:
        print(data.head(5))
        print(f, "包含以下列")
        print(data.columns.values)
        print(data.describe())
        print(data.info())
    return data

Logistic Regression

# 通用的LogisticRegression框架

import pandas as pd
import numpy as np
from scipy import sparse
from sklearn.preprocessing import OneHotEncoder
from sklearn.linear_model import LogisticRegression
from sklearn.preprocessing import StandardScaler

# 1. load data
df_train = pd.DataFrame()
df_test  = pd.DataFrame()
y_train = df_train['label'].values

# 2. process data
ss = StandardScaler()


# 3. feature engineering/encoding
# 3.1 For Labeled Feature
enc = OneHotEncoder()
feats = ["creativeID", "adID", "campaignID"]
for i, feat in enumerate(feats):
    x_train = enc.fit_transform(df_train[feat].values.reshape(-1, 1))
    x_test = enc.fit_transform(df_test[feat].values.reshape(-1, 1))
    if i == 0:
        X_train, X_test = x_train, x_test
    else:
        X_train, X_test = sparse.hstack((X_train, x_train)), sparse.hstack((X_test, x_test))

# 3.2 For Numerical Feature
# It must be a 2-D Data for StandardScalar, otherwise reshape(-1, len(feats)) is required
feats = ["price", "age"]
x_train = ss.fit_transform(df_train[feats].values)
x_test  = ss.fit_transform(df_test[feats].values)
X_train, X_test = sparse.hstack((X_train, x_train)), sparse.hstack((X_test, x_test))

# model training
lr = LogisticRegression()
lr.fit(X_train, y_train)
proba_test = lr.predict_proba(X_test)[:, 1]

LightGBM

1. 二分类

import lightgbm as lgb
import pandas as pd
import numpy as np
import pickle
from sklearn.metrics import roc_auc_score
from sklearn.model_selection import train_test_split

print("Loading Data ... ")

# 导入数据
train_x, train_y, test_x = load_data()

# 用sklearn.cross_validation进行训练数据集划分，这里训练集和交叉验证集比例为7：3，可以自己根据需要设置
X, val_X, y, val_y = train_test_split(
    train_x,
    train_y,
    test_size=0.05,
    random_state=1,
    stratify=train_y ## 这里保证分割后y的比例分布与原数据一致
)

X_train = X
y_train = y
X_test = val_X
y_test = val_y