scikit-learn中的Scaler

最新推荐文章于 2024-06-28 14:42:59 发布

每天一道题

最新推荐文章于 2024-06-28 14:42:59 发布

阅读量168

点赞数 2

本文链接：https://blog.csdn.net/weixin_51711289/article/details/125250737

版权

机器学习专栏收录该内容

14 篇文章 0 订阅

订阅专栏

对测试数据集的归一化

在这里插入图片描述
注：测试数据集用的方差与均值应是训练数据集的方差与均值。

scikit-learn中的Scaler

import numpy as np
from sklearn import datasets
from sklearn.model_selection import train_test_split

iris = datasets.load_iris()

X = iris.data
y = iris.target

X_train, X_test, y_train, y_test = train_test_split(iris.data, iris.target, test_size = 0.2, random_state = 666)

scikit-learn中的StandardScaler

from sklearn.preprocessing import StandardScaler

standardScaler = StandardScaler()
standardScaler.fit(X_train)

之后我们可以看一下他的均值和标准差：

standardScaler.mean_
standardScaler.scale_

然后我们就可以进行归一化：

X_train = standardScaler.transform(X_train)
X_test_standard = standardScaler.transform(X_test)

最后我们可以看一下效果：
在这里插入图片描述

封装

import numpy as np

class StandardScaler:

    def __init__(self):
        self.mean_ = None
        self.scale_ = None

    def fit(self, X):
        assert X.ndim == 2, "The dimension of X must be 2"

        self.mean_ = np.array([np.mean(X[:,i]) for i in range(X.shape[1])])
        self.scale_ = np.array([np.std(X[:, i]) for i in range(X.shape[1])])

        return self

    def tranform(self, X):
        assert X.ndim == 2, "The dimension of X must be 2"
        assert self.mean_ is not None and self.scale_ is not None, \
            "must fit before transform!"
        assert X.shape[1] == len(self.mean_), \
            "the feature number of X must be equal to mean_ and std_"

        resX = np.empty(shape=X.shape, dtype=float)
        for col in range(X.shape[1]):
            resX[:,col] = (X[:, col] - self.mean_[col]) / self.scale_[col]

        return resX