Unsupervised learning notes

最新推荐文章于 2024-09-27 10:58:53 发布

Frankooool

最新推荐文章于 2024-09-27 10:58:53 发布

阅读量787

点赞数

分类专栏： Python 数据科学学习文章标签：人工智能

本文链接：https://blog.csdn.net/frankooool/article/details/124383112

版权

Python 数据科学学习专栏收录该内容

6 篇文章 1 订阅

订阅专栏

本文探讨了无监督学习中的两种主要技术：主成分分析（PCA）和降维方法。PCA用于在保持大部分数据信息的同时减少特征数量。通过标准化数据，应用PCA将乳腺癌数据集从高维降至二维。此外，还介绍了多维缩放（MDS）和t-SNE，它们分别致力于保持距离信息和邻近关系的低维投影。MDS和t-SNE同样应用于水果数据集，实现了数据的可视化降维。

摘要由CSDN通过智能技术生成

Unsupervised Learning

Dimensionality Reduction

PCA

Find the features that capture most of the data points.

(https://www.youtube.com/watch?v=HMOI_lkzW08)

from sklearn.preprocessing import StandardScaler
from sklearn.decomposition import PCA
from sklearn.datasets import load_breast_cancer

cancer = load_breast_cancer()
(X_cancer, y_cancer) = load_breast_cancer(return_X_y = True)

# Before applying PCA, each feature should be centered (zero mean) and with unit variance
X_normalized = StandardScaler().fit(X_cancer).transform(X_cancer)  

pca = PCA(n_components = 2).fit(X_normalized)

X_pca = pca.transform(X_normalized)

Manifold Learning

Multidimensional scaling (MDS) attempts to find a distance-preserving low dimensional projection.

t-SNE finds a 2D projection preserving information about neighbours. (Also use the distance from the high dimension and project to 2D, but focus on distance between neighbours)

（https://distill.pub/2016/misread-tsne/#citation）

from adspy_shared_utilities import plot_labelled_scatter
from sklearn.preprocessing import StandardScaler
from sklearn.manifold import MDS

# each feature should be centered (zero mean) and with unit variance
X_fruits_normalized = StandardScaler().fit(X_fruits).transform(X_fruits)  

mds = MDS(n_components = 2)

X_fruits_mds = mds.fit_transform(X_fruits_normalized)


from sklearn.manifold import TSNE

tsne = TSNE(random_state = 0)

X_tsne = tsne.fit_transform(X_fruits_normalized)