- 博客(11)
- 资源 (3)
- 收藏
- 关注
原创 Pyspark:随机森林
Building a Random Forests with PySparkDecision TreeRandom ForestsDecisionTreeRF的基本组件DT(决策树)决策树常用于分类和回归任务Entropy熵Entorpy of targetEntorpy of target with featuresInformation Gain 信息增益# ...
2019-04-25 20:19:17 2762
原创 PySpark 实现Logistic Regression模型
Logistic RegressionAlthough it is used for classification, it’s still called logistic regression .This is due to the linear regression equations still operate to find the relationship between input v...
2019-04-24 19:24:32 5381 1
原创 build a LinearRegressio moel using PySpark
Linear RegressionLinear Regression is one of the most fundamental machine learning algorithm.build ing a Linear Regression modelvarious assumptionevaluation metricsVariablesVariables capture d...
2019-04-23 19:56:48 443
原创 图神经网络库DGL的基础操作
DGL基本操作创建一个图读,写,点和边的表示Graph Creation创建一个networkx图networkx的图可以转化为DGL的图DGL的图可以转化为networkx的图创建一个petersen_graphpetersen graph :它是Petersen提出的一种简单的连通图,它一般画作五边形中包含有五角星的造型。Petersen图的同构多种多样,形态各异,共...
2019-04-21 17:36:38 18896 1
原创 图神经网络初探:build a simple graph nets
Building a simple graph nets model : (for classification)DGL : 一个图神经网络库问题描述:如下图所示,是一个小型社交网络关系图.关系网络中有34个节点,代表34个成员.不同的颜色表示两个不同的(group/community),整个网络中有两个中心节点(0,33):align: center任务:预测每一个成员,倾向于哪...
2019-04-20 20:30:13 2867 2
原创 重要通知:!!!
各位网友:我在github上建了一个仓库,如果你想要要获得哪些blog的代码,可以在这个仓库,给我issue,我会尽量满足大家的,欢迎issue, star, watch, fork.地址:https://github.com/wang-jinghui/MyCSDN_Blog...
2019-04-20 11:19:01 887 1
原创 PySpark: DataProcessing(csv file)
data processing using pysparkfrom pyspark.sql import SparkSessionfrom pyspark.sql.functions import udffrom pyspark.sql.types import StringType, DoubleType, IntegerTypefrom pyspark.sql.functions im...
2019-04-19 21:01:06 752
原创 Tensorflow 2.0 : CNN
import warningsimport numpy as npimport pandas as pdimport seaborn as snsimport tensorflow as tfimport matplotlib.pyplot as pltfrom tensorflow import kerasfrom tensorflow.keras import layers, m...
2019-04-07 16:41:48 3352
原创 Tensorflow 2.0 : FCNN
全连接神经网络FCNNTensorflow 2.0import warningsimport seaborn as snsimport pandas as pdimport tensorflow as tfimport matplotlib.pyplot as pltfrom tensorflow import kerasfrom tensorflow.keras import l...
2019-04-05 23:36:37 1670 1
原创 pyspark:basic_operating_1
multiplyfrom pyspark import SparkConf, SparkContextsc = SparkContext()# 累乘nums = sc.parallelize([1, 2, 3 ,4, 5])mult = nums.fold(1, (lambda x, y : x *y))print(mult)120# 累加accumulate = num...
2019-04-04 18:30:50 224
原创 pyspark: basic-operating_0
add-indicesfrom pyspark import SparkConf, SparkContextsc = SparkContext()a = {('g1', 2), ('g2', 4), ('g3', 3), ('g4', 8)}a{('g1', 2), ('g2', 4), ('g3', 3), ('g4', 8)}# rdd objectrdd = sc.par...
2019-04-04 16:47:06 157
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人