风吴痕的博客

参考：1、http://spark.apache.org/docs/latest/quick-start.html2、https://github.com/mahmoudparsian/pyspark-tutorial3、https://github.com/jkthompson/pyspark-pictures安装参考：启动spark执行 /home/wu/d

参考：1、http://spark.apache.org/docs/latest/streaming-programming-guide.html2、https://github.com/apache/spark/tree/v2.2.0Spark Streaming Programming GuideOverviewA Quick ExampleBa

参考：1、http://spark.apache.org/docs/latest/structured-streaming-programming-guide.html2、https://github.com/apache/spark/tree/v2.2.0Structured Streaming Programming GuideOverviewQui

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/ml-clustering.htmlK-meansfrom pyspark

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/ml-collaborative-filtering.htmlfrom pys

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/mllib-dimensionality-reduction.htmlSVD Ex

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/mllib-evaluation-metrics.htmlClassificati

参考：1、http://spark.apache.org/docs/latest/quick-start.html2、https://github.com/mahmoudparsian/pyspark-tutorial3、https://github.com/jkthompson/pyspark-pictures4、http://spark.apache.org/docs/la

参考：1、http://spark.apache.org/docs/1.2.0/api/python/pyspark.html2、http://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame一、SparkContext API1、读取hdfs数据转成nu

参考：1、http://www.itnose.net/detail/6478156.htmlSpark On YARN 分布式集群安装2、http://blog.csdn.net/dream_an/article/details/52946840Hadoop2.7.3完全分布式集群部署过程Hadoop集群安装 参考：http://blog.csdn.net/dream_

GetStarted_Standalone(单机版)参考别人部署：http://mp.weixin.qq.com/s/sLyjwU-FZqoOtiGasJnTZwhttps://github.com/yahoo/TensorFlowOnSpark/wiki/GetStarted_standalonehttp://blog.csdn.net/u013041398/articl

参考：https://github.com/yahoo/TensorFlowOnSpark/wiki/GetStarted_YARNhttp://www.cnblogs.com/heimianshusheng/p/6768019.html基于Hadoop分布式集群YARN模式下的TensorFlowOnSpark平台搭建http://www.tuicool.com/articles

参考：http://spark.apache.org/docs/latest/rdd-programming-guide.htmlSpark Programming GuideOverviewLinking with SparkInitializing SparkUsing the ShellResilient Distributed Datasets (R

参考地址：http://spark.apache.org/docs/latest/quick-start.htmlQuick StartInteractive Analysis with the Spark ShellBasicsMore on Dataset OperationsCachingSelf-Contained ApplicationsWhere

参考地址：https://github.com/jadianes/spark-py-notebooksMLlib: Basic Statistics and Exploratory Data Analysis #!/usr/bin/python# -*- coding: UTF-8 -*-import urllibfrom pyspark import SparkCo

参考：1、https://github.com/apache/spark/tree/v2.2.02、http://spark.apache.org/docs/latest/sql-programming-guide.htmlSpark SQL, DataFrames and Datasets GuideOverviewSQLDatasets and Da

参考地址：1、https://jingyan.baidu.com/article/86fae346b696633c49121a30.html使用参考：1、https://www.gitbook.com/book/aiyanbo/spark-programming-guide-zh-cn/details2、https://github.com/search?utf8=%E

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.0

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/ml-classification-regression.htmlClassifica

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/ml-pipeline.htmlCode examplesExample: Est

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/ml-tuning.htmlCross-Validationfrom pyspark.

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/ml-frequent-pattern-mining.htmlfrom pyspark

参考地址：1、http://spark.apache.org/docs/latest/ml-guide.html2、https://github.com/apache/spark/tree/v2.2.03、http://spark.apache.org/docs/latest/ml-features.htmlExtracting, transforming

参考：1、https://github.com/mahmoudparsian/pyspark-tutorialDownload, Install Spark and Run PySparkBasics of PySparkPySpark Examples and TutorialsDNA Base CountingClassic Word CountFind

参考：https://github.com/seahboonsiew/pyspark-csvcsv数据介绍# blah.csvName, Model, Size, Width, DtJag, 63, 4, 4, '2014-12-23'Pog, 7.0, 5, 5, '2014-12-23'Peek, 68 xp, 5, 5.5, ''Usage

参考地址：https://github.com/jadianes/spark-py-notebooksRDD creation #!/usr/bin/python# -*- coding: UTF-8 -*-import urllibfrom pyspark import SparkContext,SparkConff = urllib.urlretrieve ("ht

参考地址：https://github.com/jadianes/spark-py-notebooksSpark SQL and Data Frames #!/usr/bin/python# -*- coding: UTF-8 -*-import urllibfrom pyspark import SparkContext,SparkConff = urllib.url