spark 相关性分析_Spark MLlib基本算法【相关性分析、卡方检验、总结器】

/*** Tools for vectorized statistics on MLlib Vectors.

*

* The methods in this package provide various statistics for Vectors contained inside DataFrames.

*

* This class lets users pick the statistics they would like to extract for a given column. Here is

* an example in Scala:

* { { {

* import org.apache.spark.ml.linalg._

* import org.apache.spark.sql.Row

* val dataframe = ... // Some dataframe containing a feature column and a weight column

* val multiStatsDF = dataframe.select(

* Summarizer.metrics("min", "max", "count").summary($"features", $"weight")

* val Row(Row(minVec, maxVec, count)) = multiStatsDF.first()

* }}}

*

* If one wants to get a single metric, shortcuts are also available:

* { { {

* val me