spark graphx
lief2liu
这个作者很懒,什么都没留下…
展开
-
spark graphx 教程01(graphx基本概念)
spark graphx是什么 GraphX is a new component in Spark for graphs and graph-parallel computation. At a high level, GraphX extends the Spark RDD by introducing a new Graph abstraction: a directed multigra...原创 2019-05-13 20:04:23 · 624 阅读 · 0 评论 -
spark graphx 教程 02(基本代码)
现在我们从代码着手来快速体验一下spark graphx,首先graph类在spark中的路径是org.apache.spark.graphx,我们进去看看源代码 graph基本属性 我们在spark的graph类,看到了很多方法,但是属性只看到了如下3个基本属性: /** * An RDD containing the vertices and their associated att...原创 2019-05-14 20:15:58 · 700 阅读 · 0 评论 -
spark graphx 教程 03 (结构化算子)
spark graphx 03 (结构化算子) spark有如下4种结构化算子: reverse subgraph mask groupEdges 为了演示以上4种结构化算子,我们首先初始化一个graph,代码如下 val users: RDD[(VertexId, (String, String))] = sc.parallelize(Array((1L, ("a", "student"...原创 2019-05-27 19:48:33 · 477 阅读 · 0 评论 -
spark graphx 教程 04 (join 算子)
spark graphx 04 (join 算子) 为了演示graph的join算子,首先我们定义一个graph val users: RDD[(VertexId, (String, String))] = sc.parallelize(Array( (1L, ("a", "student")), (2L, ("b", "salesman")), (3L, ("c", "pro...原创 2019-05-27 19:59:56 · 708 阅读 · 1 评论