Spark
joeywen
努力做正确的事
展开
-
Spark K-Means 算法实践之Java版
还没时间整理,先把代码贴上来。package spark.examples;import spark.api.java.*;import spark.api.java.function.*;import java.util.HashMap;import java.util.Iterator;import java.util.List;import java.util.A原创 2013-09-20 13:24:12 · 5137 阅读 · 4 评论 -
Spark 与Storm 异同
http://xinhstechblog.blogspot.com/2014/06/storm-vs-spark-streaming-side-by-side.htmlStorm vs. Spark Streaming: Side-by-side comparisonOverviewBoth Storm and Spark Streaming are open-原创 2014-08-12 10:05:33 · 2858 阅读 · 0 评论 -
DAG (directed acyclic graph) 作为大数据执行引擎的优点
TL;DR - Conceptually DAG model is a strict generalization of MapReduce model. DAG-based systems like Spark and Tez that are aware of the whole DAG of operations can do better global optimizations than原创 2014-12-04 14:29:04 · 7418 阅读 · 0 评论