spark
mr_维
这个作者很懒,什么都没留下…
展开
-
spark Parallel Computation log
1. build a method to simulate a algorithm run (Do not use the thread te)原创 2014-04-22 14:54:59 · 565 阅读 · 0 评论 -
spark scala code demo for def class etc.
a demo for code reference:import org.apache.spark.SparkContextimport java.util.HashMapimport org.apache.spark.rdd.RDDclass NF(hv: ClassA) extends Serializable { var powerMap: HashMap[Stri原创 2014-05-09 17:16:27 · 432 阅读 · 0 评论 -
spark running script setting
1. build a sh(sparkrun.sh) scripts as follows;#!/usr/bin/env bashexport SPARK_MEM=3gCP=$CLASSPATH:/opt/spark-0.9.0-incubating-bin-hadoop2/conf:/opt/spark-0.9.0-incubating-bin-hadoop2/assembly/targ原创 2014-04-25 16:17:25 · 643 阅读 · 0 评论 -
spark技术分析—sparkUI
1. SparkUI中Jetty服务开发(基本接口)public class ServletContextServer { public static void main(String[] args) throws Exception { //创建服务 Server server = new Server(8080);原创 2015-08-18 13:04:07 · 559 阅读 · 0 评论