2017年04月_Aegeaner

12月 09月 08月 07月 06月 05月 04月 03月 02月 01月

翻译 Flink Streaming cornerstones

摘自Flink-forward的一张幻灯片，也是衡量流计算平台的四个很好的基准和标尺。

2017-04-25 22:33:12 471

原创 Flink容错机制源码分析

Flink容错机制（基于FLIP6的YARN架构）YARN application master启动：YarnFlinkApplicationMasterRunnerrunApplicationMaster(flinkConfig) 启动RPC服务初始化resource manager初始化job master参数启动resource manager启动job manager runn

2017-04-25 22:19:53 1144

原创 Beam学习笔记（3）：Flink Streaming Pipeline Translator

FlinkStreamingPipelineTranslator1 所有的可用Translator：// here you can find all the available translators. static { TRANSLATORS.put(Read.Bounded.class, new BoundedReadSourceTranslator()); TRANSLAT

2017-04-25 22:18:00 767

原创 Beam学习笔记（2）：Flink Runner简介

Beam Flink Runner实现创建FlinkPipelineExecutionEnvironment；调用FlinkPipelineExecutionEnvironment.translate(FlinkRunner flinkRunner, Pipeline pipeline)方法，将pipeline翻译为flink程序，分为两种模式：STREAMING 和 BATCH，分别在Flin

2017-04-25 22:16:44 1379

原创 Beam学习笔记（1）：SDK简介

SDK调用流程Beam SDK的通常使用套路是这样的：1. Pipeline p = Pipeline.create(options); // 创建pipeline2. p.apply(PTransform t)…… // 对pipeline实施一系列变换3. p.run().waitUntilFinish(); // 由Runner实现run()方法PTransformPTransfor

2017-04-25 22:14:49 900

The Architecture of Open Source Applications

讲开源软件架构的书。 Contents Introduction Amy Brown and Greg Wilson ix 1. Asterisk Russell Bryant 1 2. Audacity James Crook 15 3. The Bourne-Again Shell Chet Ramey 29 4. Berkeley DB Margo Seltzer and Keith Bostic 45 5. CMake Bill Hoffman and Kenneth Martin 67 6. Eclipse Kim Moir 77 7. Graphite Chris Davis 101 8. The Hadoop Distributed File System Robert Chansler, Hairong Kuang, Sanjay Radia, Konstantin Shvachko, and Suresh Srinivas 111 9. Continuous Integration C. Titus Brown and Rosangela Canino-Koning 125 10. Jitsi Emil Ivov 139 11. LLVM Chris Lattner 155 12. Mercurial Dirkjan Ochtman 171 13. The NoSQL Ecosystem Adam Marcus 185 14. Python Packaging Tarek Ziadé 205 15. Riak and Erlang/OTP Francesco Cesarini, Andy Gross, and Justin Sheehy 229 16. Selenium WebDriver Simon Stewart 245 17. Sendmail Eric Allman 271 18. SnowFlock Roy Bryant and Andrés Lagar-Cavilla 291 19. SocialCalc Audrey Tang 303 20. Telepathy Danielle Madeley 325 21. Thousand Parsec Alan Laudicina and Aaron Mavrinac 345 22. Violet Cay Horstmann 361 23. VisTrails Juliana Freire, David Koop, Emanuele Santos, Carlos Scheidegger, Claudio Silva, and Huy T. Vo 377 24. VTK Berk Geveci and Will Schroeder 395 25. Battle For Wesnoth Richard Shimooka and David White 411 Bibliography Making Software

2011-09-17