Flink
文章平均质量分 88
张包峰
Distributed Computing
展开
-
Flink Runtime 1.0 Notes: Plan 2 Task
AboutI will try to give the mainline of how does Flink buildint the logical plan 2 physical plan 2 task. Main classes and methods are mentioned.Format explainationthis is Class this is method()thi原创 2016-05-17 11:29:26 · 3176 阅读 · 0 评论 -
Flink Runtime 1.0 Notes: Task Execution(1)
AboutI will try to give the mainline of how does Flink task works.Main classes and methods are mentioned.Format explainationthis is Class this is method()this is constantTask ExecutionTask Compone原创 2016-05-18 15:53:00 · 3232 阅读 · 0 评论 -
Flink sql的实现
SQL Impl in Flink跟了下Flink Table里sql的实现,flink sql的实现比较简单,一句话概述就是:借助Apache Calcite做了sql解析、逻辑树生成的过程,得到Calcite的RelRoot类,生成flink的Table,Table里的执行计划会转化成DataSet的计算,经历物理执行计划优化等步骤。类比Spark SQL,Calcite代替了大部分Spark原创 2016-06-08 16:17:33 · 12461 阅读 · 0 评论 -
Flink SQL 1.0+ UT Cases
Flink SQL UT Case截止当前flink master分支最新的代码(未完成的1.1版本),Flink Table项目的UT,batch sql(即直接调用.sql())的sql, logicalPlan, physicalPlan整理。/** Filter **/SELECT * FROM MyTable WHERE falseLogicalProject(_1=[$0], _2=[$原创 2016-07-11 16:13:18 · 2447 阅读 · 0 评论 -
Flink StreamSQL简介
Flink Stream SQLOverviewblog https://flink.apache.org/news/2016/05/24/stream-sql.html提到目前Table API的问题,batch和stream的API各自能支持的query不一样。 However, the original Table API had a few limitations. First of a原创 2016-07-01 17:28:03 · 13984 阅读 · 0 评论