Storm
victory0508
这个作者很懒,什么都没留下…
展开
-
Storm Trident指南
Trident是对基于Storm做实时计算的高层抽象。它可以使得高吞吐量、有状态的流处理与低延迟的分布式查询无缝衔接。如果你熟悉高水平的批处理工具如Pig/Cascading,那么Trident的概念将易于理解。Trident具有joins、aggregations、grouping、functions和filters。除此之外,Trident增加了基于任何数据库或持久化存储的有状态、持续处理翻译 2014-06-13 15:36:59 · 1680 阅读 · 0 评论 -
storm-cassandra
将Storm和Integrates Storm and Cassandra by providing a generic and configurable backtype.storm.Bolt implementation that writes StormTuple objects to a Cassandra Column Family.How the Storm Tuple翻译 2014-06-13 09:36:27 · 1168 阅读 · 0 评论 -
Distributed RPC
在distributedRPC (DRPC)中的思想是对Storm上许多Function计算的并行化。Stormtopology以function参数流作为输入,emits这些Function调用的结果作为输出。DRPC并不是Storm的特征,而是由Storm的primitive,即由streams,spouts, bolts, and topologies表达的pattern。DRPC被翻译 2014-06-13 20:45:06 · 771 阅读 · 0 评论 -
Storm Multi-Language Protocol
Shell ComponentsSupport for multiple languages is implemented via the ShellBolt,ShellSpout, and ShellProcess classes. These classes implement theIBolt and ISpout interfaces and the protocol for exec翻译 2014-06-14 21:06:29 · 644 阅读 · 0 评论 -
Trident state
State in TridentTrident含有 has first-class abstractions for reading from and writing to stateful sources. The state can either be internal to the topology – e.g., kept in-memory and backed by HDFS翻译 2014-06-16 22:45:17 · 1097 阅读 · 0 评论 -
Cascalog入门
About this guide本指南包括:How to add Cascalog dependency to your projectWord count example in both Java and ClojureRun a Cascalog query from Clojure nREPLIntroduction to basic conceptsPointers for w翻译 2014-06-15 22:10:54 · 1065 阅读 · 0 评论 -
Kafka入门
1. 入门1.1 介绍翻译 2014-06-17 16:32:43 · 793 阅读 · 0 评论 -
Storm Trident
1. 数据结构Stream是核心数据模型,也被称之为TridentTuple,并划分为若干Partition,以一系列的 batch来处理Stream,batch既可以包含在一个Partition中,也可能在若干Partition之上。2.操作Partition-local operations,对每个partition的局部操作,不产生网络传输Repartitioning ope原创 2015-03-26 21:58:42 · 572 阅读 · 0 评论