spark-streaming
宁桑榆
这个作者很懒,什么都没留下…
展开
-
spark-streaming的direct方式保存offset到zookeeper
maven依赖 <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.11</artifactId> <scope>provided</s...原创 2019-10-09 10:02:41 · 242 阅读 · 1 评论 -
spark-streaming的direct方式保存offset到checkpoint
啥也别说上代码 object BIStreamingCK { val logger: Logger = Logger.getLogger("org.apache.spark") var checkPoitPath:String="" def main(args: Array[String]): Unit = { logger.setLevel(Level.WARN) ...原创 2019-10-09 10:12:39 · 415 阅读 · 0 评论