val sink = new BucketingSinkString
sink.setBucketer(new DateTimeBucketer[String](“yyyy-MM-dd–HHmm”, ZoneId.of(“America/Los_Angeles”)))
sink.setWriter(new SequenceFileWriterIntWritable, Text)
sink.setBatchSize(1024 * 1024 * 400) // this is 400 MB,
sink.setBatchRolloverInterval(20 * 60 * 1000); // this is 20 mins
input.addSink(sink)
Bucketing设置时间
最新推荐文章于 2023-12-27 10:17:49 发布