2019年08月_tian_shl

08月 06月 04月

原创 SpringCloud DataFlow — 5. 多分支负载

1. 目的通过分支部署, 起到负载的效果, 提升处理速度2. 示例3. 导入jarapp import --uri https://dataflow.spring.io/kafka-maven-latestapp register --type processor --name unpack --uri maven://etl.dmt.quick:unpack-processor-k...

2019-08-26 14:51:08 406

原创 SpringCloud DataFlow — 4. Prometheus + Grafana 监控

以 unpack-processor-kafka 为例1. pom.xml 中添加依赖1.1 dependencies<dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-actuator</art...

2019-08-26 14:49:45 66534 1

原创 SpringCloud DataFlow — 3. 暴露properties

1. 创建properties类package etl.dmt.quick.unpackprocessorkafka.config;import org.springframework.boot.context.properties.ConfigurationProperties;import org.springframework.validation.annotation.Valida...

2019-08-26 14:48:44 283

原创 SpringCloud DataFlow — 2. 自定义Sink

Sink# 参考文档https://dataflow.spring.io/docs/stream-developer-guides/streams/standalone-stream-kafka/#business-logic-2# Spring Initialzrhttps://start.spring.io/新建Maven项目1. 基本信息Group: etl.dmt.qui...

2019-08-26 14:47:25 687

原创 SpringCloud DataFlow — 1. 自定义Processor

Processor# 参考文档https://dataflow.spring.io/docs/stream-developer-guides/streams/standalone-stream-kafka/#usagecostprocessor-processor# Spring Initialzrhttps://start.spring.io/新建Maven项目1. 基本信息G...

2019-08-26 14:46:09 505

原创 SpringCloud DataFlow — 0. 本地部署

# 参考文档https://dataflow.spring.io/docs/installation/local/manual/1. skipper1.1 下载wget https://repo.spring.io/release/org/springframework/cloud/spring-cloud-skipper-server/2.1.0.RELEASE/spring-clou...

2019-08-26 14:44:22 542

原创 CentOS 挂载数据盘

查看已挂载的磁盘df -h列出所有磁盘fdisk -l格式化硬盘fdisk /dev/vdb创建分区mkfs.ext4 /dev/vdb1挂载分区# 创建目录mkdir /datamount /data# 挂载分区mount /dev/vdb1 /data# 查看已挂载df -h设置自动挂载vim /etc/fstab# 末尾添加一行/dev...

2019-08-06 10:52:11 6216