1. 创建用户sdc
2. 在/home/sdc目录下,下载tar: https://archives.streamsets.com/datacollector/3.8.0/tarball/streamsets-datacollector-all-3.8.0.tgz
streamsets-datacollector-core-3.8.0.tgz
3. 解压:tar zxvf streamsets-datacollector-core-3.8.0.tgz
4. 创建jdbc相关文件的目录sdc-extras
cd streamsets-datacollector-3.8.0
mkdir sdc-extras
5. 配置环境
vi /etc/security/limits.conf,添加:
sdc hard nofile 32768
sdc soft nofile 32768
vi /etc/profile,添加:
export STREAMSETS_LIBRARIES_EXTRA_DIR="/home/sdc/streamsets-datacollector-3.8.0/sdc-extras/"
再就是streamsets根目录下,vi etc/sdc-security.policy,修改:
// For JARs to be available to all stage libraries
grant codebase "file:///home/sdc/streamsets-datacollector-3.8.0/sdc-extras/-" {
permission java.security.AllPermission;
};
6. 安装jdbc-libs
在streamsets根目录下,执行: bin/streamsets stagelib -install=streamsets-datacollector-jdbc-lib
7.启动
bin/streamsets dc &