ETL数据整合资料积累

 

https://www.cnblogs.com/yjd_hycf_space/p/7772722.html

ETL讲解（很详细！！！）

 

https://blog.csdn.net/tygxy574232205/article/details/81865973

StreamSets使用指南

 

 

https://cloud.tencent.com/developer/article/1078852

如何在CDH中安装和使用StreamSets

 

https://zhuanlan.zhihu.com/p/83314252?from_voters_page=true

关于StreamSets ETL工具的简单部署和使用

 

============================================================

https://blog.csdn.net/Mathieu66/article/details/88615902?utm_medium=distribute.pc_aggpage_search_result.none-task-blog-2~all~first_rank_v2~rank_v25-16-88615902.nonecase

 《StreamSets安装及Mysql数据同步入门示例》

========================================================

https://blog.csdn.net/jinxlzc/article/details/89638631?utm_medium=distribute.pc_aggpage_search_result.none-task-blog-2~all~first_rank_v2~rank_v25-3-89638631.nonecase

STREAMSETS自学——导入外部包

在使用StreamSets做数据迁移时，目前我进行的是MySQL，SQL server，Oracle之间的数据迁移，所以我要导入如下的外部包

===========================================================

https://blog.csdn.net/macalzheng/article/details/106973786?utm_medium=distribute.pc_aggpage_search_result.none-task-blog-2~all~first_rank_v2~rank_v25-4-106973786.nonecase

StreamSets实战之路（十二）-基础篇- StreamSets-数据流管理

StreamSets实战之路（一）-基础篇- StreamSets-数据流管理

https://blog.csdn.net/macalzheng/article/details/105757679

StreamSets实战之路（二）

https://www.cnblogs.com/xiajq/p/11218858.html

docker-docke安装和镜像仓库安装和管理

https://www.bilibili.com/video/BV1og4y1q7M4?from=search&seid=2205486603142255431

【狂神说Java】Docker最新超详细版教程通俗易懂

装docker

https://docs.docker.com/engine/install/centos/

阿里云镜像加速器

https://cr.console.aliyun.com/cn-hangzhou/instances/mirrors

配置使用

您可以通过修改daemon配置文件/etc/docker/daemon.json来使用加速器

sudo mkdir -p /etc/docker
sudo tee /etc/docker/daemon.json <<-'EOF'
{
  "registry-mirrors": ["https://qdquri71.mirror.aliyuncs.com"]
}
EOF
sudo systemctl daemon-reload
sudo systemctl restart docker

解决Docker:Failed to start docker.service: Unit not found问题

1.先更新系统 yum update
2.卸载Docker
3.然后重启系统
4.重新安装docker

 

卸载旧的版本

yum remove docker \
                  docker-client \
                  docker-client-latest \
                  docker-common \
                  docker-latest \
                  docker-latest-logrotate \
                  docker-logrotate \
                  docker-selinux \
                  docker-engine-selinux \
                  docker-engine

rm -rf /etc/systemd/system/docker.service.d

rm -rf /var/lib/docker

rm -rf /var/run/docker

安装所需要的的包，设置镜像仓库

$ sudo yum install -y yum-utils

$ sudo yum-config-manager \
    --add-repo \
 http://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo

更新缓存

yum makecache fast

安装社区版docker最新版

$ sudo yum install docker-ce docker-ce-cli containerd.io

 启动docker

$ sudo systemctl start docker

 

systemctl daemon-reload

 vim daemon.json

原来的内容：

{"registry-mirrors": ["http://bc437cce.m.daocloud.io"]}
{
   "graph": "/mnt/docker-data",
  "storage-driver": "overlay"
}
 

systemctl status docker.service  查看服务状态

----------------------------------------------------------------------------------------------------

使用脚本安装：https://blog.csdn.net/tjjingpan/article/details/80027423

curl -fsSL https://get.docker.com | bash -s docker --mirror Aliyun

https://blog.csdn.net/qq_34691713/article/details/83895617 Centos下安装mysql时出现Delta RPMs disabled because /usr/bin/applydeltarpm not installed解决办法

systemctl start docker

查看日志：docker logs openresty

======================================================

https://blog.csdn.net/educast/article/details/89954339

Docker 国内仓库和镜像

3.3没有执行成功

3.2  使用脚本来配置加速站点

curl -sSL https://raw.githubusercontent.com/wss434631143/xiaoshujiang/master/articles/Docker/shell/set_mirror.sh | sh -s <https://qdquri71.mirror.aliyuncs.com>

-bash: 未预期的符号 `newline' 附近有语法错误

3.4ExecStart=/usr/bin/dockerd registry-mirror=<https://qdquri71.mirror.aliyuncs.com>