CDK+CDS部署及案例+邮件预警

最新推荐文章于 2023-12-05 15:24:33 发布

钻石大门

最新推荐文章于 2023-12-05 15:24:33 发布

阅读量1.3k

点赞数

分类专栏： CDH

本文链接：https://blog.csdn.net/weixin_41158277/article/details/103707282

版权

本文详细介绍了使用CDK进行Kafka和CDS（CDH+Spark2）的部署过程，包括安装包下载、Parcel配置、服务添加与测试。同时，还涵盖了邮件监控的设置，如163邮箱至qq邮箱的邮件发送测试。

摘要由CSDN通过智能技术生成

1.CDK部署

1.1.安装包下载

地址：
http://archive.cloudera.com/kafka/parcels/4.1.0/KAFKA-4.1.0-1.4.1.0.p0.4-el7.parcel
http://archive.cloudera.com/kafka/parcels/4.1.0/KAFKA-4.1.0-1.4.1.0.p0.4-el7.parcel.sha1
http://archive.cloudera.com/kafka/parcels/4.1.0/manifest.json

#重命名为KAFKA-4.1.0-1.4.1.0.p0.4-el7.parcel.sha
[root@hadoop001 kafka_parcel]# mv KAFKA-4.1.0-1.4.1.0.p0.4-el7.parcel.sha1 KAFKA-4.1.0-1.4.1.0.p0.4-el7.parcel.sha
[root@hadoop001 kafka_parcel]# ll
total 85712
-rw-r--r-- 1 root root 87751486 Jul 11 22:04 KAFKA-4.1.0-1.4.1.0.p0.4-el7.parcel
-rw-r--r-- 1 root root       41 Jul 11 22:04 KAFKA-4.1.0-1.4.1.0.p0.4-el7.parcel.sha
-rw-r--r-- 1 root root     5212 Jul 11 22:04 manifest.json

1.2.Open http service

[root@hadoop001 kafka_parcel]# yum service httpd
[root@hadoop001 kafka_parcel]# service httpd start

#访问hadoop001，默认端口是80
http://47.112.39.95/
在这里插入图片描述
复制CDK文件到/var/www/html

[root@hadoop001 ~]# mv kafka_parcel /var/www/html/
[root@hadoop001 ~]# cd /var/www/html/
[root@hadoop001 html]# ll
total 4
drwxr-xr-x 2 root root 4096 Dec 25 23:33 kafka_parcel

访问http://47.112.39.95/kafka_parcel/
在这里插入图片描述

1.3.Installing or Upgrading Kafka from a Parcel

Minimum Required Role: Cluster Administrator (also provided by Full Administrator)

1.In Cloudera Manager, select Hosts > Parcels.

2.If you do not see Kafka in the list of parcels, you can add the parcel to the list.
a.Find the parcel for the version of Kafka you want to use on CDK Powered By Apache Kafka Versions.
b.Copy the parcel repository link.
(内网IP)
http://hadoop001/kafka_parcel/
c.On the Cloudera Manager Parcels page, click Configuration.
d.In the field Remote Parcel Repository URLs, click + next to an existing parcel URL to add a new field.
e.Paste the parcel repository link.
f.Save your changes.

3.On the Cloudera Manager Parcels page, download the Kafka parcel, distribute the parcel to the hosts in your cluster, and then activate the parcel. See Managing Parcels. After you activate the Kafka parcel, Cloudera Manager prompts you to restart the cluster. You do not need to restart the cluster after installing Kafka. Click Close to ignore this prompt.

4.Add the Kafka service to your cluster. See Adding a Service.
在这里插入图片描述
选择Kafka