1. 在原有的CDH基础上添加KAFKA服务。系统环境:
centos 7
jdk 1.8.0_101
python 2.7.5
CDH 5.12.2
kerberos 1.15.1-19.el7
2. kafka parcel包下载,分配和激活
地址:http://archive.cloudera.com/kafka/parcels/2.0.2/
3.添加kafka服务
按照安装导向安装即可
另
firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="x.x.x.x" port protocol="tcp" port="9092" accept"
firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="x.x.x.x" port protocol="tcp" port="9393" accept"
firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="x.x.x.x" port protocol="tcp" port="9394" accept"
firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="x.x.x.x" port protocol="tcp" port="24042" accept"
export KAFKA_HEAP_OPTS="-Xmx500m -Xms500m"
不知道为什么CDH版大数据平台,直接修改文件不起作用,需要在页面上修改参数Java Heap Size of Broker为1G。