大数据应用之 --- clickhouse安装部署

clickhouse

部署机器：lsyk01、lsyk02、lsyk03

依次安装：

​ clickhouse-common-static-22.4.5.9.x86_64.rpm
​ clickhouse-common-static-dbg-22.4.5.9.x86_64.rpm
​ clickhouse-server-22.4.5.9.noarch.rpm
​ clickhouse-client-22.4.5.9.noarch.rpm

安装

​ 3台机器都要安装

  cd /softw/clickhouse
  yum install -y clickhouse-common-static-22.4.5.9.x86_64.rpm
  yum install -y clickhouse-common-static-dbg-22.4.5.9.x86_64.rpm
  yum install -y clickhouse-server-22.4.5.9.noarch.rpm
  yum install -y clickhouse-client-22.4.5.9.noarch.rpm

​ 目录结构

​ 配置文件：/etc/clickhouse*

​ 可执行文件：/usr/bin/clickhouse*

​ 数据文件：/var/lib/clickhouse/

关闭自启动

​ 每台都执行：

​ systemctl disable clickhouse-server

集群部署

1. 在 /etc/clickhouse-server/config.d 目录下创建一个名为 metrika.xml的配置文件

   <?xml version="1.0"?>
   <clickhouse>
   	<zookeeper-servers>
   		<node index="1">
   			<host>lsyk01</host>
   			<port>2181</port>
   		</node>
   		<node index="2">
   			<host>lsyk02</host>
   			<port>2181</port>
   		</node>
   		<node index="3">
   			<host>lsyk03</host>
   			<port>2181</port>
   		</node>
   	</zookeeper-servers>
   	<remote_servers>
   		<cluster_lsyk> <!-- 集群名称--> 
   			<shard> <!--集群的第1个分片-->
   				<internal_replication>true</internal_replication>
   				<!--该分片的第1个副本-->
   				<replica> 
   					<host>lsyk01</host>
   					<port>9000</port>
   				</replica>
   				<!--该分片的第2个副本-->
   				<replica> 
   					<host>lsyk02</host>
   					<port>9000</port>
   				</replica>
   			</shard>
   			<shard> <!--集群的第2个分片-->
   				<internal_replication>true</internal_replication>
   				<!--该分片的第1个副本-->
   				<replica> 
   					<host>lsyk03</host>
   					<port>9000</port>
   				</replica>				
   			</shard>				
   		</cluster_lsyk>
   	</remote_servers>
   	<macros>
   		<shard>01</shard> <!--不同机器放的分片数不一样-->
   		<replica>rep_01_01</replica> <!--不同机器放的副本数不一样-->
   	</macros>
   </clickhouse>
   
   

2. 同步到其他机器

   scp metrika.xml lsyk02:/etc/clickhouse-server/config.d
   #修改macros标签
   	<macros>
   		<shard>01</shard> <!--不同机器放的分片数不一样-->
   		<replica>rep_01_02</replica> <!--不同机器放的副本数不一样-->
   	</macros>
   	
   scp metrika.xml lsyk03:/etc/clickhouse-server/config.d
   #修改macros标签
   	<macros>
   		<shard>02</shard> <!--不同机器放的分片数不一样-->
   		<replica>rep_02_01</replica> <!--不同机器放的副本数不一样-->
   	</macros>
   
   

3. /etc/clickhouse-server/config.xml 最后增加

   <zookeeper incl="zookeeper-servers" optional="true" />
   <remote_servers incl="remote_servers" optional="true" />
   <include_from>/etc/clickhouse-server/config.d/metrika.xml</include_from>
   
   打开注释：
   把 <listen_host>::</listen_host> 的注释打开
   

4. 同步到其他机器

   scp config.xml lsyk02:/etc/clickhouse-server/
   scp config.xml lsyk03:/etc/clickhouse-server/
   

启停集群

先确保zk集群已经启动：jps

如果没有，则

zkServer.sh start

每台都重启：

clickhouse restart
#或者
systemctl start clickhouse-server

​ 关闭集群

	clickhouse stop

问题

​ 启动报错：vim /var/log/clickhouse-server/clickhouse-server.err.log

CertificateReloader: Cannot obtain modification time for certificate file /etc/clickhouse-server/server.crt, skipping update. errno: 2, strerror: No such file or directory

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-QWt8fqCS-1657420821805)(C:\Users\yuanf\AppData\Roaming\Typora\typora-user-images\image-20220604003917816.png)]

解决：server.crt server.key是需要自己手动生成的

vim /etc/clickhouse-server/config.xml

打开config.xml你能找到下面这行

openssl req -subj "/CN=localhost" -new -newkey rsa:2048 -days 365 -nodes -x509 -keyout /etc/clickhouse-server/server.key -out /etc/clickhouse-server/server.crt

 chown clickhouse:clickhouse server.crt server.key

每台都执行他就能生成你想要的文件了，

更改属主，重启clickhouse即可。

client连接测试

​ clickhouse-client -m