MySQL NDB Cluster 分布式架构搭建自定义启动、重启和关闭集群Shell脚本_mysql cluster启动(1)

m0_74932057

于 2024-04-13 12:14:45 发布

阅读量472

点赞数 13

分类专栏：程序员文章标签： mysql 分布式架构

本文链接：https://blog.csdn.net/m0_74932057/article/details/137712309

版权

程序员专栏收录该内容

185 篇文章 0 订阅

订阅专栏

NoOfReplicas =2
DataMemory = 512M
MaxNoOfExecutionThreads = 4
[NDB_MGMD]
NodeId=1
hostname =192.168.182.102
datadir =/var/lib/mysql-cluster
[NDBD]
NodeId =2
hostname =192.168.182.103
datadir =/usr/local/mysql-cluster/data
[NDBD]
NodeId =3
hostname =192.168.182.104
datadir =/usr/local/mysql-cluster/data
[mysqld]
NodeId =4
hostname =192.168.182.103
[mysqld]
NodeId =5
hostname =192.168.182.104


在管理节点中执行以下命令，初始化管理节点（注意mysql cluster路径是固定的，否则会报错）

/usr/local/mysql/mysql-cluster/bin/ndb_mgmd -f /var/lib/mysql-cluster/config.ini --initial --ndb-nodeid=1


创建 **/etc/my.cnf** mysql配置文件

[mysqld]
basedir=/usr/local/mysql-cluster
datadir=/usr/local/mysql-cluster/data
socket=/usr/local/mysql-cluster/sock/mysql.sock
user=hadoop
symbolic-links=0
ndbcluster
ndb-connectstring=192.168.182.102
port=3306

[mysql_cluster]
ndb-connectstring=192.168.182.102

[ndbd]
ndb-connectstring=192.168.182.102

[mysqld_safe]
log-error=/usr/local/mysql-cluster/logs/mysql.pid
pid-file=/usr/local/mysql-cluster/logs/error.log

[mysql]
socket=/usr/local/mysql-cluster/sock/mysql.sock

include all files from the config directory

#!includedir /etc/my.cnf.d


 在初始化mysqld之前，需要将**data、logs、sock**文件夹创建完毕，否则无法初始化

[hadoop@hadoop103 mysql-cluster]$ pwd
/usr/local/mysql-cluster
[hadoop@hadoop103 mysql-cluster]$ ls
bin docs include lib LICENSE man README share support-files
[hadoop@hadoop103 mysql-cluster]$ mkdir data
[hadoop@hadoop103 mysql-cluster]$ mkdir sock
[hadoop@hadoop103 mysql-cluster]$ mkdir logs


 初始化mysqld，同时没有对root账号设置密码

[hadoop@hadoop103 mysql-cluster]$ bin/mysqld --initialize-insecure --user=hadoop
2024-03-01T22:50:53.201408Z 0 [Warning] [MY-010139] [Server] Changed limits: max_open_files: 1024 (requested 8161)
2024-03-01T22:50:53.201412Z 0 [Warning] [MY-010142] [Server] Changed limits: table_open_cache: 431 (requested 4000)
2024-03-01T22:50:53.202613Z 0 [Warning] [MY-011070] [Server] ‘Disabling symbolic links using --skip-symbolic-links (or equivalent) is the default. Consider not using this option as it’ is deprecated and will be removed in a future release.
2024-03-01T22:50:53.202952Z 0 [System] [MY-013169] [Server] /usr/local/mysql-cluster/bin/mysqld (mysqld 8.0.36-cluster) initializing of server in progress as process 2947
2024-03-01T22:50:53.211541Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-01T22:50:53.873353Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-01T22:50:54.189948Z 0 [System] [MY-010865] [NDB] ‘–initialize’ -> ndbcluster plugin disabled
2024-03-01T22:50:55.344321Z 6 [Warning] [MY-010453] [Server] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option.
[hadoop@hadoop103 mysql-cluster]$ sudo cp support-files/mysql.server /etc/init.d/mysqld
[hadoop@hadoop103 mysql-cluster]$ sudo chmod +x /etc/init.d/mysqld


再初始化初始化数据节点，注意此时初始化完毕会自动连接到管理节点

[hadoop@hadoop103 mysql-cluster]$ bin/ndbd --initial
2024-03-02 06:51:57 [ndbd] INFO – Angel connected to ‘192.168.182.102:1186’
2024-03-02 06:51:57 [ndbd] INFO – Angel allocated nodeid: 2


 集群目前连接情况

[hadoop@hadoop102 mysql-cluster]$ bin/ndb_mgm -e show
Connected to Management Server at: localhost:1186
Cluster Configuration

[ndbd(NDB)] 2 node(s)
id=2 @192.168.182.103 (mysql-8.0.36 ndb-8.0.36, starting, Nodegroup: 0)
id=3 (not connected, accepting connect from 192.168.182.104)

[ndb_mgmd(MGM)] 1 node(s)
id=1 @192.168.182.102 (mysql-8.0.36 ndb-8.0.36)

[mysqld(API)] 2 node(s)
id=4 (not connected, accepting connect from 192.168.182.103)
id=5 (not connected, accepting connect from 192.168.182.104)


注意SQL节点需要在数据节点全部启动后，才能开始启动，所以别着急启动mysqld


同时为了防止在之后停止mysqld的时候，出现**rm: cannot remove '/var/lock/subsys/mysql': Permission denied**报错，导致后续无法启动mysqld，需要修改该文件夹的权限

sudo chown -R hadoop:hadoop /var/lock/subsys


第三台服务器操作同第二台操作一致。在第三台服务器完成数据节点初始化之后，便可以启动两个SQL节点。整个集群启动成功后的连接情况如下

[hadoop@hadoop102 mysql-cluster]$ bin/ndb_mgm -e show
Connected to Management Server at: localhost:1186
Cluster Configuration

[ndbd(NDB)] 2 node(s)
id=2 @192.168.182.103 (mysql-8.0.36 ndb-8.0.36, Nodegroup: 0, *)
id=3 @192.168.182.104 (mysql-8.0.36 ndb-8.0.36, Nodegroup: 0)

[ndb_mgmd(MGM)] 1 node(s)
id=1 @192.168.182.102 (mysql-8.0.36 ndb-8.0.36)

[mysqld(API)] 2 node(s)
id=4 @192.168.182.103 (mysql-8.0.36 ndb-8.0.36)
id=5 @192.168.182.104 (mysql-8.0.36 ndb-8.0.36)


为了测试集群是否能够正常存储数据，需要在SQL节点中设置MySQL远程连接配置。在这里我创建了一个名为hadoop的用户，并赋予全部操作权限

[hadoop@hadoop103 mysql-cluster]$ bin/mysql -uroot

mysql> CREATE USER ‘hadoop’@‘%’ IDENTIFIED BY ‘123456’;
Query OK, 0 rows affected (0.03 sec)

mysql> GRANT ALL PRIVILEGES ON . TO ‘hadoop’@‘%’ WITH GRANT OPTION;
Query OK, 0 rows affected (0.11 sec)

mysql> FLUSH PRIVILEGES;
Query OK, 0 rows affected (0.00 sec)


 在Navicat中测试连接情况


![](https://img-blog.csdnimg.cn/direct/b644214d72744eddb0cccebc92d86706.png)


以下是自定义的集群启动Shell脚本

#!/bin/bash

/usr/local/mysql/mysql-cluster/bin/ndb_mgmd -f /var/lib/mysql-cluster/config.ini --config-cache=FALSE --ndb-nodeid=1

ssh hadoop103 /usr/local/mysql-cluster/bin/ndbd
ssh hadoop104 /usr/local/mysql-cluster/bin/ndbd

PASSWORD=123456
echo $PASSWORD | sudo -S ssh -t root@hadoop103 ‘service mysqld start’
echo $PASSWORD | sudo -S ssh -t root@hadoop104 ‘service mysqld start’



**自我介绍一下，小编13年上海交大毕业，曾经在小公司待过，也去过华为、OPPO等大厂，18年进入阿里一直到现在。**

**深知大多数大数据工程师，想要提升技能，往往是自己摸索成长或者是报班学习，但对于培训机构动则几千的学费，着实压力不小。自己不成体系的自学效果低效又漫长，而且极易碰到天花板技术停滞不前！**

**因此收集整理了一份《2024年大数据全套学习资料》，初衷也很简单，就是希望能够帮助到想自学提升又不知道该从何学起的朋友。**
![img](https://img-blog.csdnimg.cn/img_convert/0c7d9e1ca0b853607a8788536a922357.png)
![img](https://img-blog.csdnimg.cn/img_convert/a3c44bb7f297ec23c71e616d7b718801.png)
![img](https://img-blog.csdnimg.cn/img_convert/3da566131f22eb3433da9a5cb772a255.png)
![img](https://img-blog.csdnimg.cn/img_convert/01927c908710c3975a43d5810dd5045f.png)
![img](https://img-blog.csdnimg.cn/img_convert/290248673bd59c25ac5a2c684cf46210.png)

**既有适合小白学习的零基础资料，也有适合3年以上经验的小伙伴深入学习提升的进阶课程，基本涵盖了95%以上大数据开发知识点，真正体系化！**

**由于文件比较大，这里只是将部分目录大纲截图出来，每个节点里面都包含大厂面经、学习笔记、源码讲义、实战项目、讲解视频，并且后续会持续更新**

**如果你觉得这些内容对你有帮助，可以添加VX：vip204888 （备注大数据获取）**
![img](https://img-blog.csdnimg.cn/img_convert/b0fc32999b6f378b4eb762e0c3539814.png)

**一个人可以走的很快，但一群人才能走的更远。不论你是正从事IT行业的老鸟或是对IT行业感兴趣的新人，都欢迎扫码加入我们的的圈子（技术交流、学习资源、职场吐槽、大厂内推、面试辅导），让我们一起学习成长！**

讲义、实战项目、讲解视频，并且后续会持续更新**

**如果你觉得这些内容对你有帮助，可以添加VX：vip204888 （备注大数据获取）**
[外链图片转存中...(img-padPrycf-1712981609400)]

**一个人可以走的很快，但一群人才能走的更远。不论你是正从事IT行业的老鸟或是对IT行业感兴趣的新人，都欢迎扫码加入我们的的圈子（技术交流、学习资源、职场吐槽、大厂内推、面试辅导），让我们一起学习成长！**

m0_74932057

关注

13
点赞
踩
20

收藏

觉得还不错? 一键收藏
0
评论
MySQL NDB Cluster 分布式架构搭建自定义启动、重启和关闭集群Shell脚本_mysql cluster启动(1)

NoOfReplicas =2DataMemory = 512MMaxNoOfExecutionThreads = 4[NDB_MGMD]NodeId=1hostname =192.168.182.102datadir =/var/lib/mysql-cluster[NDBD]NodeId =2hostname =192.168.182.103datadir =/usr/local/mysql-cluster/data[NDBD]NodeId =3hostname =192.168
复制链接

扫一扫