背景:
公司MongoDB集群(做了用户登录认证)是有三台机器,做的副本集+分片的集群模式,由于数据量越来越大,导致机器负载不断增大,为了解决机器负载高的问题,需要添加新副本集来解决集群压力。
环境:
主机 | IP地址 | 端口 | 备注 |
MongoDB1 | 10.0.8.74 | 数据端口:27017、27018、27019 config端口:20000 mongos路由端口:30000 | 27017为primary |
MongoDB2 | 10.0.8.75 | 数据端口:27017、27018、27019 config端口:20000 mongos路由端口:30000 | 27019为primary |
MongoDB3 | 10.0.8.76 | 数据端口:27017、27018、27019 config端口:20000 mongos路由端口:30000 | 27018为primary |
MongoDB4 | 10.0.8.55 | 数据端口:27017、27018、27019 |
statestr状态说明/解释:
STARTUP:刚加入到复制集中,配置还未加载
STARTUP2:配置已加载完,初始化状态
RECOVERING:正在恢复,不适用读
ARBITER: 仲裁者
DOWN:节点不可到达
UNKNOWN:未获取其他节点状态而不知是什么状态,一般发生在只有两个成员的架构
REMOVED:移除复制集
ROLLBACK:数据回滚,在回滚结束时,转移到RECOVERING或SECONDARY状态
FATAL:出错。查看日志grep “replSet FATAL”找出错原因,重新做同步
PRIMARY:主节点
SECONDARY:备份节点
说明:
1、在添加副本集的过程中,通过rs.status()查看,新增的副本集stateStr的状态会从 STARTUP--> STARTUP2 --> SECONDARY,STARTUP2状态会维持很久,这是因为在同步主的数据,当状态变成SECONDARY,表示副本集添加成功。
2、新增的节点在安装MongoDB过程中只需要开启认证,不需要新建用户,在添加副本集的过程中,会自动同步账号密码。
操作步骤:
1、在新增的机器(10.0.8.55)上安装mongodb,并且启动三个mongod进程,端口分别为27017、27018、27019(略)
可参考:mongodb集群搭建
2、在MongoDB1上新增10.0.8.55:27017副本集
[ yukw @ MongoDB1 10.0.8.74 ] ~
$ /data/service/mongodbwork/mongodb/bin/mongo -port 27017
MongoDB shell version: 3.0.6
connecting to: 127.0.0.1:27017/test
shard1:PRIMARY> use admin
switched to db admin
shard1:PRIMARY> db.auth("yukw27017","Yukw27017_qwer")
1
shard1:PRIMARY> rs.status()
{
"set" : "shard1",
"date" : ISODate("2021-06-18T02:19:02.462Z"),
"myState" : 1,
"members" : [
{
"_id" : 0,
"name" : "10.0.8.74:27017",
"health" : 1,
"state" : 1,
"stateStr" : "PRIMARY",
"uptime" : 5527840,
"optime" : Timestamp(1623982729, 5),
"optimeDate" : ISODate("2021-06-18T02:18:49Z"),
"electionTime" : Timestamp(1618454907, 1),
"electionDate" : ISODate("2021-04-15T02:48:27Z"),
"configVersion" : 11,
"self" : true
},
{
"_id" : 1,
"name" : "10.0.8.75:27017",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527492,
"optime" : Timestamp(1623982729, 5),
"optimeDate" : ISODate("2021-06-18T02:18:49Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:19:02.078Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:19:01.257Z"),
"pingMs" : 0,
"syncingTo" : "10.0.8.74:27017",
"configVersion" : 11
},
{
"_id" : 2,
"name" : "10.0.8.76:27017",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527828,
"optime" : Timestamp(1623982729, 5),
"optimeDate" : ISODate("2021-06-18T02:18:49Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:19:02.078Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:19:01.936Z"),
"pingMs" : 0,
"syncingTo" : "10.0.8.74:27017",
"configVersion" : 11
}
],
"ok" : 1,
"$gleStats" : {
"lastOpTime" : Timestamp(0, 0),
"electionId" : ObjectId("6077a97b5cfe481bacbf3233")
}
}
shard1:PRIMARY> rs.add("10.0.8.55:27017")
{
"ok" : 1,
"$gleStats" : {
"lastOpTime" : Timestamp(1623982772, 1),
"electionId" : ObjectId("6077a97b5cfe481bacbf3233")
}
}
shard1:PRIMARY> rs.status()
{
"set" : "shard1",
"date" : ISODate("2021-06-18T02:19:35.278Z"),
"myState" : 1,
"members" : [
{
"_id" : 0,
"name" : "10.0.8.74:27017",
"health" : 1,
"state" : 1,
"stateStr" : "PRIMARY",
"uptime" : 5527873,
"optime" : Timestamp(1623982772, 1),
"optimeDate" : ISODate("2021-06-18T02:19:32Z"),
"electionTime" : Timestamp(1618454907, 1),
"electionDate" : ISODate("2021-04-15T02:48:27Z"),
"configVersion" : 12,
"self" : true
},
{
"_id" : 1,
"name" : "10.0.8.75:27017",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527525,
"optime" : Timestamp(1623982772, 1),
"optimeDate" : ISODate("2021-06-18T02:19:32Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:19:34.606Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:19:33.328Z"),
"pingMs" : 0,
"configVersion" : 12
},
{
"_id" : 2,
"name" : "10.0.8.76:27017",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527861,
"optime" : Timestamp(1623982772, 1),
"optimeDate" : ISODate("2021-06-18T02:19:32Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:19:34.606Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:19:34.001Z"),
"pingMs" : 0,
"configVersion" : 12
},
{
"_id" : 3,
"name" : "10.0.8.55:27017",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY", ### stateStr状态会从 STARTUP --> STARTUP2 --> SECONDARY
"uptime" : 0,
"optime" : Timestamp(1623982716, 1),
"optimeDate" : ISODate("2021-06-18T02:18:36Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:19:34.623Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:19:34.750Z"),
"pingMs" : 0,
"syncingTo" : "10.0.8.74:27017",
"configVersion" : 12
}
],
"ok" : 1,
"$gleStats" : {
"lastOpTime" : Timestamp(1623982772, 1),
"electionId" : ObjectId("6077a97b5cfe481bacbf3233")
}
}
3、在MongoDB2上新增10.0.8.55:27019副本集
[ yukw @ MongoDB2 10.0.8.75 ] ~
$ /data/service/mongodbwork/mongodb/bin/mongo -port 27019
MongoDB shell version: 3.0.6
connecting to: 127.0.0.1:27019/test
shard3:PRIMARY> use admin
switched to db admin
shard3:PRIMARY> db.auth("yukw27019","Yukw27019_qwer")
1
shard3:PRIMARY> rs.status()
{
"set" : "shard3",
"date" : ISODate("2021-06-18T02:24:43.916Z"),
"myState" : 1,
"members" : [
{
"_id" : 0,
"name" : "10.0.8.74:27019",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527828,
"optime" : Timestamp(1623983002, 1),
"optimeDate" : ISODate("2021-06-18T02:23:22Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:24:42.516Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:24:42.705Z"),
"pingMs" : 0,
"lastHeartbeatMessage" : "could not find member to sync from",
"configVersion" : 3
},
{
"_id" : 1,
"name" : "10.0.8.75:27019",
"health" : 1,
"state" : 1,
"stateStr" : "PRIMARY",
"uptime" : 5527830,
"optime" : Timestamp(1623983002, 1),
"optimeDate" : ISODate("2021-06-18T02:23:22Z"),
"electionTime" : Timestamp(1618455259, 1),
"electionDate" : ISODate("2021-04-15T02:54:19Z"),
"configVersion" : 3,
"self" : true
},
{
"_id" : 2,
"name" : "10.0.8.76:27019",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527828,
"optime" : Timestamp(1623983002, 1),
"optimeDate" : ISODate("2021-06-18T02:23:22Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:24:42.536Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:24:42.875Z"),
"pingMs" : 0,
"lastHeartbeatMessage" : "could not find member to sync from",
"configVersion" : 3
}
],
"ok" : 1
}
shard3:PRIMARY> rs.add("10.0.8.55:27019")
{ "ok" : 1 }
shard3:PRIMARY> rs.status()
{
"set" : "shard3",
"date" : ISODate("2021-06-18T02:25:01.372Z"),
"myState" : 1,
"members" : [
{
"_id" : 0,
"name" : "10.0.8.74:27019",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527846,
"optime" : Timestamp(1623983098, 1),
"optimeDate" : ISODate("2021-06-18T02:24:58Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:25:00.214Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:25:00.770Z"),
"pingMs" : 0,
"syncingTo" : "10.0.8.75:27019",
"configVersion" : 4
},
{
"_id" : 1,
"name" : "10.0.8.75:27019",
"health" : 1,
"state" : 1,
"stateStr" : "PRIMARY",
"uptime" : 5527848,
"optime" : Timestamp(1623983098, 1),
"optimeDate" : ISODate("2021-06-18T02:24:58Z"),
"electionTime" : Timestamp(1618455259, 1),
"electionDate" : ISODate("2021-04-15T02:54:19Z"),
"configVersion" : 4,
"self" : true
},
{
"_id" : 2,
"name" : "10.0.8.76:27019",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527846,
"optime" : Timestamp(1623983098, 1),
"optimeDate" : ISODate("2021-06-18T02:24:58Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:25:00.213Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:25:00.935Z"),
"pingMs" : 0,
"syncingTo" : "10.0.8.75:27019",
"configVersion" : 4
},
{
"_id" : 3,
"name" : "10.0.8.55:27019",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY", ### stateStr状态会从 STARTUP --> STARTUP2 --> SECONDARY
"uptime" : 1,
"optime" : Timestamp(1623983098, 1),
"optimeDate" : ISODate("2021-06-18T02:24:58Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:25:00.230Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:25:00.362Z"),
"pingMs" : 0,
"syncingTo" : "10.0.8.75:27019",
"configVersion" : 4
}
],
"ok" : 1
}
4、在MongoDB3上新增10.0.8.55:27018副本集
[ yukw @ MongoDB3 10.0.8.76 ] ~
$ /data/service/mongodbwork/mongodb/bin/mongo -port 27018
MongoDB shell version: 3.0.6
connecting to: 127.0.0.1:27018/test
shard2:PRIMARY> use admin
switched to db admin
shard2:PRIMARY> db.auth("yukw27018","Yukw27018_Nsw0316")
1
shard2:PRIMARY> rs.status()
{
"set" : "shard2",
"date" : ISODate("2021-06-18T02:27:03.762Z"),
"myState" : 1,
"members" : [
{
"_id" : 0,
"name" : "10.0.8.74:27018",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5528293,
"optime" : Timestamp(1623983202, 1),
"optimeDate" : ISODate("2021-06-18T02:26:42Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:27:02.902Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:27:02.946Z"),
"pingMs" : 0,
"lastHeartbeatMessage" : "could not find member to sync from",
"configVersion" : 3
},
{
"_id" : 1,
"name" : "10.0.8.75:27018",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527971,
"optime" : Timestamp(1623983202, 1),
"optimeDate" : ISODate("2021-06-18T02:26:42Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:27:02.902Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:27:03.259Z"),
"pingMs" : 0,
"lastHeartbeatMessage" : "could not find member to sync from",
"configVersion" : 3
},
{
"_id" : 2,
"name" : "10.0.8.76:27018",
"health" : 1,
"state" : 1,
"stateStr" : "PRIMARY",
"uptime" : 5528294,
"optime" : Timestamp(1623983202, 1),
"optimeDate" : ISODate("2021-06-18T02:26:42Z"),
"electionTime" : Timestamp(1618454955, 1),
"electionDate" : ISODate("2021-04-15T02:49:15Z"),
"configVersion" : 3,
"self" : true
}
],
"ok" : 1
}
shard2:PRIMARY> rs.add("10.0.8.55:27018")
{ "ok" : 1 }
shard2:PRIMARY> rs.status()
{
"set" : "shard2",
"date" : ISODate("2021-06-18T02:27:21.282Z"),
"myState" : 1,
"members" : [
{
"_id" : 0,
"name" : "10.0.8.74:27018",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5528310,
"optime" : Timestamp(1623983202, 1),
"optimeDate" : ISODate("2021-06-18T02:26:42Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:27:21.001Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:27:20.998Z"),
"pingMs" : 2,
"configVersion" : 4
},
{
"_id" : 1,
"name" : "10.0.8.75:27018",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY",
"uptime" : 5527988,
"optime" : Timestamp(1623983238, 1),
"optimeDate" : ISODate("2021-06-18T02:27:18Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:27:20.989Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:27:19.323Z"),
"pingMs" : 0,
"syncingTo" : "10.0.8.76:27018",
"configVersion" : 4
},
{
"_id" : 2,
"name" : "10.0.8.76:27018",
"health" : 1,
"state" : 1,
"stateStr" : "PRIMARY",
"uptime" : 5528312,
"optime" : Timestamp(1623983238, 1),
"optimeDate" : ISODate("2021-06-18T02:27:18Z"),
"electionTime" : Timestamp(1618454955, 1),
"electionDate" : ISODate("2021-04-15T02:49:15Z"),
"configVersion" : 4,
"self" : true
},
{
"_id" : 3,
"name" : "10.0.8.55:27018",
"health" : 1,
"state" : 2,
"stateStr" : "SECONDARY", ### stateStr状态会从 STARTUP --> STARTUP2 --> SECONDARY
"uptime" : 0,
"optime" : Timestamp(1623983238, 1),
"optimeDate" : ISODate("2021-06-18T02:27:18Z"),
"lastHeartbeat" : ISODate("2021-06-18T02:27:21.006Z"),
"lastHeartbeatRecv" : ISODate("2021-06-18T02:27:21.123Z"),
"pingMs" : 0,
"syncingTo" : "10.0.8.76:27018",
"configVersion" : 4
}
],
"ok" : 1
}
附加:
删除副本集:
### 在primary机器上删除副本集
shard1:PRIMARY> rs.remove("10.0.8.55:27017")
{ "ok" : 1 }
shard2:PRIMARY> rs.remove("10.0.8.55:27019")
{ "ok" : 1 }
shard3:PRIMARY> rs.remove("10.0.8.55:27018")
{ "ok" : 1 }