mongoDB分片集群搭建演示

最新推荐文章于 2024-06-28 23:46:21 发布
最新推荐文章于 2024-06-28 23:46:21 发布
阅读量1.6k 收藏 5
点赞数 1
文章标签： mongodb分片集群 分片 片健
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/zhiwule1314/article/details/103085386
版权

mongodb复制集群搭建演示可参考上一篇：mongoDB复制集搭建，演示

文章目录

一：mongodb分片的背景简介

  1. 原因简介

    随着数据的增长，单机实例的瓶颈是很明显的。可以通过复制的机制应对压力，但mongodb中单个集群的 节点数量限制到了12个以内，所以需要通过分片进一步横向扩展。此外分片也可节约磁盘的存储。

  2. 分片优势简介

    a、透明化
       MongoDB自带mongos路由进程。通过mongos将客户端发来的请求准确无误的路由到集群中的一个或者一组服务器上，同时会把接收到的响应聚合起来发回到客户端。
    b.高可用
      MongoDB通过将副本集和分片集群结合使用，在确保数据实现分片的同时，也确保了各分片数据都有相应的备份，这样就可以确保当主服务器宕机时，其他的从库可以立即替换，继续工作。
    c.易扩展
      当系统需要更多的空间和资源的时候，MongoDB使我们可以按需方便的扩充系统容量。

    1. 分片集群组件简介
组件说明
Mongos提供对外应用访问，所有操作均通过mongos执行。一般有多个mongos节点。数据迁移和数据自动平衡。
Config Server存储集群所有节点、分片数据路由信息。默认需要配置3个Config Server节点。 路由节点基于元数据信息 决定把请求发给哪个分片。
Mongod存储应用数据记录。一般有多个Mongod节点，达到数据分片目的。实际存储的节点，其每个数据块默认为64M，满了之后就会产生新的数据库。

在这里插入图片描述
实际上，生产使用的所有组件都是复制集群的，实际架构如下：
在这里插入图片描述
（备注：下面为了简化演示，配置节点集群使用2个节点，分片节点集群使用2个，路由节点集群使用1个，27017~57018是相应的端口号，搭建演示的服务器环境是阿里云的centos7上做伪分片集群演示）

二：mongodb分片搭建演示

1、配置节点集群搭建
a、37017节点的conf配置信息：
#数据目录
dbpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/config-37017
#端口
port=37017
#日志
logpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/config-37017/37017.log
#后台启动
fork=true
#复制集名称
replSet=configCluster
#配置节点
configsvr=true

37018节点的conf配置信息：

dbpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/config-37018
port=37018
logpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/config-37018/37018.log
fork=true
replSet=configCluster
configsvr=true
b、启动37017，37018节点：
[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongod -f conf/conf-37017.conf 
about to fork child process, waiting until server is ready for connections.
forked process: 32692
child process started successfully, parent exiting
[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongod -f conf/conf-37018.conf 
about to fork child process, waiting until server is ready for connections.
forked process: 32726
child process started successfully, parent exiting
[root@hugo mongodb-linux-x86_64-4.0.5]# ps -ef|grep mongo
root     32692     1  5 14:46 ?        00:00:00 ./bin/mongod -f conf/conf-37017.conf
root     32726     1  9 14:46 ?        00:00:00 ./bin/mongod -f conf/conf-37018.conf
root     32761 32621  0 14:46 pts/3    00:00:00 grep --color=auto mongo

进入37017节点的客户端配置配置节点集群的集群设置：

[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongo --port 37017
MongoDB shell version v4.0.5
connecting to: mongodb://127.0.0.1:37017/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("434beeea-5179-4a2d-ad8d-01bd094d96a0") }
MongoDB server version: 4.0.5
Server has startup warnings: 
2019-11-15T14:46:04.066+0800 I STORAGE  [initandlisten] 
2019-11-15T14:46:04.066+0800 I STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2019-11-15T14:46:04.066+0800 I STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] 
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] 
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] ** WARNING: This server is bound to localhost.
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] **          Remote systems will be unable to connect to this server. 
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] **          Start the server with --bind_ip <address> to specify which IP 
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] **          addresses it should serve responses from, or with --bind_ip_all to
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] **          bind to all interfaces. If this behavior is desired, start the
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] **          server with --bind_ip 127.0.0.1 to disable this warning.
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] 
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] 
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] 
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] 
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] ** WARNING: soft rlimits too low. rlimits set to 7230 processes, 65535 files. Number of processes should be at least 32767.5 : 0.5 times number of files.
2019-11-15T14:46:04.782+0800 I CONTROL  [initandlisten] 
> rs.status()
{
	"operationTime" : Timestamp(0, 0),
	"ok" : 0,
	"errmsg" : "no replset config has been received",
	"code" : 94,
	"codeName" : "NotYetInitialized",
	"$gleStats" : {
		"lastOpTime" : Timestamp(0, 0),
		"electionId" : ObjectId("000000000000000000000000")
	},
	"lastCommittedOpTime" : Timestamp(0, 0),
	"$clusterTime" : {
		"clusterTime" : Timestamp(0, 0),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
> var cfg = {
... "_id":"configCluster",
... "protocolVersion":1,
... "members":[
... {
... "_id":0,"host":"127.0.0.1:37017"
... },{
... "_id":1,"host":"127.0.0.1:37018"
... }
... ]
... }
> rs.initiate(cfg)
{
	"ok" : 1,
	"operationTime" : Timestamp(1573800528, 1),
	"$gleStats" : {
		"lastOpTime" : Timestamp(1573800528, 1),
		"electionId" : ObjectId("000000000000000000000000")
	},
	"lastCommittedOpTime" : Timestamp(0, 0),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573800528, 1),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
configCluster:SECONDARY> rs.status()
{
	"set" : "configCluster",
	"date" : ISODate("2019-11-15T06:49:09.813Z"),
	"myState" : 1,
	"term" : NumberLong(1),
	"syncingTo" : "",
	"syncSourceHost" : "",
	"syncSourceId" : -1,
	"configsvr" : true,
	"heartbeatIntervalMillis" : NumberLong(2000),
	"optimes" : {
		"lastCommittedOpTime" : {
			"ts" : Timestamp(1573800544, 1),
			"t" : NumberLong(1)
		},
		"readConcernMajorityOpTime" : {
			"ts" : Timestamp(1573800544, 1),
			"t" : NumberLong(1)
		},
		"appliedOpTime" : {
			"ts" : Timestamp(1573800544, 1),
			"t" : NumberLong(1)
		},
		"durableOpTime" : {
			"ts" : Timestamp(1573800544, 1),
			"t" : NumberLong(1)
		}
	},
	"lastStableCheckpointTimestamp" : Timestamp(1573800540, 1),
	"members" : [
		{
			"_id" : 0,
			"name" : "127.0.0.1:37017",
			"health" : 1,
			"state" : 1,
			"stateStr" : "PRIMARY",
			"uptime" : 185,
			"optime" : {
				"ts" : Timestamp(1573800544, 1),
				"t" : NumberLong(1)
			},
			"optimeDate" : ISODate("2019-11-15T06:49:04Z"),
			"syncingTo" : "",
			"syncSourceHost" : "",
			"syncSourceId" : -1,
			"infoMessage" : "could not find member to sync from",
			"electionTime" : Timestamp(1573800539, 1),
			"electionDate" : ISODate("2019-11-15T06:48:59Z"),
			"configVersion" : 1,
			"self" : true,
			"lastHeartbeatMessage" : ""
		},
		{
			"_id" : 1,
			"name" : "127.0.0.1:37018",
			"health" : 1,
			"state" : 2,
			"stateStr" : "SECONDARY",
			"uptime" : 21,
			"optime" : {
				"ts" : Timestamp(1573800544, 1),
				"t" : NumberLong(1)
			},
			"optimeDurable" : {
				"ts" : Timestamp(1573800544, 1),
				"t" : NumberLong(1)
			},
			"optimeDate" : ISODate("2019-11-15T06:49:04Z"),
			"optimeDurableDate" : ISODate("2019-11-15T06:49:04Z"),
			"lastHeartbeat" : ISODate("2019-11-15T06:49:09.586Z"),
			"lastHeartbeatRecv" : ISODate("2019-11-15T06:49:08.074Z"),
			"pingMs" : NumberLong(0),
			"lastHeartbeatMessage" : "",
			"syncingTo" : "127.0.0.1:37017",
			"syncSourceHost" : "127.0.0.1:37017",
			"syncSourceId" : 0,
			"infoMessage" : "",
			"configVersion" : 1
		}
	],
	"ok" : 1,
	"operationTime" : Timestamp(1573800544, 1),
	"$gleStats" : {
		"lastOpTime" : Timestamp(1573800528, 1),
		"electionId" : ObjectId("7fffffff0000000000000001")
	},
	"lastCommittedOpTime" : Timestamp(1573800544, 1),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573800544, 1),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
configCluster:PRIMARY>
2、路由节点集群搭建
a、路由节点27017的配置
#端口号
port=27017
#日志
logpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/mongos-27017/27017.log
#后台启动
fork=true
#configCluster是我们上面配置的配置节点复制集的名称，要对应，不然启动不了
configdb=configCluster/127.0.0.1:37017,127.0.0.1:37018
b、启动27017,即路由节点
[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongos -f conf/mongos-27017.conf 
2019-11-15T15:52:52.052+0800 W SHARDING [main] Running a sharded cluster with fewer than 3 config servers should only be done for testing purposes and is not recommended for production.
about to fork child process, waiting until server is ready for connections.
forked process: 2191
child process started successfully, parent exiting
[root@hugo mongodb-linux-x86_64-4.0.5]# ps -ef|grep mongo
root      2191     1  0 15:52 ?        00:00:00 ./bin/mongos -f conf/mongos-27017.conf
root      2297  1471  0 15:56 pts/4    00:00:00 grep --color=auto mongo
root     32692     1  0 14:46 ?        00:00:18 ./bin/mongod -f conf/conf-37017.conf
root     32726     1  0 14:46 ?        00:00:18 ./bin/mongod -f conf/conf-37018.conf
[root@hugo mongodb-linux-x86_64-4.0.5]#

现在启动的路由节点是还不能正常写入数据的，因为我们的shard（分片）节点集群还没有启动：

[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongo
MongoDB shell version v4.0.5
connecting to: mongodb://127.0.0.1:27017/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("f1734e03-cc66-44a5-b7cb-e880de610002") }
MongoDB server version: 4.0.5
Server has startup warnings: 
2019-11-15T15:52:52.057+0800 I CONTROL  [main] 
2019-11-15T15:52:52.058+0800 I CONTROL  [main] ** WARNING: Access control is not enabled for the database.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          Read and write access to data and configuration is unrestricted.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] ** WARNING: You are running this process as the root user, which is not recommended.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] 
2019-11-15T15:52:52.058+0800 I CONTROL  [main] ** WARNING: This server is bound to localhost.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          Remote systems will be unable to connect to this server. 
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          Start the server with --bind_ip <address> to specify which IP 
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          addresses it should serve responses from, or with --bind_ip_all to
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          bind to all interfaces. If this behavior is desired, start the
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          server with --bind_ip 127.0.0.1 to disable this warning.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] 
mongos> show dbs;
admin   0.000GB
config  0.000GB
mongos> use hugo;
switched to db hugo
mongos> db.emp.insert({"name":"张三"})
WriteCommandError({
	"ok" : 0,
	"errmsg" : "unable to initialize targeter for write op for collection hugo.emp :: caused by :: Database hugo not found :: caused by :: No shards found",
	"code" : 70,
	"codeName" : "ShardNotFound",
	"operationTime" : Timestamp(1573804857, 2),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573804857, 2),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
})
3、分片节点集群搭建
a、47017,47018是我们的一个shard分片集群，现在进行改shard集群的配置**

47017的配置：

#数据目录
dbpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/shard-47017
#端口
port=47017
#日志
logpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/shard-47017/47017.log
#后台启动
fork=true
#复制集名称/副本集名称
replSet=shardCluster
#表明是分片服务
shardsvr=true

47018的配置：

dbpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/shard-47018
port=47018
logpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/shard-47018/47018.log
fork=true
replSet=shardCluster
shardsvr=true
b、启动47017,47018：
[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongod -f conf/shard-47017.conf 
about to fork child process, waiting until server is ready for connections.
forked process: 2827
child process started successfully, parent exiting
[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongod -f conf/shard-47018.conf 
about to fork child process, waiting until server is ready for connections.
forked process: 2909
child process started successfully, parent exiting
[root@hugo mongodb-linux-x86_64-4.0.5]# ps -ef|grep mongo
root      2191     1  0 15:52 ?        00:00:01 ./bin/mongos -f conf/mongos-27017.conf
root      2827     1  0 16:14 ?        00:00:00 ./bin/mongod -f conf/shard-47017.conf
root      2909     1  3 16:15 ?        00:00:00 ./bin/mongod -f conf/shard-47018.conf
root      2952  1471  0 16:16 pts/4    00:00:00 grep --color=auto mongo
root     32692     1  0 14:46 ?        00:00:23 ./bin/mongod -f conf/conf-37017.conf
root     32726     1  0 14:46 ?        00:00:24 ./bin/mongod -f conf/conf-37018.conf
[root@hugo mongodb-linux-x86_64-4.0.5]#
c、配置我们的分片节点集群47017,47018的集群关系配置：
[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongo --port 47017
MongoDB shell version v4.0.5
connecting to: mongodb://127.0.0.1:47017/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("7be3f20d-c3cf-4ee9-bb24-ae9f1695db6c") }
MongoDB server version: 4.0.5
Server has startup warnings: 
2019-11-15T16:14:42.422+0800 I STORAGE  [initandlisten] 
2019-11-15T16:14:42.422+0800 I STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2019-11-15T16:14:42.422+0800 I STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] 
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] 
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] ** WARNING: This server is bound to localhost.
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] **          Remote systems will be unable to connect to this server. 
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] **          Start the server with --bind_ip <address> to specify which IP 
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] **          addresses it should serve responses from, or with --bind_ip_all to
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] **          bind to all interfaces. If this behavior is desired, start the
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] **          server with --bind_ip 127.0.0.1 to disable this warning.
2019-11-15T16:14:43.147+0800 I CONTROL  [initandlisten] 
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] 
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] 
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] 
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] ** WARNING: soft rlimits too low. rlimits set to 7230 processes, 65535 files. Number of processes should be at least 32767.5 : 0.5 times number of files.
2019-11-15T16:14:43.148+0800 I CONTROL  [initandlisten] 
> rs.status()
{
	"operationTime" : Timestamp(0, 0),
	"ok" : 0,
	"errmsg" : "no replset config has been received",
	"code" : 94,
	"codeName" : "NotYetInitialized",
	"$clusterTime" : {
		"clusterTime" : Timestamp(0, 0),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
> var cfg = {
... "_id":"shardCluster",
... "protocolVersion":1,
... "members":[
... {
... "_id":0,"host":"127.0.0.1:47017"
... },{
... "_id":1,"host":"127.0.0.1:47018"
... }
... ]
... }
> rs.initiate(cfg)
{
	"ok" : 1,
	"operationTime" : Timestamp(1573806134, 1),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573806134, 1),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
shardCluster:SECONDARY> rs.status()
{
	"set" : "shardCluster",
	"date" : ISODate("2019-11-15T08:23:17.712Z"),
	"myState" : 1,
	"term" : NumberLong(1),
	"syncingTo" : "",
	"syncSourceHost" : "",
	"syncSourceId" : -1,
	"heartbeatIntervalMillis" : NumberLong(2000),
	"optimes" : {
		"lastCommittedOpTime" : {
			"ts" : Timestamp(1573806188, 1),
			"t" : NumberLong(1)
		},
		"readConcernMajorityOpTime" : {
			"ts" : Timestamp(1573806188, 1),
			"t" : NumberLong(1)
		},
		"appliedOpTime" : {
			"ts" : Timestamp(1573806188, 1),
			"t" : NumberLong(1)
		},
		"durableOpTime" : {
			"ts" : Timestamp(1573806188, 1),
			"t" : NumberLong(1)
		}
	},
	"lastStableCheckpointTimestamp" : Timestamp(1573806148, 1),
	"members" : [
		{
			"_id" : 0,
			"name" : "127.0.0.1:47017",
			"health" : 1,
			"state" : 1,
			"stateStr" : "PRIMARY",
			"uptime" : 515,
			"optime" : {
				"ts" : Timestamp(1573806188, 1),
				"t" : NumberLong(1)
			},
			"optimeDate" : ISODate("2019-11-15T08:23:08Z"),
			"syncingTo" : "",
			"syncSourceHost" : "",
			"syncSourceId" : -1,
			"infoMessage" : "could not find member to sync from",
			"electionTime" : Timestamp(1573806146, 1),
			"electionDate" : ISODate("2019-11-15T08:22:26Z"),
			"configVersion" : 1,
			"self" : true,
			"lastHeartbeatMessage" : ""
		},
		{
			"_id" : 1,
			"name" : "127.0.0.1:47018",
			"health" : 1,
			"state" : 2,
			"stateStr" : "SECONDARY",
			"uptime" : 62,
			"optime" : {
				"ts" : Timestamp(1573806188, 1),
				"t" : NumberLong(1)
			},
			"optimeDurable" : {
				"ts" : Timestamp(1573806188, 1),
				"t" : NumberLong(1)
			},
			"optimeDate" : ISODate("2019-11-15T08:23:08Z"),
			"optimeDurableDate" : ISODate("2019-11-15T08:23:08Z"),
			"lastHeartbeat" : ISODate("2019-11-15T08:23:16.294Z"),
			"lastHeartbeatRecv" : ISODate("2019-11-15T08:23:17.074Z"),
			"pingMs" : NumberLong(0),
			"lastHeartbeatMessage" : "",
			"syncingTo" : "127.0.0.1:47017",
			"syncSourceHost" : "127.0.0.1:47017",
			"syncSourceId" : 0,
			"infoMessage" : "",
			"configVersion" : 1
		}
	],
	"ok" : 1,
	"operationTime" : Timestamp(1573806188, 1),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573806188, 1),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
shardCluster:PRIMARY>

主节点（47017）已经正常启动，现在把从节点（47018）也准备好：

[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongo --port 47018
MongoDB shell version v4.0.5
connecting to: mongodb://127.0.0.1:47018/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("b0c34434-cb24-49df-958b-c1fd3e819900") }
MongoDB server version: 4.0.5
Server has startup warnings: 
2019-11-15T16:15:46.416+0800 I STORAGE  [initandlisten] 
2019-11-15T16:15:46.416+0800 I STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2019-11-15T16:15:46.416+0800 I STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] 
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] 
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] ** WARNING: This server is bound to localhost.
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] **          Remote systems will be unable to connect to this server. 
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] **          Start the server with --bind_ip <address> to specify which IP 
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] **          addresses it should serve responses from, or with --bind_ip_all to
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] **          bind to all interfaces. If this behavior is desired, start the
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] **          server with --bind_ip 127.0.0.1 to disable this warning.
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] 
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] 
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] 
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] 
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] ** WARNING: soft rlimits too low. rlimits set to 7230 processes, 65535 files. Number of processes should be at least 32767.5 : 0.5 times number of files.
2019-11-15T16:15:47.135+0800 I CONTROL  [initandlisten] 
shardCluster:SECONDARY> show dbs;
2019-11-15T16:25:34.407+0800 E QUERY    [js] Error: listDatabases failed:{
	"operationTime" : Timestamp(1573806328, 1),
	"ok" : 0,
	"errmsg" : "not master and slaveOk=false",
	"code" : 13435,
	"codeName" : "NotMasterNoSlaveOk",
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573806328, 1),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
} :
_getErrorWithCode@src/mongo/shell/utils.js:25:13
Mongo.prototype.getDBs@src/mongo/shell/mongo.js:124:1
shellHelper.show@src/mongo/shell/utils.js:876:19
shellHelper@src/mongo/shell/utils.js:766:15
@(shellhelp2):1:1
shardCluster:SECONDARY> rs.slaveOk()
shardCluster:SECONDARY> show dbs;
admin   0.000GB
config  0.000GB
local   0.000GB
shardCluster:SECONDARY>
d、把47017,47018的分片复制集加入到路由节点27017下

现在我们已经成功启动了路由节点，配置节点集群，一个分片节点复制集群
在这里插入图片描述
但是进入路由节点27017中可以看到，当前的shards分片节点还没有加进来：

[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongo
MongoDB shell version v4.0.5
connecting to: mongodb://127.0.0.1:27017/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("4cc305cf-5800-427f-9865-da500d12f281") }
MongoDB server version: 4.0.5
Server has startup warnings: 
2019-11-15T15:52:52.057+0800 I CONTROL  [main] 
2019-11-15T15:52:52.058+0800 I CONTROL  [main] ** WARNING: Access control is not enabled for the database.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          Read and write access to data and configuration is unrestricted.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] ** WARNING: You are running this process as the root user, which is not recommended.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] 
2019-11-15T15:52:52.058+0800 I CONTROL  [main] ** WARNING: This server is bound to localhost.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          Remote systems will be unable to connect to this server. 
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          Start the server with --bind_ip <address> to specify which IP 
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          addresses it should serve responses from, or with --bind_ip_all to
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          bind to all interfaces. If this behavior is desired, start the
2019-11-15T15:52:52.058+0800 I CONTROL  [main] **          server with --bind_ip 127.0.0.1 to disable this warning.
2019-11-15T15:52:52.058+0800 I CONTROL  [main] 
mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
  	"_id" : 1,
  	"minCompatibleVersion" : 5,
  	"currentVersion" : 6,
  	"clusterId" : ObjectId("5dce4a5cfd68eca59be538e4")
  }
  shards:
  active mongoses:
  autosplit:
        Currently enabled: yes
  balancer:
        Currently enabled:  yes
        Currently running:  no
        Failed balancer rounds in last 5 attempts:  0
        Migration Results for the last 24 hours: 
                No recent migrations
  databases:
        {  "_id" : "config",  "primary" : "config",  "partitioned" : true }

mongos>

所以，把47017,47018shard节点加进来（添加分片节点）：
（备注：sh.addShard(“shardCluster/127.0.0.1:47017,127.0.0.1:47018”)中的shardCluster就是我们上面配置47017,47018的分片复制集名称）

mongos> sh.addShard("shardCluster/127.0.0.1:47017,127.0.0.1:47018")
{
	"shardAdded" : "shardCluster",
	"ok" : 1,
	"operationTime" : Timestamp(1573807105, 8),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573807105, 8),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
  	"_id" : 1,
  	"minCompatibleVersion" : 5,
  	"currentVersion" : 6,
  	"clusterId" : ObjectId("5dce4a5cfd68eca59be538e4")
  }
  shards:
        {  "_id" : "shardCluster",  "host" : "shardCluster/127.0.0.1:47017,127.0.0.1:47018",  "state" : 1 }
  active mongoses:
        "4.0.5" : 1
  autosplit:
        Currently enabled: yes
  balancer:
        Currently enabled:  yes
        Currently running:  no
        Failed balancer rounds in last 5 attempts:  0
        Migration Results for the last 24 hours: 
                No recent migrations
  databases:
        {  "_id" : "config",  "primary" : "config",  "partitioned" : true }

mongos>

可以看到，shards的分片节点已经加进来了。

e、往分片集群里再添加一个分片节点

前面的工作，我们已经往整个分片集群里加入了一个分片节点复制集了（47017,47018），现在再添加一个分片节点（57017，这里为了简化演示，就不做复制集了）

57017的conf配置：

dbpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/shard-57017
port=57017
logpath=/root/Hugo/tools/mongodb/mongodb-linux-x86_64-4.0.5/data/shard-57017/57017.log
fork=true
shardsvr=true

启动57017节点：

[root@hugo mongodb-linux-x86_64-4.0.5]# ./bin/mongod -f conf/shard-57017.conf 
about to fork child process, waiting until server is ready for connections.
forked process: 4111
child process started successfully, parent exiting
[root@hugo mongodb-linux-x86_64-4.0.5]# ps -ef|grep mongo
root      2191     1  0 15:52 ?        00:00:03 ./bin/mongos -f conf/mongos-27017.conf
root      2827     1  0 16:14 ?        00:00:08 ./bin/mongod -f conf/shard-47017.conf
root      2909     1  0 16:15 ?        00:00:08 ./bin/mongod -f conf/shard-47018.conf
root      3387  1471  0 16:29 pts/4    00:00:00 ./bin/mongo
root      4111     1  6 16:50 ?        00:00:00 ./bin/mongod -f conf/shard-57017.conf
root      4138 32621  0 16:50 pts/3    00:00:00 grep --color=auto mongo
root     32692     1  0 14:46 ?        00:00:32 ./bin/mongod -f conf/conf-37017.conf
root     32726     1  0 14:46 ?        00:00:32 ./bin/mongod -f conf/conf-37018.conf
[root@hugo mongodb-linux-x86_64-4.0.5]#

把57017加入到分片集群中：

mongos> sh.addShard("127.0.0.1:57017")
{
	"shardAdded" : "shard0001",
	"ok" : 1,
	"operationTime" : Timestamp(1573808031, 2),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573808031, 2),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
  	"_id" : 1,
  	"minCompatibleVersion" : 5,
  	"currentVersion" : 6,
  	"clusterId" : ObjectId("5dce4a5cfd68eca59be538e4")
  }
  shards:
        {  "_id" : "shard0001",  "host" : "127.0.0.1:57017",  "state" : 1 }
        {  "_id" : "shardCluster",  "host" : "shardCluster/127.0.0.1:47017,127.0.0.1:47018",  "state" : 1 }
  active mongoses:
        "4.0.5" : 1
  autosplit:
        Currently enabled: yes
  balancer:
        Currently enabled:  yes
        Currently running:  no
        Failed balancer rounds in last 5 attempts:  0
        Migration Results for the last 24 hours: 
                No recent migrations
  databases:
        {  "_id" : "config",  "primary" : "config",  "partitioned" : true }
                config.system.sessions
                        shard key: { "_id" : 1 }
                        unique: false
                        balancing: true
                        chunks:
                                shardCluster	1
                        { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shardCluster Timestamp(1, 0) 

mongos>

可以看到，我们的分片集群中shards已经有2个片健了，搞定成功。
下面演示数据操作。

4、片健数据操作演示
a、为数据库开启分片功能

这里新建一个叫做hugo的数据库，表名(collection) emp

mongos> sh.enableSharding("hugo")
{
	"ok" : 1,
	"operationTime" : Timestamp(1573808573, 5),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573808573, 5),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
  	"_id" : 1,
  	"minCompatibleVersion" : 5,
  	"currentVersion" : 6,
  	"clusterId" : ObjectId("5dce4a5cfd68eca59be538e4")
  }
  shards:
        {  "_id" : "shard0001",  "host" : "127.0.0.1:57017",  "state" : 1 }
        {  "_id" : "shardCluster",  "host" : "shardCluster/127.0.0.1:47017,127.0.0.1:47018",  "state" : 1 }
  active mongoses:
        "4.0.5" : 1
  autosplit:
        Currently enabled: yes
  balancer:
        Currently enabled:  yes
        Currently running:  no
        Failed balancer rounds in last 5 attempts:  0
        Migration Results for the last 24 hours: 
                No recent migrations
  databases:
        {  "_id" : "config",  "primary" : "config",  "partitioned" : true }
                config.system.sessions
                        shard key: { "_id" : 1 }
                        unique: false
                        balancing: true
                        chunks:
                                shardCluster	1
                        { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shardCluster Timestamp(1, 0) 
        {  "_id" : "hugo",  "primary" : "shard0001",  "partitioned" : true,  "version" : {  "uuid" : UUID("8175e28f-8335-4d35-bcf9-c40a937dc344"),  "lastMod" : 1 } }

mongos>

在databases中可以看到，hugo的数据库已经加进来了。

b、为指定集合开启分片功能

这里为集合‘emp’开启分片功能，并且指定‘_id’做为片健

mongos> sh.shardCollection("hugo.emp",{"_id":1})
{
	"collectionsharded" : "hugo.emp",
	"collectionUUID" : UUID("6027c2a3-e8d1-49c4-bbe9-b57eacaf3201"),
	"ok" : 1,
	"operationTime" : Timestamp(1573808814, 1),
	"$clusterTime" : {
		"clusterTime" : Timestamp(1573808814, 1),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	}
}
mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
  	"_id" : 1,
  	"minCompatibleVersion" : 5,
  	"currentVersion" : 6,
  	"clusterId" : ObjectId("5dce4a5cfd68eca59be538e4")
  }
  shards:
        {  "_id" : "shard0001",  "host" : "127.0.0.1:57017",  "state" : 1 }
        {  "_id" : "shardCluster",  "host" : "shardCluster/127.0.0.1:47017,127.0.0.1:47018",  "state" : 1 }
  active mongoses:
        "4.0.5" : 1
  autosplit:
        Currently enabled: yes
  balancer:
        Currently enabled:  yes
        Currently running:  no
        Failed balancer rounds in last 5 attempts:  0
        Migration Results for the last 24 hours: 
                No recent migrations
  databases:
        {  "_id" : "config",  "primary" : "config",  "partitioned" : true }
                config.system.sessions
                        shard key: { "_id" : 1 }
                        unique: false
                        balancing: true
                        chunks:
                                shardCluster	1
                        { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shardCluster Timestamp(1, 0) 
        {  "_id" : "hugo",  "primary" : "shard0001",  "partitioned" : true,  "version" : {  "uuid" : UUID("8175e28f-8335-4d35-bcf9-c40a937dc344"),  "lastMod" : 1 } }
                hugo.emp
                        shard key: { "_id" : 1 }
                        unique: false
                        balancing: true
                        chunks:
                                shard0001	1
                        { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shard0001 Timestamp(1, 0) 
mongos> show dbs;
admin   0.000GB
config  0.001GB
hugo    0.000GB
c、往分片集群中写数据,观察分片效果

因为分片集群中默认的chunk块大小是64M，这里为了演示效果，把chunk块大小修改为1m

mongos> use config;
switched to db config
mongos> db.settings.find()
mongos> db.settings.save({_id:"chunksize",value:1})
WriteResult({ "nMatched" : 0, "nUpserted" : 1, "nModified" : 0, "_id" : "chunksize" })
mongos> use config;
switched to db config
mongos> show tables;
changelog
chunks
collections
databases
lockpings
locks
migrations
mongos
settings
shards
tags
transactions
version
mongos> db.settings.find()
{ "_id" : "chunksize", "value" : 1 }
mongos>

可以看到，当前emp表的数据为0：

mongos> use hugo;
switched to db hugo
mongos> db.emp.count()
0

为了演示分片效果，我们往集合emp中写入10000条数据：

mongos> use hugo;
switched to db hugo
mongos>  for(var i=1;i<=100000;i++){
...      db.emp.insert({"_id":i,"name":"copy"+i});
... }

查看一下当前分片集群中的分片效果：

mongos> db.emp.count()
0
mongos> db.emp.count()
4453
mongos> db.emp.count()
6693
mongos> db.emp.count()
8587
mongos> db.emp.count()
10460
mongos> db.emp.count()
22249
mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
  	"_id" : 1,
  	"minCompatibleVersion" : 5,
  	"currentVersion" : 6,
  	"clusterId" : ObjectId("5dce4a5cfd68eca59be538e4")
  }
  shards:
        {  "_id" : "shard0001",  "host" : "127.0.0.1:57017",  "state" : 1 }
        {  "_id" : "shardCluster",  "host" : "shardCluster/127.0.0.1:47017,127.0.0.1:47018",  "state" : 1 }
  active mongoses:
        "4.0.5" : 1
  autosplit:
        Currently enabled: yes
  balancer:
        Currently enabled:  yes
        Currently running:  no
        Failed balancer rounds in last 5 attempts:  0
        Migration Results for the last 24 hours: 
                1 : Success
  databases:
        {  "_id" : "config",  "primary" : "config",  "partitioned" : true }
                config.system.sessions
                        shard key: { "_id" : 1 }
                        unique: false
                        balancing: true
                        chunks:
                                shardCluster	1
                        { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shardCluster Timestamp(1, 0) 
        {  "_id" : "hugo",  "primary" : "shard0001",  "partitioned" : true,  "version" : {  "uuid" : UUID("8175e28f-8335-4d35-bcf9-c40a937dc344"),  "lastMod" : 1 } }
                hugo.emp
                        shard key: { "_id" : 1 }
                        unique: false
                        balancing: true
                        chunks:
                                shard0001	2
                                shardCluster	1
                        { "_id" : { "$minKey" : 1 } } -->> { "_id" : 2 } on : shardCluster Timestamp(2, 0) 
                        { "_id" : 2 } -->> { "_id" : 28340 } on : shard0001 Timestamp(2, 1) 
                        { "_id" : 28340 } -->> { "_id" : { "$maxKey" : 1 } } on : shard0001 Timestamp(1, 3) 

mongos>

可以看到，已经有2个块了
在这里插入图片描述
当前数据还在写，10000条还没写完，等一下，看最终的效果：

mongos> db.emp.count()
89701
mongos> db.emp.count()
89701
mongos> db.emp.count()
89701
mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
  	"_id" : 1,
  	"minCompatibleVersion" : 5,
  	"currentVersion" : 6,
  	"clusterId" : ObjectId("5dce4a5cfd68eca59be538e4")
  }
  shards:
        {  "_id" : "shard0001",  "host" : "127.0.0.1:57017",  "state" : 1 }
        {  "_id" : "shardCluster",  "host" : "shardCluster/127.0.0.1:47017,127.0.0.1:47018",  "state" : 1 }
  active mongoses:
        "4.0.5" : 1
  autosplit:
        Currently enabled: yes
  balancer:
        Currently enabled:  yes
        Currently running:  no
        Collections with active migrations: 
                hugo.emp started at Fri Nov 15 2019 17:28:21 GMT+0800 (CST)
        Failed balancer rounds in last 5 attempts:  0
        Migration Results for the last 24 hours: 
                2 : Success
  databases:
        {  "_id" : "config",  "primary" : "config",  "partitioned" : true }
                config.system.sessions
                        shard key: { "_id" : 1 }
                        unique: false
                        balancing: true
                        chunks:
                                shardCluster	1
                        { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shardCluster Timestamp(1, 0) 
        {  "_id" : "hugo",  "primary" : "shard0001",  "partitioned" : true,  "version" : {  "uuid" : UUID("8175e28f-8335-4d35-bcf9-c40a937dc344"),  "lastMod" : 1 } }
                hugo.emp
                        shard key: { "_id" : 1 }
                        unique: false
                        balancing: true
                        chunks:
                                shard0001	3
                                shardCluster	4
                        { "_id" : { "$minKey" : 1 } } -->> { "_id" : 2 } on : shardCluster Timestamp(2, 0) 
                        { "_id" : 2 } -->> { "_id" : 28340 } on : shard0001 Timestamp(3, 1) 
                        { "_id" : 28340 } -->> { "_id" : 42509 } on : shard0001 Timestamp(2, 2) 
                        { "_id" : 42509 } -->> { "_id" : 59897 } on : shard0001 Timestamp(2, 3) 
                        { "_id" : 59897 } -->> { "_id" : 74066 } on : shardCluster Timestamp(3, 2) 
                        { "_id" : 74066 } -->> { "_id" : 89699 } on : shardCluster Timestamp(3, 3) 
                        { "_id" : 89699 } -->> { "_id" : { "$maxKey" : 1 } } on : shardCluster Timestamp(3, 4) 

mongos>

可以看到：数据比较均匀的分布在2个块
在这里插入图片描述
未完，待续，吃饭去。。。。。。

zhiwule1314
关注
  • 1
    点赞
  • 踩
  • 5
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
MongoDB分片集群(sharded cluster)搭建过程
duanbeibei的专栏
04-16 1万+
1.分片集群概述 MongoDB分片集群，英文名称为： Sharded Cluster 旨在通过横向扩展，来提高数据吞吐性能、增大数据存储量。 分片集群由三个组件：“mongos”, “config server”, “shard” 组成。 框架如下（图片来自mongodb官网说明）： mongos:数据库请求路由。负责接收所有客户端应用程序的连接查询请求，并将请求路由到集群内部对应的分片上。...
mongoDB 分片集群搭建
xiaoenxiaoen的专栏
06-24 199
1.搭建环境 OS：centos7 mem：8G 2.软件版本 mongodb-linux-x86_64-3.2.22 端口规划 ip port mongos 127.0.0.1 28017 config 镜像 127.0.0.1 28018 镜像 127.0.0.1 28019 镜像 127.0.0.1 28020 shard1 p 127.0.0.1 28021 ...
Mongodb集群搭建
失之东隅的博客
02-10 4320
mongodb集群搭建...
【超详细】手把手教你搭建MongoDB集群搭建
热门推荐
博学谷狂野架构师的博客
07-14 1万+
​ 为解决mongodb在replica set每个从节点上面的数据库均是对数据库的全量拷贝，从节点压力在高并发大数据量的场景下存在很大挑战，同时考虑到后期mongodb集群的在数据压力巨大时的扩展性，应对海量数据引出了分片机制。​ 分片是将数据库进行拆分，将其分散在不同的机器上的过程，无需功能强大的服务器就可以存储更多的数据，处理更大的负载，在总数据中，将集合切成小块，将这些块分散到若干片中，每个片只负载总数据的一部分，通过一个知道数据与分片对应关系的组件mongos的路由进程进行操作。​ 数据库集
MongoDB分片集群：构建高性能、可扩展的数据架构
最新发布
lcy159357LCY的博客
06-28 925
分片集群通过路由服务器（Mongos）来接收客户端的请求，并根据分片键（Sharding Key）将数据路由到相应的Shard上进行处理。MongoDB，作为一款领先的NoSQL数据库，以其灵活的文档模型、强大的查询能力和水平扩展能力，赢得了众多企业的青睐。本文将详细介绍如何部署MongoDB分片集群，以构建高性能、可扩展的数据架构，并通过图文并茂的方式展示部署过程，带来新颖的题材体验。Mongos将作为客户端的接入点，负责接收请求并路由到相应的Shard上。三、分片集群的部署步骤。
MongoDB 简单集群搭建
Orange_air的博客
10-18 1827
mongoDB简单分片集群搭建整理
手把手教你搭建MongoDB分片式部署集群+实战
Executing_的博客
11-17 4969
MongoDB分片式集群部署实战，构建一个MongoDB的分片集群，需要三个重要组件，分别是分片服务器（Shard Server）、配置服务器（Config Server）、路由服务器（Router Server）。
mongoDB分片集群部署
weixin_39934651的博客
02-22 1732
一、MongoDB 背景 MongoDB 是一款功能完善的分布式文档数据库，是一款非常出名的 NoSQL 数据库。当前国内使用 Mongodb 的大型实践越来越多，MongoDB 为我司提供了重要的数据库存储服务，支撑着每天近千万级 QPS 峰值读写，数万亿级数据量存储服务。 MongoDB 在高性能、动态扩缩容、高可用、易部署、易使用、海量数据存储等方面拥有很大优势。近些年，MongoDB 在 DB-Engines 流行度排行榜稳居榜单 Top5 ，且历年得分是持续增长的，具体如下图所示： DB-En
MongoDB4.2分片及副本集群搭建
04-21
MongoDB4.2分片及副本集群搭建 MongoDB集群 MongoDB分片 MongoDB副本 MongoDB副本集群
mongodb 分片集群搭建过程（无副本）
04-18
mongodb 分片集群搭建过程（无副本），详细操作步骤，linux命令
MongoDB分片集群部署详解
09-09
本篇文章将详细阐述MongoDB分片集群的部署过程和相关概念。 首先，理解分片集群的基本构成。MongoDB的分片集群由三个主要部分组成：mongos路由服务器、config servers配置服务器以及shards存储节点。mongos负责...
MongoDB的分片集群基本配置教程
09-10
本教程将详细讲解MongoDB分片集群的基本配置步骤。 首先，了解为何需要进行数据分片。分片的主要目标是解决单个服务器的性能瓶颈，包括处理能力（请求量）和存储空间。通过分片，可以减少单台服务器的负载，提高...
Mongodb分片副本集集群搭建
04-04
搭建Mongodb分片集群的步骤文档，度娘上很多坑，被坑的可以看看，本文档专门埋坑。
mongodb分片集群搭建
ApexPredator的博客
05-06 1124
mongodb分片集群搭建
搭建MongoDB分片集群
misakivv的博客
05-03 1694
分片（sharding）是一种跨多台机器分布数据的方法，MongoDB使用分片来支持具有非常大的数据集和高吞吐量操作的部署。 分片是将数据拆分，散到不同的机器上，不需要功能强大的大型计算机就可以储存更多的数据，处理更多的负载。有时也叫分区 (partitioning)。
mongodb-6 安装及异常解决方法
pang_2899的博客
01-31 1416
mongodb 安装及 故障排查
Mongodb实验二——分片集群搭建
qq_55977554的博客
11-25 1万+
mongodb分片式集群搭建 本实验在一台电脑上完成，本人自己方法与标准方法略有差异，大家仁者见仁，同时可能你按照一样的步骤下来，会出现各种各样的错误，但希望大家懂得学会去查看日志，查看代码，懂得如何解决问题，这是一个有趣的过程，共勉。
MongoDB集群搭建
dopa66666的博客
02-26 1555
分片（sharding）是MongoDB用来将大型集合分割到不同服务器（或者说一个集群）上所采用的方法。例如，如果数据库1tb的数据集，并有4个分片，然后每个分片可能仅持有256 GB的数据。如果有40个分片，那么每个切分可能只有25GB的数据。MongoDB中数据的分片是以集合为基本单位的，集合中的数据通过片键（Shard key）被分成多部分。其实片键就是在集合中选一个键，用该键的值作为数据拆分的依据。一般片键采用范围或哈希的方式进行分片。
MongoDB集群搭建（四）
沉浸式Study
06-26 1089
因为由多个容器，配置文件是一样的，只需要创建一个配置文件，其他的容器统一读取该配置文件即可,因为Mongos只负责路由，就不需要数据文件了，并且mongos服务是不负责认证的，需要将。因为有多个容器，配置文件是一样的，只需要创建一个配置文件，其他的容器统一读取该配置文件即可。因为有多个容器，配置文件是一样的，只需要创建一个配置文件，其他的容器统一读取该配置文件即可。因为由多个容器，配置文件是一样的，只需要创建一个配置文件，其他的容器统一读取该配置文件即可。是无中心的配置，所有需要每一台都需要进行分片配置。
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值