mysql cluster 并发_MySQL Cluster 4个数据节点压力测试--mysqlslap工具压400W写

最新推荐文章于 2024-05-24 16:09:10 发布
最新推荐文章于 2024-05-24 16:09:10 发布
阅读量1k 收藏
点赞数
文章标签： mysql cluster 并发
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_42402228/article/details/113264654
版权

锅巴哥的个人建议：cluster叫电信运营商版本，所以基本上在很大的用户并发量的情况下才会用到，对连接数的线性增长要求高的场景，千兆就不用想了， 没万兆就不用玩了。

很不幸，我的就是千兆网络，我的数据节点是16 core，32G内存，sql节点是16core，16G内存，做了raid10

PS: 水平所限，环境所限，测试结果仅供参考，欢迎大家一起交流提出宝贵的意见，让我更进一步。

【】一：测试

20.30.50.107 3307

mysql -utim -mcgxxxxx -P3307 -h20.30.50.107 --default-character-set=utf8

1 查询测试 100W

1.1  ndbcluster  100W测试，并发分别为--concurrency=800,1200,1500

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-guid-primary  --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=rdb10 --auto-generate-sql-load-type=read   ) 1> r101.log 2> r102.log

-- 20.30.50.31

(time mysqlslap --engine=ndbcluster --auto-generate-sql-guid-primary  --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=rdb10 --auto-generate-sql-load-type=read   ) 1> /root/r101.log 2> /root/r102.log

1.2 innodb  100W测试，并发分别为--concurrency=800,1200,1500

-- 20.30.50.37

(time mysqlslap --engine=innodb -h20.30.50.37 -P3307  -utim -mcgxxxxx --auto-generate-sql-guid-primary  --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=idb10 --auto-generate-sql-load-type=read   ) 1> /root/rin101.log 2> /root/rin102.log

mixed 混合读写压力测试

2  ndbcluster 10W

【===================10W 写 =================】

2.1  ndbcluster 在集群里面测试，并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 3.735 seconds

Minimum number of seconds to run all queries: 3.629 seconds

Maximum number of seconds to run all queries: 3.841 seconds

Number of clients running queries: 500

Average number of queries per client: 200

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 3.577 seconds

Minimum number of seconds to run all queries: 3.535 seconds

Maximum number of seconds to run all queries: 3.619 seconds

Number of clients running queries: 1000

Average number of queries per client: 100

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 7.998 seconds

Minimum number of seconds to run all queries: 7.513 seconds

Maximum number of seconds to run all queries: 8.483 seconds

Number of clients running queries: 1500

Average number of queries per client: 66

2.2 innodb 在20.30.50.52里面测试，并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=innodb -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500,1000,1500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indbw2 –-commint=100 --auto-generate-sql-load-type=write) 1> idb11w.log  2> indb12w.log

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 14.494 seconds

Minimum number of seconds to run all queries: 13.995 seconds

Maximum number of seconds to run all queries: 14.994 seconds

Number of clients running queries: 500

Average number of queries per client: 200

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 15.575 seconds

Minimum number of seconds to run all queries: 15.427 seconds

Maximum number of seconds to run all queries: 15.724 seconds

Number of clients running queries: 1000

Average number of queries per client: 100

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 14.275 seconds

Minimum number of seconds to run all queries: 13.989 seconds

Maximum number of seconds to run all queries: 14.561 seconds

Number of clients running queries: 1500

Average number of queries per client: 66

3【===================50W 写 =================】

3.1 ndbcluster，并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-500.log 2> 52-500.log

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-1000.log 2> 52-1000.log

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-1500.log 2> 52-1500.log

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 15.950 seconds

Minimum number of seconds to run all queries: 15.797 seconds

Maximum number of seconds to run all queries: 16.104 seconds

Number of clients running queries: 500

Average number of queries per client: 1000

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 16.325 seconds

Minimum number of seconds to run all queries: 16.080 seconds

Maximum number of seconds to run all queries: 16.570 seconds

Number of clients running queries: 1000

Average number of queries per client: 500

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 25.563 seconds

Minimum number of seconds to run all queries: 24.996 seconds

Maximum number of seconds to run all queries: 26.130 seconds

Number of clients running queries: 1500

Average number of queries per client: 333

3.2 innodb，并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=innodb -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-500.log  2> idb52-500.log

(time mysqlslap --engine=innodb -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-1000.log  2> idb52-1000.log

(time mysqlslap --engine=innodb -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-1500.log  2> idb52-1500.log

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 72.366 seconds

Minimum number of seconds to run all queries: 72.271 seconds

Maximum number of seconds to run all queries: 72.461 seconds

Number of clients running queries: 500

Average number of queries per client: 1000

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 75.593 seconds

Minimum number of seconds to run all queries: 75.500 seconds

Maximum number of seconds to run all queries: 75.687 seconds

Number of clients running queries: 1000

Average number of queries per client: 500

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 70.388 seconds

Minimum number of seconds to run all queries: 69.999 seconds

Maximum number of seconds to run all queries: 70.777 seconds

Number of clients running queries: 1500

Average number of queries per client: 333

4【===================100W 写 =================】

4.1 ndbcluster,并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-500.log 2> 102-500.log

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-1000.log 2> 102-1000.log

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-1500.log 2> 102-1500.log

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 72.162 seconds

Minimum number of seconds to run all queries: 71.001 seconds

Maximum number of seconds to run all queries: 73.323 seconds

Number of clients running queries: 500

Average number of queries per client: 2000

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 33.083 seconds

Minimum number of seconds to run all queries: 32.924 seconds

Maximum number of seconds to run all queries: 33.243 seconds

Number of clients running queries: 1000

Average number of queries per client: 1000

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 50.789 seconds

Minimum number of seconds to run all queries: 50.629 seconds

Maximum number of seconds to run all queries: 50.949 seconds

Number of clients running queries: 1500

Average number of queries per client: 666

4.2 innodb,并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=innodb  -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-500.log  2> idb102-500.log

(time mysqlslap --engine=innodb  -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-1000.log  2> idb102-1000.log

(time mysqlslap --engine=innodb  -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-1500.log  2> idb102-1500.log

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 144.806 seconds

Minimum number of seconds to run all queries: 144.262 seconds

Maximum number of seconds to run all queries: 145.350 seconds

Number of clients running queries: 500

Average number of queries per client: 2000

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 152.853 seconds

Minimum number of seconds to run all queries: 152.369 seconds

Maximum number of seconds to run all queries: 153.337 seconds

Number of clients running queries: 1000

Average number of queries per client: 1000

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 146.931 seconds

Minimum number of seconds to run all queries: 140.731 seconds

Maximum number of seconds to run all queries: 153.132 seconds

Number of clients running queries: 1500

Average number of queries per client: 666

5 100W write压力，并发分别为--concurrency=600,800,1000

【===================100W 更新 =================】

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=600,800,1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=udb100 –-commint=100 --auto-generate-sql-load-type=update) 1> u101.log 2> u102.log

6【===================200W 写 =================】

6.1 ndbcluster,并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201.log 2> 202.log

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1000.log 2> 202-1000.log

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1500.log 2> 202-1500.log

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 62.062 seconds

Minimum number of seconds to run all queries: 60.812 seconds

Maximum number of seconds to run all queries: 63.313 seconds

Number of clients running queries: 500

Average number of queries per client: 4000

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 65.292 seconds

Minimum number of seconds to run all queries: 64.708 seconds

Maximum number of seconds to run all queries: 65.876 seconds

Number of clients running queries: 1000

Average number of queries per client: 2000

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 101.242 seconds

Minimum number of seconds to run all queries: 99.702 seconds

Maximum number of seconds to run all queries: 102.783 seconds

Number of clients running queries: 1500

Average number of queries per client: 1333

6.2 innodb ,并发分别为--concurrency=600,800,1000

(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201.log 2> 202.log

(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1000.log 2> 202-1000.log

(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1500.log 2> 202-1500.log

卡住了，长时间无结果，所以我果断ctrl + c

7【===================400W 写 =================】

7.1 ndbcluster,并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-500.log 2> 402-500.log

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1000.log 2> 402-1000.log

(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1500.log 2> 402-1500.log

Benchmark

Running for engine ndbcluster

Average number of seconds to run all queries: 125.639 seconds

Minimum number of seconds to run all queries: 124.601 seconds

Maximum number of seconds to run all queries: 126.677 seconds

Number of clients running queries: 500

Average number of queries per client: 8000

PS：只执行了500的并发，1000，1500的卡住了，没有结果，果断ctrl + C

7.2 innodb,并发分别为--concurrency=500,1000,1500

(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-500.log 2> 402-500.log

(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1000.log 2> 402-1000.log

(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1500.log 2> 402-1500.log

卡住了，长时间无结果，所以我果断ctrl + c

8 一些调试过程中的报错纪录

8.1

time mysqlslap --engine=ndbcluster --auto-generate-sql-write-number=100000 --auto-generate-sql-guid-primary  --concurrency=200,400,600 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb –-commint=1000

报错如下：

mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),1124366589,1668402834,788193961,693240337,710453914,1431628572,249499286,1957253341,731708400,1783032263,'lFEughGHyWDXctISMOyE500yda24R2J4HZyp6674cCb5ymPKAGQ7GQxts0pK29GCa7th5sdi55fvr4FtKhsSzpMrh33k4KofJhCOapyXuTQdaZMm6E75wLodOsDT4t','0FbCf11eOo7iPZ7oCDuJAigyCwiHPmBP1eTZXX3vB2TcSSGYh3rrlNhxBOFd2QuwwOTRnOEyQjQuBbQke9RNO8DcOK5JmrFaFc1usFkIq351eNd8P4Xh4c9LwEgayn','85F907OcHEfM79ekHvghcd9my6sWgqHpwYqoX7OoLw3L5hxFSeo4Fxi53bbcHsHDGztn6IRK6Wh33eIX8ycFwACrlnJvXc0fcuIi4muAGbDC6Oj6MBEAMQ2zEDudqv','HIhbslLnnWM0iKGPRXTZhrzbqDhdjXY0hDRZqhKdBbTlne269XfiMfA5kriRE6JvJnS1Shef8zGvdI2mqZL4CN9pEjGKpcF0Fb1j8XEGXW48oynWX0bcNcPTKZp994','2GX3zgR5oybsyGideEdDi0i7TugIviExyetqAKvyANj8XPm9XNFDGxClrtwmR2cPgTFqp3hzQOzxhly51DAH2Nut8iYbl80PT88I3p9LD0Ame8rfM2oOPaAZHa02as','J3sRDvGEGLEQ8sRzNptB5Am7bvhbxFSGAKkNGsdOEkjMcADsrz3w9hwdcTCPdgantA312YPGG8WlAcd1RYqS6m5aFI0sqaYjkbke72nG291DdeE4AwZGiWrqgjaX9y','6lZjNZlApnKqspK7uWvJfWpMKWxmt6lzrAi6jJHY7TEzIay45mNcG5qSRnEKlrBc2mad5jA4COwNzmRwYjOogE87tFJe6W608geEOgASwyjnlBj9mzqQ5yPyDkSC6a','4F7iLNENjBMRyzWa0GZqaXhzTmbyqhOvwNT9mkZWnnxdmJBebdT1820TgbJX8kIxzn6eNX8AAxowGrRjSokSqcyM39t3tB0lrzNEMNPZC5LKwo3HcflI7bhAlaDWe6','FL5ebR1ssDpEZm2S3fzgx68WGt5MFbSXoP1Fkv8d0prQblmWOmBEsBk14hNB8jio0c4kN4LNt4pLqcr6MuC65p71MMDNxnBxNFimJv2DsraiJHgZClY9aXBouOBjBN','hReF5qA7vurLS2e9Sim0sKX38HJC1Mbip5pnnzmimT3EYaNsG9s8LF3MZMaal18QyxDmo0KaTGptq4l66TFJlIhIZ7kI0kkrZyTDqpgB5TxvPiuXC1jpBOzkOb2OJn')

ERROR : Got temporary error 1221 'REDO buffers overloaded (increase RedoBuffer)' from NDBCLUSTER

【】设置值

RedoBuffer=1024M

8.2

mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),493003739,1094004845,2043467988,1553979924,1267424138,2013801552,1873938704,1783263123,1384180838,447107163,'1MPJh2d9MOvi9GCrzc6vAxsqMXvyQPuJnJfLL8MbPHHaaMHPqFCsDxjRSWHmvB5aMcvbdHA2RKStilAYtFOyCzPYTaAGm7j8kWcDgm776bsgCu4x9TvDKClinnyZvZ','ZX49kkorjmQRRWLXSNsNcDcEvF1lgwJDRFF3zvuahC10bMY3dGIELmKG1LuhA5ndK2hBpRlWgeX7svAWBKcZ7wh8HRqROdxkXWnKxYiT2Dcv0eP4z1T6p2E6MwQmZN','XwtIGijzCd4gYxJptIiMOXGWWeRwPsJop46xmhoqBlXjiqPb07pOf5m9cDx1y8pnCncqLPhYA4FkmgBmg02BxoCZu9asHFXL373GOkoagvIQSTC8LEBJvNkpYBZhQ4','uL3xdSaHuEDDZhalhossznFjcfu1CDx6Q0vwKTDFcQK9zmugaeYZPf9tIvuM0rSRkON4lSBLnNMmA9Jcnj2DNByZ6to7kGQKYhPA9SNosmbunmMaTOfkbeAaNyZ76z','KXYdhh5wWpixjLb6w4MRhq5jOShpSfooAKPjtMgFCE4ncflOc8r9ypsE9Z3dCjHFvayopWw1lsoDYad0aK9Y91mJQpoWYylRYc7L6vEjovoCLPCveDRnE56gun2Ilo','d9OcNMYdyCYmOl4Sgih7Ln4KJy7L8s1dtPEGgemWqAG6wCQcu7cGmgc5XbIfJKHCdNLH17njHwpD8FivEIB0qfxLEFtZb2dDHyMI52tFyaKyh2tnC4n3bcGpj1EB3s','OKqeWogN3WpNTWIMHWJwPuOic8jqJfabrH5M5md08JNTpZsz43vTxK3PKfGfAi61zBFwploy4CRtdBshEg34syTCddjnKphB0w0qhoglszXW3F39v6Df5jraCaEONv','cGrSyPGW21LZXOhaaSZf8eEz4RQIrhDJxxnnMwHOxXqKvXuLzJ17p7zuaHCIyIdoFHbT5lt28bM368HySAxHHw3kDG24QXshgJAlwvf4N10L2HJMJHXc5bCJj6F9e7','iAQkwFXbJuTBGNKblfkG8qjK1QRGRxF9zZtvoPN0BkBR7YvkBfsJLcYMuzWMolNnJ9b7aq7laB5Zj09mX16tTWFOTee9N1wi2NicDhEfsBCRBLEiFCRkib03DeCcY0','BaOl3dI9HBKLWNjkxywPae0bh55lZTmkwALzng0wjKIDjtygjmxHHxkq2qccBMC7OayB6y0pAIul3sQmXFvoDge7MEbZSohsEfwCWw1g6vI9gcn3rir4ML4kSfIwJr')

ERROR : Got temporary error 1218 'Send Buffers overloaded in NDB kernel' from NDBCLUSTER

【】设置值

在sql节点的my.cnf里面去掉binlog

8.3

time mysqlslap --engine=ndbcluster --auto-generate-sql-write-number=100000 --auto-generate-sql-guid-primary  --concurrency=200,400,600 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb –-commint=1000 --auto-generate-sql-load-type=write

mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),100669,332702450,660916487,67974802,573556837,75245562,1390598089,1028363610,1531585205,1260995960,'kXdTjGCh2PNzLoeR0527frpQDQ8uw67Ydk1K06uuNHtkxYBxT5w8plb2BbpzhwYBgPNYX9RmICWGkZD6fAESvhMzH3yqzMtXoH4BQNylbK1CmEIPGYlC6zBN3152Gz','a4GW7atxJKACYwJqDbFynLxqc0kh30YTwgz3FktQ43XTrqJ4PQ25frn7kXhfXD8RuzN1j8Rf3y8ugKy6es3IbqPJM6ylCyD6xS7YcQCfHKZxYNvB7yTahmu3lkoxjt','vgLu5xKHSTTtJuGE5F5QqmCcppCTmvFZScRZQgim93gSxwb24gKmIPEzEQStMjQiCu7WapGbkw4ilXch3xRLMhKSzgLDOovSi2qGj6rKvnuYAWDDJgaZDu24bNIrBD','Bl81tjzdvuOpQRCXgX37xGtzLKEXBIcE3k7xK7aFtqxC99jqYnpTviK83bf6lGDgsKd4R3KLmHPnI8TqnIKj1gjw7N2sXFZNS2Svyg8cpZN7atxL39w4igspvnaQuz','hMt1IrZIJMkbLAKBNNKKK2sCknzI5uHeGAgQuDd5SLgpN0smODyc7qorTo1QaI5qLl97qmCIzl0Mds81x7TxpIoJyqlY0iEDRNKA1PS0AKEn5NhuMAr3KgEIMsqMa5','SuKo4M5OM7ldvisSc6WK9rsG9E8sSixocHdgfa5uiiNTGFxkDJ4EAwWC2e4NL1BpAgWiFRcp1zIH6F1BayPdmwphatwnmzdwgzWnQ6SRxmcvtd6JRYwEKdvuWri8qB','5MAR1caTvNFXB00HKShGa1uToGCMP2ZMHjpABFg6fnTioTz8pZGNQAkEJwckr9y0kfAvvq1QWM8IkzIZOaprdPxwMaY5bW5C977wy1MKNMe7EwZeWET7fRv1tRyKpv','Yr3YntZ2DoGrwWfL91bW9Epw8iO6vDuR4xrkqOe3Dum1PPEQQpwRvmO3Kg2FtobqlQQRj4Woq8hFZvhrkWBX8bRSFLc09BiuT0L44jsvrZ2GKczwyAS6dvakGAlPDJ','BbKOfG7O3qp66Aa5yY8QelD4WL77eKIpneDJnCbq2Oo0QM6Pm6jOrxLDASCpgXWS1cnooMXjeJj5ahMCnxTXuqkxIxmyK8QLk52PJZ8ykjvAP9N46sbtiKq09SqTcH','iLEkea9eOuLJweKJjQ3IJlW1dXTSs6dbJjJpHTRZFgkBJ4XuNQ4iCRchy51r3WQEEdvNyMxDvZHEeg0164bINBsM9l54GNBM06lrTa4G8LWe1Mf8I6IiA24Jo1FwOQ')

ERROR : Got temporary error 1234 'REDO log files overloaded (increase disk hardware)' from NDBCLUSTER

【】清理磁盘data节点37的磁盘满了

/home/ndb_4_fs文件夹占据了22G，清理掉。

8.4

【】

ERROR : Got temporary error 410 'REDO log files overloaded (decrease TimeBetweenLocalCheckpoints or increase NoOfFragmentLogFiles)' from NDBCLUSTER

vim /usr/local/mysql/cluster-conf/config.ini

TimeBetweenLocalCheckpoints=10 (原值20)

NoOfFragmentLogFiles=32 (原值8)

ERROR : Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER --------------------- 本文来自 黄杉 的CSDN 博客 ，全文地址请点击：https://blog.csdn.net/mchdba/article/details/10496839?utm_source=copy

大图都
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
MySql Cluster 测试结果
weixin_33939380的博客
05-24 108
2019独角兽企业重金招聘Python工程师标准>>> ...
JMeter多节点压力测试
FrankieCheng的专栏
11-05 3807
应用进场景：用一台机器（称为JMeter客户端）上的jmeter同时启动另外几台机器（称为JMeter远程服务器）上的jmeter。 1. 保证jmeter客户端和jmeter远程服务器采用相同版本的jmeter和JVM。 2. jmeter客户端和jmeter远程服务器最好在同一个网段内。 3. 在jmeter远程服务器上运行JMETER_HOME/bin/jmeter-server （U
Tron 节点 性能压测
最新发布
J_Lee
05-24 338
最近搭建了一个TRON节点，同事不相信我的自建节点比官方更靠谱，咱们给他使用golang写一个压测脚本，测试一下。 本文档详细介绍了一个基于 Go 的并发 HTTP 请求工具，帮助你对 Tron 节点进行压力测试。本文档将从代码简介、环境配置、编译运行以及结果分析等方面进行详细说明。
MySQL Cluster 4个数据节点压力测试--mysqlslap工具压400W写
记事本
09-26 912
锅巴哥的个人建议：cluster叫电信运营商版本，所以基本上在很大的用户并发量的情况下才会用到，对连接数的线性增长要求高的场景，千兆就不用想了， 没万兆就不用玩了。 很不幸，我的就是千兆网络，我的数据节点是16 core，32G内存，sql节点是16core，16G内存，做了raid10 PS: 水平所限，环境所限，测试结果仅供参考，欢迎大家一起交流提出宝贵的意见，让我更进一步。 【】一：测...
mysql cluster 压力测试_MySQL Cluster 4个数据节点压力测试--mysqlslap工具压400W写
weixin_34171095的博客
01-19 293
锅巴哥的个人建议：cluster叫电信运营商版本，所以基本上在很大的用户并发量的情况下才会用到，对连接数的线性增长要求高的场景，千兆就不用想了， 没万兆就不用玩了。很不幸，我的就是千兆网络，我的数据节点是16 core，32G内存，sql节点是16core，16G内存，做了raid10PS: 水平所限，环境所限，测试结果仅供参考，欢迎大家一起交流提出宝贵的意见，让我更进一步。【】一：测试20.30...
MySQL压力测试方法 如何使用mysqlslap测试MySQL的压力?
12-16
其实mysql测试也没有这么复杂，除了一些常用的select\insert\update\deletc这些外，其实测试他的并发量才是最重要的。比如在连接数1K的时候，并发量能否满足当前请求\服务器性能、内存CPU使用情况。说白了，测试...
详解Mysql5.7自带的压力测试命令mysqlslap及使用语法
09-09
MySQL 5.7 自带的 `mysqlslap` 是一个非常实用的工具，用于模拟客户端负载，对数据库进行压力测试，以评估其性能和稳定性。通过模拟多用户并发访问，`mysqlslap` 可以帮助管理员了解在特定负载下数据库的表现，从而...
Mysqlslap MySQL压力测试工具 简单教程
09-11
MySQLslap是一个集成在MySQL服务器中的内置工具，用于进行数据库的压力测试。自5.1.4版本起，MySQL提供此工具来帮助用户评估数据库在高并发情况下的性能表现。Mysqlslap通过模拟多个并发客户端对MySQL服务器进行访问...
开源办公开发平台丨Mysql5.7两套四节点主从结构环境搭建教程（二）
liyi_hz2008的博客
11-23 191
MyCat及主从分库分表方案 1、MyCAT基础架构准备 1.1 环境准备： 两台虚拟机 db01 db02 每台创建四个Mysql实例 3307 3308 3309 3310 数据目录：/data/ 1.2 删除历史环境（在需要时执行） pkill mysql rm -rf /data/* mv /etc/my.cnf /etc/my.cnf.bak 数据库准备 一、Mysql5.7.29服务器下载 服务器下载链接：https://cdn.mysql.com/...
innodb cluster 安装及性能测试
水彩橘子
07-26 730
一、实验环境介绍 cpu：16核心 内存：64G 操作系统：centos7.8 mysql版本：mysql8.0 ip地址规划:10.99.19.74; 10.99.19.75; 10.99.19.76 配置主机名及解析 二、安装mysql https://blog.csdn.net/zyj81092211/article/details/107489793 更改root用户主机名为% mysql> update mysql.user set host = '%' where user = 'root
xfz:小饭桌官网原始码
03-23
xfz:小饭桌官网原始码
mysql 集群自动负载_MySQL Cluster集群负载配置
weixin_42515056的博客
01-27 115
MySQL Cluster集群负载配置一、软件包a) MySQL-ndb-management-5.0.90-1.i386.rpmb) MySQL-ndb-management-5.0.90-1.i386.rpmc) mysql-5.0.27.tar.gz二、安装［管理节点］a) rpm -ivh MySQL-ndb-tools-5.0.90-1.i386.rpmb) rpm -ivh MySQL...
CoAP测试服务器 wsncoap.org
物联网 IoT 经验分享
11-04 2万+
coap://vs0.inf.ethz.ch:5683 是一个CoAP测试服务器，但是该服务器远在欧洲，由于种种情况不能稳定访问。为了让更多的国内物联网爱好者学习和使用CoAP协议，我自掏腰包购买了wsncoap.org域名，并租用了阿里云服务器。在阿里云服务器中部署了和vs0.inf.ethz.ch相似的CoAP服务器，通过coap://wsncoap.org也可以测试和验证CoAP协议的各
php正则匹配sg-nc-wap_Pandas基础操作（上）
热门推荐
weixin_28977715的博客
12-29 11万+
文章目录一、Pandas文件读取1.pandas数据读取1、读取纯文本文件1.1 读取csv，使用默认的标题行、逗号分隔符1.2 读取txt文件，自己指定分隔符、列名2、读取excel文件3、读取sql文件二、pandas的数据结构DataFrame和SeriesDataFrame：二维数据，整个表格，多行多列1.Series1.1 仅有数据列表即可生产最简单的Series1.2 创建一个具有标签...
MySQL Cluster初步测试结果汇总图示报告 用mysqlslap与sysbench进行测试
记事本
09-26 769
Cluster结构图                                                 测试环境简介 Mysql cluster集群测试环境 4 data node，32G 8核cpu 4 sql node， 16G 8核cpu 1 manage node，16G 8核cpu Cluster版本：          mysql-5.5.25...
signature=3eda655e9e4dbd6ac0cf4fcd2462751b,PayPal
weixin_31002075的博客
05-29 4万+
To: opes-archive@ietf.orgSubject: SAGE PARMESAN UPSIDE DOWNDate: Fri, 8 Sep 2006 17:30:40 -0200MIME-Version: 1.0Content-Type: multipart/related;type="multipart/alternative";boundary="----=_NextPart_...
mysql集群压力测试_[原创]对MYSQL进行压力测试
weixin_39938724的博客
01-21 151
1、安装supersmackhttp://vegan.net/tony/supersmack/安装过程以及我中间遇到问题的总结都在这里。之前记得把libmysqlclient.so.16拷贝到/usr/lib中去，这样make 的时候不用改MakeFile文件。[root@localhost super-smack-1.3]# cp /usr/local/mysql/libmysqlclient....
MySQL集群压力测试工具详解
Mysqlslap是由MySQL官方提供的开源测试工具，它可以创建多个并发会话来测试数据库的读写性能。用户可以通过自定义SQL语句或存储过程来执行测试。Mysqlslap支持不同引擎之间的性能比较，其关键参数包括： - `-a, --...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值