MySQL Cluster 4个数据节点压力测试--mysqlslap工具压400W写

最新推荐文章于 2023-03-28 15:43:09 发布
最新推荐文章于 2023-03-28 15:43:09 发布
阅读量935 收藏
点赞数

锅巴哥的个人建议：cluster叫电信运营商版本，所以基本上在很大的用户并发量的情况下才会用到，对连接数的线性增长要求高的场景，千兆就不用想了， 没万兆就不用玩了。

很不幸，我的就是千兆网络，我的数据节点是16 core，32G内存，sql节点是16core，16G内存，做了raid10

PS: 水平所限，环境所限，测试结果仅供参考，欢迎大家一起交流提出宝贵的意见，让我更进一步。





【】一：测试
20.30.50.107 3307
mysql -utim -mcgxxxxx -P3307 -h20.30.50.107 --default-character-set=utf8 


1 查询测试 100W
1.1  ndbcluster  100W测试，并发分别为--concurrency=800,1200,1500 
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-guid-primary  --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=rdb10 --auto-generate-sql-load-type=read   ) 1> r101.log 2> r102.log
-- 20.30.50.31
(time mysqlslap --engine=ndbcluster --auto-generate-sql-guid-primary  --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=rdb10 --auto-generate-sql-load-type=read   ) 1> /root/r101.log 2> /root/r102.log


1.2 innodb  100W测试，并发分别为--concurrency=800,1200,1500 
-- 20.30.50.37
(time mysqlslap --engine=innodb -h20.30.50.37 -P3307  -utim -mcgxxxxx --auto-generate-sql-guid-primary  --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=idb10 --auto-generate-sql-load-type=read   ) 1> /root/rin101.log 2> /root/rin102.log






mixed 混合读写压力测试
2  ndbcluster 10W
【===================10W 写 =================】
2.1  ndbcluster 在集群里面测试，并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)  
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)  
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write) 


Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 3.735 seconds
        Minimum number of seconds to run all queries: 3.629 seconds
        Maximum number of seconds to run all queries: 3.841 seconds
        Number of clients running queries: 500
        Average number of queries per client: 200
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 3.577 seconds
        Minimum number of seconds to run all queries: 3.535 seconds
        Maximum number of seconds to run all queries: 3.619 seconds
        Number of clients running queries: 1000
        Average number of queries per client: 100
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 7.998 seconds
        Minimum number of seconds to run all queries: 7.513 seconds
        Maximum number of seconds to run all queries: 8.483 seconds
        Number of clients running queries: 1500
        Average number of queries per client: 66


2.2 innodb 在20.30.50.52里面测试，并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500,1000,1500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indbw2 –-commint=100 --auto-generate-sql-load-type=write) 1> idb11w.log  2> indb12w.log
Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 14.494 seconds
        Minimum number of seconds to run all queries: 13.995 seconds
        Maximum number of seconds to run all queries: 14.994 seconds
        Number of clients running queries: 500
        Average number of queries per client: 200


Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 15.575 seconds
        Minimum number of seconds to run all queries: 15.427 seconds
        Maximum number of seconds to run all queries: 15.724 seconds
        Number of clients running queries: 1000
        Average number of queries per client: 100


Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 14.275 seconds
        Minimum number of seconds to run all queries: 13.989 seconds
        Maximum number of seconds to run all queries: 14.561 seconds
        Number of clients running queries: 1500
        Average number of queries per client: 66






3【===================50W 写 =================】
3.1 ndbcluster，并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-500.log 2> 52-500.log 
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-1000.log 2> 52-1000.log 
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-1500.log 2> 52-1500.log 
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 15.950 seconds
        Minimum number of seconds to run all queries: 15.797 seconds
        Maximum number of seconds to run all queries: 16.104 seconds
        Number of clients running queries: 500
        Average number of queries per client: 1000
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 16.325 seconds
        Minimum number of seconds to run all queries: 16.080 seconds
        Maximum number of seconds to run all queries: 16.570 seconds
        Number of clients running queries: 1000
        Average number of queries per client: 500
 Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 25.563 seconds
        Minimum number of seconds to run all queries: 24.996 seconds
        Maximum number of seconds to run all queries: 26.130 seconds
        Number of clients running queries: 1500
        Average number of queries per client: 333


3.2 innodb，并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-500.log  2> idb52-500.log
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-1000.log  2> idb52-1000.log
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-1500.log  2> idb52-1500.log
Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 72.366 seconds
        Minimum number of seconds to run all queries: 72.271 seconds
        Maximum number of seconds to run all queries: 72.461 seconds
        Number of clients running queries: 500
        Average number of queries per client: 1000
Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 75.593 seconds
        Minimum number of seconds to run all queries: 75.500 seconds
        Maximum number of seconds to run all queries: 75.687 seconds
        Number of clients running queries: 1000
        Average number of queries per client: 500
Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 70.388 seconds
        Minimum number of seconds to run all queries: 69.999 seconds
        Maximum number of seconds to run all queries: 70.777 seconds
        Number of clients running queries: 1500
        Average number of queries per client: 333





4【===================100W 写 =================】
4.1 ndbcluster,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-500.log 2> 102-500.log 
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-1000.log 2> 102-1000.log 
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-1500.log 2> 102-1500.log 


Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 72.162 seconds
        Minimum number of seconds to run all queries: 71.001 seconds
        Maximum number of seconds to run all queries: 73.323 seconds
        Number of clients running queries: 500
        Average number of queries per client: 2000
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 33.083 seconds
        Minimum number of seconds to run all queries: 32.924 seconds
        Maximum number of seconds to run all queries: 33.243 seconds
        Number of clients running queries: 1000
        Average number of queries per client: 1000
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 50.789 seconds
        Minimum number of seconds to run all queries: 50.629 seconds
        Maximum number of seconds to run all queries: 50.949 seconds
        Number of clients running queries: 1500
        Average number of queries per client: 666


4.2 innodb,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=innodb  -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-500.log  2> idb102-500.log
(time mysqlslap --engine=innodb  -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-1000.log  2> idb102-1000.log
(time mysqlslap --engine=innodb  -h127.0.0.1 -P3307  -uadmin -pMBpassw0rd  --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-1500.log  2> idb102-1500.log
Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 144.806 seconds
        Minimum number of seconds to run all queries: 144.262 seconds
        Maximum number of seconds to run all queries: 145.350 seconds
        Number of clients running queries: 500
        Average number of queries per client: 2000
Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 152.853 seconds
        Minimum number of seconds to run all queries: 152.369 seconds
        Maximum number of seconds to run all queries: 153.337 seconds
        Number of clients running queries: 1000
        Average number of queries per client: 1000
Benchmark
        Running for engine innodb
        Average number of seconds to run all queries: 146.931 seconds
        Minimum number of seconds to run all queries: 140.731 seconds
        Maximum number of seconds to run all queries: 153.132 seconds
        Number of clients running queries: 1500
        Average number of queries per client: 666




5 100W write压力，并发分别为--concurrency=600,800,1000
【===================100W 更新 =================】
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=600,800,1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=udb100 –-commint=100 --auto-generate-sql-load-type=update) 1> u101.log 2> u102.log 



6【===================200W 写 =================】
6.1 ndbcluster,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201.log 2> 202.log 
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1000.log 2> 202-1000.log 
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1500.log 2> 202-1500.log 
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 62.062 seconds
        Minimum number of seconds to run all queries: 60.812 seconds
        Maximum number of seconds to run all queries: 63.313 seconds
        Number of clients running queries: 500
        Average number of queries per client: 4000
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 65.292 seconds
        Minimum number of seconds to run all queries: 64.708 seconds
        Maximum number of seconds to run all queries: 65.876 seconds
        Number of clients running queries: 1000
        Average number of queries per client: 2000
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 101.242 seconds
        Minimum number of seconds to run all queries: 99.702 seconds
        Maximum number of seconds to run all queries: 102.783 seconds
        Number of clients running queries: 1500
        Average number of queries per client: 1333

6.2 innodb ,并发分别为--concurrency=600,800,1000
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201.log 2> 202.log 
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1000.log 2> 202-1000.log 
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1500.log 2> 202-1500.log 
卡住了，长时间无结果，所以我果断ctrl + c


7【===================400W 写 =================】
7.1 ndbcluster,并发分别为--concurrency=500,1000,1500
 (time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-500.log 2> 402-500.log 
  (time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1000.log 2> 402-1000.log 
   (time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1500.log 2> 402-1500.log 
Benchmark
        Running for engine ndbcluster
        Average number of seconds to run all queries: 125.639 seconds
        Minimum number of seconds to run all queries: 124.601 seconds
        Maximum number of seconds to run all queries: 126.677 seconds
        Number of clients running queries: 500
        Average number of queries per client: 8000
PS：只执行了500的并发，1000，1500的卡住了，没有结果，果断ctrl + C


7.2 innodb,并发分别为--concurrency=500,1000,1500
 (time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-500.log 2> 402-500.log 
  (time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1000 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1000.log 2> 402-1000.log 
   (time mysqlslap --engine=innodb -h20.30.50.107 -P3307  -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary  --concurrency=1500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1500.log 2> 402-1500.log 
卡住了，长时间无结果，所以我果断ctrl + c




8 一些调试过程中的报错纪录
8.1 
time mysqlslap --engine=ndbcluster --auto-generate-sql-write-number=100000 --auto-generate-sql-guid-primary  --concurrency=200,400,600 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb –-commint=1000  
报错如下：
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),1124366589,1668402834,788193961,693240337,710453914,1431628572,249499286,1957253341,731708400,1783032263,'lFEughGHyWDXctISMOyE500yda24R2J4HZyp6674cCb5ymPKAGQ7GQxts0pK29GCa7th5sdi55fvr4FtKhsSzpMrh33k4KofJhCOapyXuTQdaZMm6E75wLodOsDT4t','0FbCf11eOo7iPZ7oCDuJAigyCwiHPmBP1eTZXX3vB2TcSSGYh3rrlNhxBOFd2QuwwOTRnOEyQjQuBbQke9RNO8DcOK5JmrFaFc1usFkIq351eNd8P4Xh4c9LwEgayn','85F907OcHEfM79ekHvghcd9my6sWgqHpwYqoX7OoLw3L5hxFSeo4Fxi53bbcHsHDGztn6IRK6Wh33eIX8ycFwACrlnJvXc0fcuIi4muAGbDC6Oj6MBEAMQ2zEDudqv','HIhbslLnnWM0iKGPRXTZhrzbqDhdjXY0hDRZqhKdBbTlne269XfiMfA5kriRE6JvJnS1Shef8zGvdI2mqZL4CN9pEjGKpcF0Fb1j8XEGXW48oynWX0bcNcPTKZp994','2GX3zgR5oybsyGideEdDi0i7TugIviExyetqAKvyANj8XPm9XNFDGxClrtwmR2cPgTFqp3hzQOzxhly51DAH2Nut8iYbl80PT88I3p9LD0Ame8rfM2oOPaAZHa02as','J3sRDvGEGLEQ8sRzNptB5Am7bvhbxFSGAKkNGsdOEkjMcADsrz3w9hwdcTCPdgantA312YPGG8WlAcd1RYqS6m5aFI0sqaYjkbke72nG291DdeE4AwZGiWrqgjaX9y','6lZjNZlApnKqspK7uWvJfWpMKWxmt6lzrAi6jJHY7TEzIay45mNcG5qSRnEKlrBc2mad5jA4COwNzmRwYjOogE87tFJe6W608geEOgASwyjnlBj9mzqQ5yPyDkSC6a','4F7iLNENjBMRyzWa0GZqaXhzTmbyqhOvwNT9mkZWnnxdmJBebdT1820TgbJX8kIxzn6eNX8AAxowGrRjSokSqcyM39t3tB0lrzNEMNPZC5LKwo3HcflI7bhAlaDWe6','FL5ebR1ssDpEZm2S3fzgx68WGt5MFbSXoP1Fkv8d0prQblmWOmBEsBk14hNB8jio0c4kN4LNt4pLqcr6MuC65p71MMDNxnBxNFimJv2DsraiJHgZClY9aXBouOBjBN','hReF5qA7vurLS2e9Sim0sKX38HJC1Mbip5pnnzmimT3EYaNsG9s8LF3MZMaal18QyxDmo0KaTGptq4l66TFJlIhIZ7kI0kkrZyTDqpgB5TxvPiuXC1jpBOzkOb2OJn') 
ERROR : Got temporary error 1221 'REDO buffers overloaded (increase RedoBuffer)' from NDBCLUSTER
【】设置值
RedoBuffer=1024M


8.2 
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),493003739,1094004845,2043467988,1553979924,1267424138,2013801552,1873938704,1783263123,1384180838,447107163,'1MPJh2d9MOvi9GCrzc6vAxsqMXvyQPuJnJfLL8MbPHHaaMHPqFCsDxjRSWHmvB5aMcvbdHA2RKStilAYtFOyCzPYTaAGm7j8kWcDgm776bsgCu4x9TvDKClinnyZvZ','ZX49kkorjmQRRWLXSNsNcDcEvF1lgwJDRFF3zvuahC10bMY3dGIELmKG1LuhA5ndK2hBpRlWgeX7svAWBKcZ7wh8HRqROdxkXWnKxYiT2Dcv0eP4z1T6p2E6MwQmZN','XwtIGijzCd4gYxJptIiMOXGWWeRwPsJop46xmhoqBlXjiqPb07pOf5m9cDx1y8pnCncqLPhYA4FkmgBmg02BxoCZu9asHFXL373GOkoagvIQSTC8LEBJvNkpYBZhQ4','uL3xdSaHuEDDZhalhossznFjcfu1CDx6Q0vwKTDFcQK9zmugaeYZPf9tIvuM0rSRkON4lSBLnNMmA9Jcnj2DNByZ6to7kGQKYhPA9SNosmbunmMaTOfkbeAaNyZ76z','KXYdhh5wWpixjLb6w4MRhq5jOShpSfooAKPjtMgFCE4ncflOc8r9ypsE9Z3dCjHFvayopWw1lsoDYad0aK9Y91mJQpoWYylRYc7L6vEjovoCLPCveDRnE56gun2Ilo','d9OcNMYdyCYmOl4Sgih7Ln4KJy7L8s1dtPEGgemWqAG6wCQcu7cGmgc5XbIfJKHCdNLH17njHwpD8FivEIB0qfxLEFtZb2dDHyMI52tFyaKyh2tnC4n3bcGpj1EB3s','OKqeWogN3WpNTWIMHWJwPuOic8jqJfabrH5M5md08JNTpZsz43vTxK3PKfGfAi61zBFwploy4CRtdBshEg34syTCddjnKphB0w0qhoglszXW3F39v6Df5jraCaEONv','cGrSyPGW21LZXOhaaSZf8eEz4RQIrhDJxxnnMwHOxXqKvXuLzJ17p7zuaHCIyIdoFHbT5lt28bM368HySAxHHw3kDG24QXshgJAlwvf4N10L2HJMJHXc5bCJj6F9e7','iAQkwFXbJuTBGNKblfkG8qjK1QRGRxF9zZtvoPN0BkBR7YvkBfsJLcYMuzWMolNnJ9b7aq7laB5Zj09mX16tTWFOTee9N1wi2NicDhEfsBCRBLEiFCRkib03DeCcY0','BaOl3dI9HBKLWNjkxywPae0bh55lZTmkwALzng0wjKIDjtygjmxHHxkq2qccBMC7OayB6y0pAIul3sQmXFvoDge7MEbZSohsEfwCWw1g6vI9gcn3rir4ML4kSfIwJr') 
ERROR : Got temporary error 1218 'Send Buffers overloaded in NDB kernel' from NDBCLUSTER
【】设置值
在sql节点的my.cnf里面去掉binlog


8.3
 time mysqlslap --engine=ndbcluster --auto-generate-sql-write-number=100000 --auto-generate-sql-guid-primary  --concurrency=200,400,600 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb –-commint=1000 --auto-generate-sql-load-type=write   
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),100669,332702450,660916487,67974802,573556837,75245562,1390598089,1028363610,1531585205,1260995960,'kXdTjGCh2PNzLoeR0527frpQDQ8uw67Ydk1K06uuNHtkxYBxT5w8plb2BbpzhwYBgPNYX9RmICWGkZD6fAESvhMzH3yqzMtXoH4BQNylbK1CmEIPGYlC6zBN3152Gz','a4GW7atxJKACYwJqDbFynLxqc0kh30YTwgz3FktQ43XTrqJ4PQ25frn7kXhfXD8RuzN1j8Rf3y8ugKy6es3IbqPJM6ylCyD6xS7YcQCfHKZxYNvB7yTahmu3lkoxjt','vgLu5xKHSTTtJuGE5F5QqmCcppCTmvFZScRZQgim93gSxwb24gKmIPEzEQStMjQiCu7WapGbkw4ilXch3xRLMhKSzgLDOovSi2qGj6rKvnuYAWDDJgaZDu24bNIrBD','Bl81tjzdvuOpQRCXgX37xGtzLKEXBIcE3k7xK7aFtqxC99jqYnpTviK83bf6lGDgsKd4R3KLmHPnI8TqnIKj1gjw7N2sXFZNS2Svyg8cpZN7atxL39w4igspvnaQuz','hMt1IrZIJMkbLAKBNNKKK2sCknzI5uHeGAgQuDd5SLgpN0smODyc7qorTo1QaI5qLl97qmCIzl0Mds81x7TxpIoJyqlY0iEDRNKA1PS0AKEn5NhuMAr3KgEIMsqMa5','SuKo4M5OM7ldvisSc6WK9rsG9E8sSixocHdgfa5uiiNTGFxkDJ4EAwWC2e4NL1BpAgWiFRcp1zIH6F1BayPdmwphatwnmzdwgzWnQ6SRxmcvtd6JRYwEKdvuWri8qB','5MAR1caTvNFXB00HKShGa1uToGCMP2ZMHjpABFg6fnTioTz8pZGNQAkEJwckr9y0kfAvvq1QWM8IkzIZOaprdPxwMaY5bW5C977wy1MKNMe7EwZeWET7fRv1tRyKpv','Yr3YntZ2DoGrwWfL91bW9Epw8iO6vDuR4xrkqOe3Dum1PPEQQpwRvmO3Kg2FtobqlQQRj4Woq8hFZvhrkWBX8bRSFLc09BiuT0L44jsvrZ2GKczwyAS6dvakGAlPDJ','BbKOfG7O3qp66Aa5yY8QelD4WL77eKIpneDJnCbq2Oo0QM6Pm6jOrxLDASCpgXWS1cnooMXjeJj5ahMCnxTXuqkxIxmyK8QLk52PJZ8ykjvAP9N46sbtiKq09SqTcH','iLEkea9eOuLJweKJjQ3IJlW1dXTSs6dbJjJpHTRZFgkBJ4XuNQ4iCRchy51r3WQEEdvNyMxDvZHEeg0164bINBsM9l54GNBM06lrTa4G8LWe1Mf8I6IiA24Jo1FwOQ') 
ERROR : Got temporary error 1234 'REDO log files overloaded (increase disk hardware)' from NDBCLUSTER
【】清理磁盘data节点37的磁盘满了
/home/ndb_4_fs文件夹占据了22G，清理掉。


8.4
【】
ERROR : Got temporary error 410 'REDO log files overloaded (decrease TimeBetweenLocalCheckpoints or increase NoOfFragmentLogFiles)' from NDBCLUSTER
vim /usr/local/mysql/cluster-conf/config.ini
TimeBetweenLocalCheckpoints=10 （原值20）
NoOfFragmentLogFiles=32 （原值8）


ERROR : Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER --------------------- 本文来自 黄杉 的CSDN 博客 ，全文地址请点击：https://blog.csdn.net/mchdba/article/details/10496839?utm_source=copy

CodingSir
关注
MySQL压力测试方法 如何使用mysqlslap测试MySQL的压力?
12-16
其实mysql测试也没有这么复杂，除了一些常用的select\insert\update\deletc这些外，其实测试他的并发量才是最重要的。比如在连接数1K的时候，并发量能否满足当前请求\服务器性能、内存CPU使用情况。说白了，测试...
mysql ndbcluster 缺点_MySQL NDB Cluster和Galera Cluster的主要特性和优缺点介绍
weixin_39629093的博客
01-19 579
MySQL NDB Cluster是MySQL 适合于分布式计算环境的高实用、高冗余版本。它采用了NDB Cluster 存储引擎，允许在1个 Cluster 中运行多个MySQL服务器。MySQL NDB Cluster是一种技术，该技术允许在无共享的系统中部署“内存中”数据库的 Cluster 。通过无共享体系结构，系统能够使用廉价的硬件，而且对软硬件无特殊要求。此外，由于每个组件有自己的内存...
mysql引擎innodb与ndb比较_mysql存储引擎memory，ndb，innodb之选择
weixin_30616309的博客
02-02 343
mysql的innodb和cluster的NDB引擎都支持事务，在有共同的特性外，也有不同之处：以mysql cluster NDB 7.3和MySQL 5.6之InnoDB为例：ndb7.3基于mysql5.6，包括支持innodb1.1，因此可以在cluster里使用innodb表，但这些表不是集群的。MySQL Cluster NDB存储引擎用分布式, shared-nothing的架构实现...
mysql自带的性能测试工具mysqlslap执行压力测试
liaomingwu的专栏
06-24 809
mysql自带的性能测试工具mysqlslap执行压力测试
MySQL架构之存储引擎的配置以及使用mysqlslap工具进行压力测试详解
BLXH-AS
02-13 841
简介：MySQL Server 系统架构逻辑模块组成:MySQL逻辑结构可以看成是二层架构，第一层我们通常叫做SQL Layer，在MySQL 数据库系统处理底层数据之前的所有工作都是在这一层完成的，包括权限判断，sql解析，执行计划优化，query cache 的处理等等；第二层就是存储引擎层，我们通常叫做StorageEngine Layer，也就是底层数据存取操作实现部分，由多种存储引擎共同...
NDB和InnoDB存储引擎比较
Expec-乐的博客
05-10 3371
文章目录说明NDB和InnoDB的不同点NDB和InnoDB的性能、负载比较NDB和InnoDB特性总结 说明 首先MySQL提供了众多的存储引擎供用户使用，但是支持事务的存储引擎并不多：NDB和InnoDB两个。但是NDB只支持在NDB集群中使用，并不支持在其他场景下使用。下面我们主要讨论它们之间不同的地方，各自的优缺点方便用户根据自己的实际情况进行选项。 注：在NDB集群中，只支持NDB存储...
详解Mysql5.7自带的压力测试命令mysqlslap及使用语法
09-09
MySQL 5.7 自带的 `mysqlslap` 是一个非常实用的工具，用于模拟客户端负载，对数据库进行压力测试，以评估其性能和稳定性。通过模拟多用户并发访问，`mysqlslap` 可以帮助管理员了解在特定负载下数据库的表现，从而...
Mysqlslap MySQL压力测试工具 简单教程
09-11
MySQLslap是一个集成在MySQL服务器中的内置工具，用于进行数据库的压力测试。自5.1.4版本起，MySQL提供此工具来帮助用户评估数据库在高并发情况下的性能表现。Mysqlslap通过模拟多个并发客户端对MySQL服务器进行访问...
[Mysql] 关于 Innodb 和 NDB 的一些事
chenqunan3231的博客
03-09 164
作为一个准 PHPer，今天必须要写的第一句话一定是： “Happy birthday to PHP ” ~ 第十五个年头了，PHP 发展至今仍然能占据最流行语言 TOP4 的位置，确实令不少人惊异不已，但是这就是 PHP 独特的魅力，真心希望他能更好的发展下去，期待 PHP6 给我们带来惊...
高级DBA带你从0到1搭建Mysql NDB Cluster 分布式集群搭建实战全网最详细
最新发布
nasen512的博客
03-28 3051
NDB集群是一种在无共享系统中实现内存数据库集群的技术。无共享体系结构使系统能够使用非常便宜的硬件，并且对硬件或软件的特定要求最低。NDB集群设计为没有任何单点故障。在无共享系统中，每个组件都应该有自己的内存和磁盘，不建议或不支持使用共享存储机制，如网络共享、网络文件系统和SAN。NDB Cluster将MySQL服务器与NDB的内存集群存储引擎集成在一起。NDB集群由一组主机组成，每个主机运行一个或多个进程。
mysql ndb 测试_MySQL Cluster搭建与测试
weixin_33800074的博客
02-17 267
MySQL Cluster是一个基于NDB Cluster存储引擎的完整的分布式数据库系统。不仅仅具有高可用性，而且可以自动切分数据，冗余数据等高级功能。和Oracle Real Cluster Application不太一样的是，MySQL Cluster 是一个Share Nothing的架构，各个MySQL Server之间并不共享任何数据，高度可扩展以及高度可用方面的突出表现是其最大的特色...
一文读懂MySQL集群4类节点的概念
Javanewspaper的博客
01-04 1698
在数据通信中，一个物理网络节点可以是数据电路端接设备（DCE），如调制解调器、集线器、桥接器或交换机；也可以是一个数据终端设备（DTE），如数字手机，打印机或主机（例如路由器、工作站或服务器）。 MySQL集群由 4 类节点组成：SQL节点、数据节点、管理节点以及客户机节点。 下面我们一起来看看MySQL集群4类节点的概念。 1、客户机节点 为了实现 MySQL 集群中数据的增、删、改、查，需要通过 MySQL 客户机编辑、提交 SQL 语句（这里将 MySQL 客户机简称为客户机节点）。MyS
CenterOS的Hive环境的搭建日志及可能出现的问题和解决方法
共勉
10-01 1059
前提：安装好hadoop集群和zookeeper。 安装步骤 一、Hive文件上传 1.上传安装包进行解压。使用tar命令进行解压，tar -zxvf apache-hive-2.0.0-bin.tar.gz -C /usr/local/src/ 2.切换到解压的目录下：cd /usr/local/src 3.移动文件 ：mv /usr/local/src/apache-hive-2.0.0-bin /usr/local/src/hive 4.给文件加权限：chown -R hadoop:hadoop hi
MySQL基准测试工具1 mysqlslap
wade1010的专栏
12-02 200
msyql
MySQL Cluster初步测试结果汇总图示报告 用mysqlslap与sysbench进行测试
记事本
09-26 787
Cluster结构图                                                 测试环境简介 Mysql cluster集群测试环境 4 data node，32G 8核cpu 4 sql node， 16G 8核cpu 1 manage node，16G 8核cpu Cluster版本：          mysql-5.5.25...
mysql blgg_压力测试工具之mysqlslap
weixin_31714129的博客
01-27 410
mysqlslap是一个mysql官方提供的压力测试工具。以下是比较重要的参数：–defaults-file，配置文件存放位置–concurrency，并发数–engines，引擎–iterations，迭代的实验次数–socket，socket文件位置- only-print，只打印测试语句而不实际执行自动测试：–auto-generate-sql，自动产生测试SQL–auto-generate...
MySQL cluster多个管理节点和多个sql节点的配置和相关命令
atec2000的专栏
09-23 7627
config.ini [ndbd default] NoOfReplicas=2 DataMemory=80M IndexMemory=18M [ndb_mgmd] nodeid=1 hostname=192.168.1.207 datadir=/var/lib/mysql-cluster [ndb_mgmd] nodeid=2 hostname=192.168.
mysql query insert,mysql_query（INSERT ...）函数在我的代码中不工作
weixin_33309848的博客
01-27 201
I've create database, which basically accept name and Id and answer string oflength 47,and my php code will grade the incoming results against the answer key I provided and number containing the count...
MySQL压力测试：利用mysqlslap进行性能基准测试
mysqlslap是MySQL官方提供的一个基准测试工具，用于模拟多客户端并发查询和更新操作，帮助评估数据库在高负载下的表现。通过调整参数，如并发连接数、迭代次数、表结构和查询类型，可以进行各种定制化的压力测试。...
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值