2000张表的备份xtrabackup 使用python调用报错,手工可以执行

2000张表的备份,直接shell中可以执行成功,但使用python调用相同的指令报  'Too many open files'

# ulimit -n
65536

[root@my3306.sock][(none)]> show variables like '%open%';
+----------------------------+-------+
| Variable_name              | Value |
+----------------------------+-------+
| have_openssl               | YES   |
| innodb_open_files          | 8096  |
| open_files_limit           | 65536 |
| table_open_cache           | 8096  |
| table_open_cache_instances | 16    |
+----------------------------+-------+
5 rows in set (0.00 sec)

[root@my3306.sock][(none)]> select count(*) from information_schema.tables;
+----------+
| count(*) |
+----------+
|     3328 |
+----------+
1 row in set (0.02 sec)
 

命令:

/bin/sh -c /opt/agent/tools/xtrabackup/bin/xtrabackup --port=3306 --host=127.0.0.1 --user=root --password=xxx --no-server-version-check --compress --compress-threads=4 --read-buffer-size=128M --backup --stream=xbstream --extra-lsndir=/data/backup/3306/xtrabackup/last_backup --target-dir=/data/backup/3306/xtrabackup/full_backup | /usr/bin/s3cmd --host=http://ss3-cn-shanghai-dev.voneyun.com --no-ssl --host-bucket=%\(bucket\).ss3-cn-shanghai-dev.xx.com --access_key=xxx --secret_key=xxx put - s3://rds-sbx-backup/1554367298511441920/xtrabackup/test_backup_053

错误信息:

2022-08-03T19:04:34.397071+08:00 2 [Note] [MY-011825] [Xtrabackup] Compressing and streaming ./test_db_001/test_table_466.ibd
2022-08-03T19:04:34.397824+08:00 2 [Note] [MY-011825] [Xtrabackup] Done: Compressing and streaming ./test_db_001/test_table_466.ibd
2022-08-03T19:04:34.398012+08:00 2 [ERROR] [MY-012592] [InnoDB] Operating system error number 24 in a file operation.
2022-08-03T19:04:34.398056+08:00 2 [ERROR] [MY-012596] [InnoDB] Error number 24 means 'Too many open files'
2022-08-03T19:04:34.398076+08:00 2 [Note] [MY-012597] [InnoDB] Refer to your operating system documentation for operating system error code information.
2022-08-03T19:04:34.398095+08:00 2 [ERROR] [MY-012646] [InnoDB] File ./test_db_001/test_table_210.ibd: 'open' returned OS error 83. Cannot continue operation
2022-08-03T19:04:34.398113+08:00 2 [ERROR] [MY-012981] [InnoDB] Cannot continue operation.

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值