批量执行shell命令

   虽然目前都实现了自动化如puppet saltstack在环境中的应用,但工作中不可避免的要自己写一些简单的批量执行shell命令的脚本。

python paramiko模块是目前使用得较为顺手的模块，执行命令时基本无需要转换，直接将shell命令扔进去执行就OK

简单示例，10个线程同时执行ssh或scp动作,未设置timeout时间，如执行长时间无反应会导致脚本执行问题：

#!/usr/bin/python

# _*_ coding: utf-8 _*_

import paramiko

import sys

import logging

from multiprocessing.dummy import Pool as ThreadPool

import re

import os

try:

    fun_name = sys.argv[1]

    file = open(sys.argv[2])

except Exception,e:

    print """use like:

    #copy dir or file

    shell_exec_map.py scp ip_file source_file des_file

    #do cmd in host

    exec_map.py ssh ip_file 'yum install -y zabbix'

    """

    exit()

logging.basicConfig(level=logging.DEBUG ,

                format='%(asctime)s %(filename)s[line:%(lineno)d] %(levelname)s %(message)s',

                datefmt='%a, %d %b %Y %H:%M:%S',

                filename='exec_map.log',

                filemode='a+')

#ssh key文件位置

privatekeyfile  = os.path.expanduser('/root/.ssh/id_rsa')

mykey = paramiko.RSAKey.from_private_key_file(privatekeyfile)

#############################

#对ssh key设置密码方式

#privatekeyfile  = os.path.expanduser('/root/.ssh/id_rsa')

#mykey = paramiko.RSAKey.from_private_key_file(privatekeyfile,password='password')

#############################

def getCmdInfo(host_ip,cmd):

    print host_ip

    try:

        c = paramiko.SSHClient()

        c.set_missing_host_key_policy(paramiko.AutoAddPolicy())

##################

#密码登录方式

        #c.connect(host_ip,22,'root',password)

##################

        c.connect(host_ip,22,'root',pkey=mykey)

        stdin,stdout,stderr = c.exec_command(cmd)

        info = stdout.read()

        c.close()

        return info

    except Exception as e:

            logging.error( 'getCmdInfo ip %s  %s error: %s' % (host_ip,cmd,e))

def postFileToRemote(host_ip,localpath,remotepath):

    print host_ip

    try:

        t = paramiko.Transport((host_ip,22))

        ##################

#密码登录方式

        #t.connect(username='root',password='')

##################

        t.connect(username='root',pkey=mykey)

        sftp = paramiko.SFTPClient.from_transport(t)

        sftp.put(localpath,remotepath)

        sftp.close()

        t.close()

    except Exception,e:

        logging.error( 'scp_cmd ip %s soure:%s des: %s error: %s' % (host_ip,localpath,remotepath,e))

#10个并发同时进行

pool = ThreadPool(10)

line_list = []

for line in file.readlines():

  line_list.append(line.strip())

  

if fun_name == 'scp':

    try:

        pool.map(scpFile,line_list)

        logging.debug('scpFile ip file %s source %s dec %s' % (sys.argv[2],sys.argv[3],sys.argv[4]))

    except Exception as e:

            logging.error( 'scpFile map error: %s ' % e)

elif fun_name == 'ssh':

    try:

        if pattern_cmd.findall(sys.argv[3]):

            print "can't use rm command!"

            logging.debug('sshCmd ip file %s cmd %s' % (sys.argv[2],sys.argv[3]))

        else:

            pool.map(sshCmd,line_list)

            logging.debug('sshCmd ip file %s cmd %s' % (sys.argv[2],sys.argv[3]))

    except Exception as e:

            logging.error( 'sshCmd map error: %s ' % e)

pool.close()

pool.join()

ansible基于paramiko模块做的批量执行脚本，远端执行

1、安装ansible软件，配置了epel源，或者线上下载ansible-1.7.2

2、配置节点，IP(主机名需要主机能正常解析)

vi /etc/ansible/hosts

[other]
zabbix-127023.xxx.com
haproxy-127021.xxx .com
controller-127022.xxx .com
haproxy-127021.xxx.com

3、执行Ping命令测试（带上环境变量. ~/.bash_profile）

ansible -m shell -a '. ~/.bash_profile &&ping -c 2 10.197.128.1' other

controller-129022.xxx.com | success | rc=0 >>
PING 10.197.128.1 (10.198.127.1) 56(84) bytes of data.
64 bytes from 10.198.127.1: icmp_seq=1 ttl=254 time=0.466 ms
64 bytes from 10.198.127.1: icmp_seq=2 ttl=254 time=0.409 ms

--- 10.198.127.1 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1000ms
rtt min/avg/max/mdev = 0.409/0.437/0.466/0.035 ms

pinsh-127024.xxx.com | FAILED => SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue

ansible方法有个不方便的地方第一次执行时，需要手动确认下。python脚本不需要手动确认