Linux系统sersync数据文件实时同步

一、sersync介绍

sersync其实是利用inotify和rsync两种软件技术来实现数据实时同步功能的，inotify是用于监听sersync所在服务器上的文件变化，结合rsync软件来进行数据同步，将数据实时同步给客户端服务器。

二、sersync工作过程

在同步主服务器上开启sersync，负责监听文件系统的变化，然后调用rsync命令把更新的文件同步到目标服务器上，主服务器上安装sersync软件，目标服务器上安装rsync服务。

三、客户端安装配置rsync服务

[root@nbh_guanwang_nginx ~]# cat /etc/rsyncd.conf
cat: /etc/rsyncd.conf: No such file or directory

如果有此文件，配置前要进行备份，再进行相关配置

[root@nbh_guanwang_nginx ~]# cat /etc/rsyncd.conf
##rsync config  start

##created by root 2016-08-08 15:00
##rsync.conf config start
uid = root
gid = root
use chroot = no
max connetctions = 200
timeout = 100
pid file = /var/run/rsyncd.pid
lock file = /var/run/rsync.lock
log file = /var/log/rsyncd.log
[backup]
path = /data/cms/upload/
ignore errors
read only = false
list = false
hosts allow = 10.0.20.203/24
hosts deny = 0.0.0.0/32
auth users = rsync_backup
secrets file = /etc/rsync.password
##rsync config  end 
"rsyncd.conf" [New] 21L, 458C written

添加用户

[root@nbh_guanwang_nginx ~]# useradd rsync -s /sbin/nologin -M

改变目录权限

[root@nbh_guanwang_nginx ~]# chown -R rsync.rsync /data/cms/upload/

配置密码文件

[root@nbh_guanwang_nginx ~]# echo "rsync_backup:rsync.conf">>/etc/rsync.password
[root@nbh_guanwang_nginx ~]# cat /etc/rsync.password    
rsync_backup:rsync.conf

改变密码文件权限

[root@nbh_guanwang_nginx ~]# chmod 600 /etc/rsync.password 
[root@nbh_guanwang_nginx ~]# ls -ld /etc/rsync.password 
-rw-------. 1 root root 24 Sep  9 13:06 /etc/rsync.password

格式化文件

[root@nbh_guanwang_nginx ~]# dos2unix /etc/rsyncd.conf 
dos2unix: converting file /etc/rsyncd.conf to UNIX format ...

开启服务后台运行

[root@nbh_guanwang_nginx ~]# rsync --daemon
[root@nbh_guanwang_nginx ~]# netstat -lntup|grep rsync
tcp 0 0 0.0.0.0:873 0.0.0.0:*  LISTEN   2002/rsync
tcp 0 0 :::873 :::*       LISTEN   2002/rsync 

四、主服务器上配置密码文件

[root@nbh_guanwang_a ~]# echo "rsync.conf">>/etc/rsync.password
[root@nbh_guanwang_a ~]# cat /etc/rsync.password
rsync.conf
[root@nbh_guanwang_a ~]#  chmod 600 /etc/rsync.password
[root@nbh_guanwang_a ~]#  ls -ld /etc/rsync.password
-rw-------. 1 root root 11 Sep  8 06:25 /etc/rsync.password

五、测试手工同步

[root@nbh_guanwang_a ~]# rsync -avzP /etc/hosts rsync_backup@10.0.20.2::backup--password-file=/etc/rsync.password
sending incremental file list
hosts
158 100%    0.00kB/s    0:00:00 (xfer#1, to-check=0/1)
sent 120 bytes  received 27 bytes  26.73 bytes/sec

total size is 158  speedup is 1.07
[root@nbh_guanwang_a ~]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
[root@nbh_guanwang_a ~]# cat /backup/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

经过对比两边数据一致，表明同步成功，手工同步成功之后，然后再进行后面的配置

六：安装sersync服务

首先下载好安装软件

sersync2.5.4_64bit_binary_stable_final.tar.gz

[root@nbh_guanwang_a software]## tar -zxvf sersync2.5.4_64bit_binary_stable_final.tar.gz -C
/usr/local/
GNU-Linux-x86/
GNU-Linux-x86/sersync2
GNU-Linux-x86/confxml.xml
[root@nbh_guanwang_a software]## cd /usr/local/
[root@nbh_guanwang_a local]# ls
bin  games   include  lib64    sbin   src
etc  GNU-Linux-x86  lib   libexec  share

GNU-Linux-x86就是sersync安装软件，为了方便将它改名

[root@nbh_guanwang_a local]# mv GNU-Linux-x86 sersync

为了后续方便管理，创建几个目录用于存放各类文件

[root@nbh_guanwang_a sersync]# mkdir -p conf bin logs
[root@nbh_guanwang_a sersync]# mv confxml.xml conf
[root@nbh_guanwang_a sersync]# ls
bin  conf  logs  sersync2
[root@nbh_guanwang_a sersync]# cd conf
[root@nbh_guanwang_a conf]## ls
confxml.xml

在配置配置文件之前备份

[root@nbh_guanwang_a conf]# cp confxml.xml confxml.xml.$(date +%F)
[root@nbh_guanwang_a conf]# ls
confxml.xml  confxml.xml.2024-06-22

修改配置文件内容（confxml.xml）

1、修改24-28行

<localpath watch="/opt/tongbu">
      <remote ip="127.0.0.1" name="tongbu1"/>
        <!--<remote ip="192.168.8.39" name="tongbu"/>-->注释内容
        <!--<remote ip="192.168.8.40" name="tongbu"/>-->注释内容
</localpath>

修改后的内容为

<localpath watch="/data/cms/upload">
	<remote ip="10.0.20.2" name="backup"/>
</localpath>

2、修改31-34行内容——认证

<commonParams params="-artuz"/>
<auth start="false" users="root" passwordfile="/etc/rsync.pas"/>
<userDefinedPort start="false" port="874"/><!-- port=874 -->
<timeout start="false" time="100"/><!-- timeout=100 -->
<ssh start="false"/>

修改后的内容为

<commonParams params="-aruz"/>
<auth start="true" users="rsync_backup" passwordfile="/etc/rsync.password"/>
<userDefinedPort start="false" port="874"/><!-- port=874 -->
<timeout start="true" time="100"/><!-- timeout=100 -->
<ssh start="false"/>

3、修改36-37行

<failLog path="/tmp/rsync_fail_log.sh" timeToExecute="60"/><!--default
 every 60mins execute once-->

修改成我们刚刚创建好的logs目录

<failLog path="/usr/local/sersync/logs/rsync_fail_log.sh" timeToExecute="60"/><!--default eve
ry 60mins execute once-->

修改完成后最终的配置文件如下

[root@nbh_guanwang_a conf]# cat confxml.xml
<?xml version="1.0" encoding="ISO-8859-1"?>
<head version="2.5">
    <host hostip="localhost" port="8008"></host>
    <debug start="false"/>
    <fileSystem xfs="false"/>
    <common>
      <user>root</user>
      <group>root</group>
    </common>
    <filter start="false">
   <exclude expression="(.*)\.svn"></exclude>
   <exclude expression="(.*)\.gz"></exclude>
   <exclude expression="^info/*"></exclude>
   <exclude expression="^static/*"></exclude>
    </filter>
    <inotify>
   <delete start="true"/>
   <createFolder start="true"/>
   <createFile start="false"/>
   <closeWrite start="true"/>
   <moveFrom start="true"/>
   <moveTo start="true"/>
   <attrib start="false"/>
   <modify start="false"/>
    </inotify>

    <sersync>
   <localpath watch="/data/cms/upload">
       <remote ip="10.0.20.2" name="backup"/>
   </localpath>
   <rsync>
       <commonParams params="-aruz"/>
       <auth start="true" users="rsync_backup" passwordfile="/etc/rsync.password"/>
       <userDefinedPort start="false" port="874"/><!-- port=874 -->
       <timeout start="true" time="100"/><!-- timeout=100 -->
       <ssh start="false"/>
   </rsync>
   <failLog path="/usr/local/sersync/logs/rsync_fail_log.sh" timeToExecute="60"/><!--default every 60
mins execute once-->
   <crontab start="false" schedule="600"><!--600mins-->
       <crontabfilter start="false">
      <exclude expression="*.php"></exclude>
      <exclude expression="info/*"></exclude>
       </crontabfilter>
   </crontab>
   <plugin start="false" name="command"/>
    </sersync>

    <plugin name="command">
   <param prefix="/bin/sh" suffix="" ignoreError="true"/>   <!--prefix /opt/tongbu/mmm.sh suffix-->
   <filter start="false">
       <include expression="(.*)\.php"/>
       <include expression="(.*)\.sh"/>
   </filter>
    </plugin>

    <plugin name="socket">
   <localpath watch="/opt/tongbu">
       <deshost ip="192.168.138.20" port="8009"/>
   </localpath>
    </plugin>
    <plugin name="refreshCDN">
   <localpath watch="/data0/htdocs/cms.xoyo.com/site/">
       <cdninfo domainname="ccms.chinacache.com" port="80" username="xxxx" passwd="xxxx"/>
       <sendurl base="http://pic.xoyo.com/cms"/>
       <regexurl regex="false" match="cms.xoyo.com/site([/a-zA-Z0-9]*).xoyo.com/images"/>
   </localpath>
    </plugin>
</head>

七、开启sersync守护进程

首先配置全局环境变量，使得后同可以直接调用sersync命令

[root@nbh_guanwang_a conf]#  echo 'export PATH=$PATH:/usr/local/sersync/bin'>>/etc/profile
[root@nbh_guanwang_a conf]#  tail -1 /etc/profile
export PATH=$PATH:/usr/local/sersync/bin
[root@nbh_guanwang_a conf]#  source /etc/profile
[root@nbh_guanwang_a conf]#  which sersync
/usr/local/sersync/bin/sersync

启动sersync服务

serync -r -d -o /usr/local/sersync/conf/confxml.xml

-r初始化数据
-d后台启动
-o指定路径
如果需要将命令开启动，只需将命令去掉参数-r定入/etc/rc.local
启动后结果如下

[root@nbh_guanwang_a backup]# sersync -r -d -o /usr/local/sersync/conf/confxml.xml 
set the system param
execute:echo 50000000 > /proc/sys/fs/inotify/max_user_watches
execute:echo 327679 > /proc/sys/fs/inotify/max_queued_events
parse the command param
option: -r rsync all the local files to the remote servers before the sersync work
option: -d    run as a daemon
option: -o    config xml name:  /usr/local/sersync/conf/confxml.xml
daemon thread num: 10
parse xml config file
host ip : localhost     host port: 8008
daemon start,sersync run behind the console 
use rsync password-file :
user is rsync_backup
passwordfile is         /etc/rsync.password
config xml parse success
please set /etc/rsyncd.conf max connections=0 Manually
sersync working thread 12  = 1(primary thread) + 1(fail retry thread) + 10(daemon sub threads) 
Max threads numbers is: 22 = 12(Thread pool nums) + 10(Sub threads)
please according your cpu ,use -n param to adjust the cpu rate
------------------------------------------
rsync the directory recursivly to the remote servers once
working please wait...
execute command: cd /opt/backup && rsync -aruz -R --delete ./  --timeout=100 rsync_backup@192.168.1.3::rsync --password-file=/etc/rsync.password >/dev/null 2>&1 
run the sersync: 
watch path is: /opt/backup

八：测试数据同步

[root@nbh_guanwang_a sersync]# cd /opt/backup/
[root@nbh_guanwang_a backup]# ls
[root@nbh_guanwang_a backup]# ls -ll
total 0
[root@nbh_guanwang_a backup]# touch 123
[root@nbh_guanwang_a backup]# touch 1234
[root@nbh_guanwang_a backup]# touch 1235
[root@nbh_guanwang_a backup]# touch 12333
[root@nbh_guanwang_a backup]# ls -ll
total 0
-rw-r--r--. 1 root root 0 Sep  8 09:26 123
-rw-r--r--. 1 root root 0 Sep  8 09:26 12333
-rw-r--r--. 1 root root 0 Sep  8 09:26 1234
-rw-r--r--. 1 root root 0 Sep  8 09:26 1235

目标服务器查看同步情况

[root@nbh_guanwang_nginx backup]# ls -ll
total 0
-rw-r--r--. 1 rsync rsync 0 Sep  8 04:26 123
-rw-r--r--. 1 rsync rsync 0 Sep  8 04:26 12333
-rw-r--r--. 1 rsync rsync 0 Sep  8 04:26 1234
-rw-r--r--. 1 rsync rsync 0 Sep  8 04:26 1235

测试结果表明数据同步正常，能够实时同步