1. rsync
1.1 认识
Rsync(remote synchronize)是一个远程数据同步工具,可通过LAN/WAN快速同步多台主机间的文件。Rsync使用所谓的“Rsync算法”来使本地和远 程两个主机之间的文件达到同步,这个算法只传送两个文件的不同部分,而不是每次都整份传送,因此速度相当快
1.2 原理
Rsync本来是用于替代rcp的一个工具,目前由rsync.samba.org维护,所以rsync.conf文件的格式类似于samba的主配 置文件;Rsync可以通过rsh或ssh使用,也能以daemon模式去运行
在以daemon方式运行时Rsync server会打开一个873 端口,等待客户端去连接。连接时,Rsync server会检查口令是否相符,若通过口令查核,则可以开始进行文件传输。第一次连通完成时,会把整份文件传输一次,以后则就只需进行增量备份
1.3 特点
1、可以镜像保存整个目录树和文件系统;
2、可以很容易做到保持原来文件的权限、时间、软硬链接等;
3、无须特殊权限即可安装;
4、优化的流程,文件传输效率高;
5、可以使用rsh、ssh等方式来传输文件,当然也可以通过直接的socket连接;
6、支持匿名传输
1.4 两种工作模式 推和拉
rsync -avz /home/work ip:/home #推
rsync -avz ip:/home/work /home #拉
1.5 总结
以守护进程(socket)的方式传输数据(这个是rsync自身的重要的功能)
1.5.1 rsync 命令常用参数选项说明
-v, --verbose 详细模式输出,传输时的进度等信息
-z, --compress 传输时进行压缩以提高传输效率,--compress-level=NUM可按级别压缩 。
-a, --archive 归档模式,表示以递归方式传输文件,并保持所有文件属性,等于-rtopgDl(字母l)
!!!###注意:复制文件到 /tmp目录的时候, 会把/tmp目录的权限改了
rsync -avz /etc/hosts 172.16.1.31:/tmp
vzrtopg
=======================================================================
-a
-r, --recursive 对子目录以递归模式,即目录下的所有目录都同样传输,注意是小写r
-t, --times 保持文件时间信息
-o, --owner 保持文件属主信息
-p, --perms 保持文件权限
-g, --group 保持文件属组信息
-D, --devices 保持设备文件信息
-l, --links 保留软链
-P --progress 显示同步的过程及传输时的进度等信息
-e, --rsh=COMMAND 使用的信道协议(remote shell),指定替代rsh的shell程序。例如:ssh
--exclude=PATTERN 指定排除不需要传输的文件模式(和tar参数一样)
--exclude-from=file(文件名所在的目录文件) (和tar参数一样)
--bwlimit=RATE limit socket I/O bandwidth 传输的时候限速
2. 服务端
2.1检查安装包
[root@backup ~]# rpm -qa rsync
rsync-3.0.6-12.el6.x86_64 ##检查软件是否安装
[root@backup ~]# rpm -qa |grep rsync
rsync-3.0.6-12.el6.x86_64 ##查看软件包里面有什么内容
[root@backup ~]# rpm -ql rsync
/etc/xinetd.d/rsync
/usr/bin/rsync
...
[root@backup ~]# rpm -qf ssh
error: file /root/ssh: No such file or directory
[root@backup ~]# rpm -qf `which ssh`
openssh-clients-5.3p1-122.el6.x86_64
2.2 配置文件
rsync daemon -- rsync守护进程(服务)的配置文件
cat /etc/rsyncd.conf
######rsync_config_______________start
#created by oldboy 15:01 2007-6-5
#QQ 31333741 blog:http://oldboy.blog.51cto.com
##rsyncd.conf start##
uid = rsync
gid = rsync
use chroot = no
max connections = 200
timeout = 300
pid file = /var/run/rsyncd.pid
lock file = /var/run/rsync.lock
log file = /var/log/rsyncd.log
[backup]
path = /backup/
ignore errors
read only = false
list = false
hosts allow = 172.16.1.0/24
#hosts deny = 0.0.0.0/32
auth users = rsync_backup
secrets file = /etc/rsync.password
#rsync_config_______________end
2.3 添加用户和目录
[root@backup ~]# useradd -s /sbin/nologin -M rsync
[root@backup ~]# mkdir /backup
2.4 创建密码文件并修改权限
[root@backup ~]# echo 'rsync_backup:123456' >/etc/rsync.password
[root@backup ~]# chmod 600 /etc/rsync.password
2.5 启动rsync服务
[root@backup ~]# rsync --daemon
2.6 检查
[root@backup ~]# ss -lntup |grep rsync
tcp LISTEN 0 5 :::873 :::* users:(("rsync",1821,5))
tcp LISTEN 0 5 *:873 *:* users:(("rsync",1821,4))
[root@backup ~]# ps -ef |grep rsync
root 1821 1 0 18:34 ? 00:00:00 rsync --daemon
root 1829 1751 0 18:35 pts/2 00:00:00 grep --color=auto rsync
2.7 重启rsync
killall rsync
rsync --daemon
3. 客户端
3.1 测试
rsync -avz /etc/hosts rsync_backup@172.16.1.41::backup
3.2 创建密码文件
echo '123456' >/etc/rsync.password
chmod 600 /etc/rsync.password
3.3 使用密码文件测试
rsync -avz /etc/sysconfig rsync_backup@172.16.1.41::backup --password-file=/etc/rsync.password
4.总结
4.1 rsync多个模块配置文件
[root@backup backup]# cat /etc/rsyncd.conf
######rsync_config_______________start
##rsyncd.conf start##
uid = rsync
gid = rsync
use chroot = no
max connections = 200
timeout = 300
pid file = /var/run/rsyncd.pid
lock file = /var/run/rsync.lock
log file = /var/log/rsyncd.log
ignore errors
read only = false
list = false
hosts allow = 172.16.1.0/24
#hosts deny = 0.0.0.0/32
auth users = rsync_backup
secrets file = /etc/rsync.password
[backup]
path = /backup/
[nfsbackup]
path = /nfsbackup/
#rsync_config_______________end
++++++++++++++++++++++++++++++++++++++++
mkdir -p /backup /nfsbackup
chown rsync.rsync /backup /nfsbackup
4.2 技巧
[root@nfs01 ~]# rsync -avz /etc/hosts rsync_backup@172.16.1.41::backup/oldboy/ --password-file=/etc/rsync.password
5.报错
5.1连接超时 连不上
[root@backup ~]# scp /etc/hosts 172.16.1.31:/tmp/
ssh: connect to host 172.16.1.31 port 22: Connection timed out
lost connection
[root@backup ~]#
无法通过172.16.1.31 这个ip地址连接到nfs01 (linux)
1.ping 172.16.1.31
2.telnet 172.16.1.31 (yum install -y telnet)
5.2 配置文件错误
[root@backup ~]# scp /etc/hosts 172.16.1.31:/tmp/
/etc/ssh/ssh_config: line 2: Bad configuration option: PermitRootLogin
/etc/ssh/ssh_config: line 3: Bad configuration option: PermitEmptyPasswords
/etc/ssh/ssh_config: terminating, 2 bad configuration options
lost connection
这个/etc/ssh/ssh_config 配置文件 的第2 行 第3行 有错误
PermitRootLogin yes
PermitEmptyPasswords no
5.3 权限
[root@nfs01 ~]# rsync -avz /etc/hosts rsync_backup@172.16.1.41::backup
Password:
sending incremental file list
hosts
rsync: mkstemp ".hosts.hxsIpZ" (in backup) failed: Permission denied (13)
sent 170 bytes received 27 bytes 20.74 bytes/sec
total size is 262 speedup is 1.33
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1039) [sender=3.0.6]
[root@nfs01 ~]# #rsync提示: 我在backup模块(/backup)目录下面创建文件,失败了,权限不足
[root@nfs01 ~]#
[root@nfs01 ~]# #rsync服务端运行的时候是以rsync用户的身份运行
[root@backup ~]# #rsync服务端运行的时候是以rsync用户的身份运行
[root@backup ~]# #rsync用户与/backup目录之间的关系
[root@backup ~]# ls -ld /backup/
drwxr-xr-x 2 root root 4096 Jun 15 18:25 /backup/
[root@backup ~]# #rsync用户对/backup 拥有的权限是r-x
[root@backup ~]# #我想通过rsync用户 想 /backup 目录中
[root@backup ~]# chown rsync.rsync /backup/
5.4 no route to host
[root@nfc01 ~]# rsync -avz /etc/hosts rsync_backup@172.16.1.41::backup
rsync: failed to connect to 172.16.1.41: No route to host (113)
rsync error: error in socket IO (code 10) at clientserver.c(124) [sender=3.0.6]
[root@nfc01 ~]# #no route to host
[root@nfc01 ~]# rsync -avz /etc/hosts rsync_backup@172.16.1.41::backup
Password:
sending incremental file list
hosts
sent 169 bytes received 27 bytes 35.64 bytes/sec
total size is 250 speedup is 1.28
[root@backup ~]# /etc/init.d/iptables stop
iptables: Setting chains to policy ACCEPT: filter [ OK ]
iptables: Flushing firewall rules: [ OK ]
iptables: Unloading modules: [ OK ]
[root@backup ~]# /etc/init.d/iptables stop
5.5 配置文件故障
[root@nfs01 ~]# rsync -avz /etc/hosts rsync_backup@172.16.1.41::backup
sending incremental file list
ERROR: module is read only
rsync error: syntax or usage error (code 1) at main.c(866) [receiver=3.0.6]
rsync: read error: Connection reset by peer (104)
rsync error: error in rsync protocol data stream (code 12) at io.c(759) [sender=3.0.6]
[root@nfs01 ~]# ##backup模块 只读
[root@nfs01 ~]# rsync -avz /etc/hosts rsync_backup@172.16.1.41::backup
Password:
sending incremental file list
hosts
sent 196 bytes received 27 bytes 49.56 bytes/sec
total size is 349 speedup is 1.57
配置文件 故障
5.6 无法链接机器
#1.ping
[root@nfs01 ~]# ping 172.16.1.41
PING 172.16.1.41 (172.16.1.41) 56(84) bytes of data.
64 bytes from 172.16.1.41: icmp_seq=1 ttl=64 time=0.211 ms
64 bytes from 172.16.1.41: icmp_seq=2 ttl=64 time=0.469 ms
64 bytes from 172.16.1.41: icmp_seq=3 ttl=64 time=0.213 ms
^C
--- 172.16.1.41 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2793ms
rtt min/avg/max/mdev = 0.211/0.297/0.469/0.122 ms
#2.telnet
[root@nfs01 ~]# telnet 172.16.1.41 873
Trying 172.16.1.41...
telnet: connect to address 172.16.1.41: Connection refused
5.7 Not a directory
[root@nfs01 ~]# rsync -avz /etc/hosts rsync_backup@172.16.1.41::nfsbackup/oldboy/
Password:
sending incremental file list
rsync: ERROR: cannot stat destination "oldboy/" (in nfsbackup): Not a directory (20)
rsync error: errors selecting input/output files, dirs (code 3) at main.c(554) [receiver=3.0.6]
rsync: connection unexpectedly closed (5 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6]
6.rsync 管理脚本
https://blog.csdn.net/wanchaopeng/article/details/98614572