Hadoop集群同步文件夹失败解决方法

在安装hadoop集群的时候经常会用到集群同步，但是有时候同步一个文件夹的时候经常会出现同步不成功的情况。

问题如下：

[mayday@hadoop101 module]$ xsync kafka/
==================== hadoop102 ====================
sending incremental file list
rsync: recv_generator: mkdir "/opt/module/kafka" failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
kafka/

sent 5,538 bytes  received 171 bytes  3,806.00 bytes/sec
total size is 75,717,134  speedup is 13,262.77
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1179) [sender=3.1.2]
==================== hadoop103 ====================
sending incremental file list
rsync: recv_generator: mkdir "/opt/module/kafka" failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
kafka/

sent 5,538 bytes  received 171 bytes  11,418.00 bytes/sec
total size is 75,717,134  speedup is 13,262.77
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1179) [sender=3.1.2]

在hadoop102上查看同步的文件夹

[mayday@hadoop102 module]$ ll
总用量 0
drwxr-xr-x. 11 mayday mayday 173 3月   1 16:56 hadoop-3.1.3
drwxr-xr-x.  8     10    143 255 12月 13 2016 jdk1.8.0_121
drwxrwxr-x.  8 mayday mayday 160 3月  18 08:49 zookeeper-3.5.7

 解决方法：

在其它的节点的目录下分别创建对应的文件夹

1、创建文件夹

[mayday@hadoop102 module]$ sudo mkdir kafka

2、执行同步命令

 

[mayday@hadoop101 module]$ xsync kafka/

再次查看时，同步成功

[mayday@hadoop102 module]$ ll
总用量 0
drwxr-xr-x. 11 mayday mayday 173 3月   1 16:56 hadoop-3.1.3
drwxr-xr-x.  8     10    143 255 12月 13 2016 jdk1.8.0_121
drwxr-xr-x.  2 root   root     6 3月  18 10:59 kafka
drwxrwxr-x.  8 mayday mayday 160 3月  18 08:49 zookeeper-3.5.7