CentOS 6.3（64） ---> fastdfs_v4.07 / 实现多服务器

最新推荐文章于 2024-11-15 11:54:09 发布

weixin_34214500

最新推荐文章于 2024-11-15 11:54:09 发布

阅读量119

点赞数

文章标签：运维开发工具网络

原文链接：https://my.oschina.net/shking/blog/165326

版权

为什么80%的码农都做不了架构师？>>>

自己闲着没事，在小黑上虚拟了 4 个 centos 64 的系统，用来安装分布式 fastdfs 、 nginx 负载均衡，过程一路艰辛，搞了一个通宵都没弄好，终于在第二天的傍晚终于弄好了，记录一下过程。
有时候看书会犯糊涂，看完了都不知道将了啥，只有动手坐坐，啥玩意都明白差不多了。
有时候太懒了，哎，这是病，得治。

FastDFS安装
FastDFS是一个国产开源的轻量级分布式文件系统,它对文件进行管理,功能包括:文件存储、文件同步、文件访问(文件上传、文件下载)等，解决了大容量存储和负载均衡的问题.特别适合以文件为载体的在线服务,如相册网站、视频网站等等.FastDFS服务端有两个角色:跟踪器(tracker)和存储节点(storage).跟踪器主要做调度工作,在访问上起负载均衡的作用.
下载地址
http://sourceforge.net/projects/fastdfs/files/
http://code.google.com/p/fastdfs/

实现多服务器fastdfs

整体网络配置

Tracker  Server    192.168.55.222         /home/tracker  端口:22122
Tracker  Server    192.168.55.226         /home/tracker  端口:22122
Storage1 Server    192.168.55.223  group1 /home/storage  端口:23000
Storage4 Server    192.168.55.227  group1 /home/storage  端口:23000
Storage2 Server    192.168.55.224  group2 /home/storage  端口:23000
Storage3 Server    192.168.55.225  group2 /home/storage  端口:23000
#Storage2为group2的源服务器
注意：
1.group2同组的Storage2和Storage3 FastDFS服务端口必须一致: port=23000。
2.一台服务器可以装多个组(group)但不能装同组的多个Storage,日志会报错误，日志报错原因是"注意1"
3.Version 4.05之前fastdfs内部绑定了libevent作为http服务器.Version 4.05之后的版本删除了内置的web http服务，内置的web http服务是个累赘，不用也罢！
4.启动storage server时，一直处于僵死状态.启动storage server，storage将连接tracker server，如果连不上，将一直重试。直到连接成功，启动才算真正完成!如果集群中有2台tracker server，而其中一台tracker没有启动，可能会导致storage server一直处于僵死状态

系统操作环境的设置

#软件安装包存储:
  /usr/local/src
  /usr/local/fastdfs  fastdfs安装目录

#基本目录列表:
#创建fastdfs用户
  /usr/sbin/groupadd fastdfs
  /usr/sbin/useradd -g fastdfs fastdfs
#创建存储数据目录
  mkdir -p /home/fastdfs/tracker;#创建tracker目录保存运行日志
  mkdir -p /home/fastdfs/storage;#创建Storage目录保存运行日志及其data数据 
# source .bashrc

为方便查找目录,设置变量

################Tracker################
# vi .bashrc
  alias  worksrc='cd /usr/local/src;ls'
  alias  workfastdfs='cd /usr/local/fastdfs;ls'
  alias  worktracker='cd /home/fastdfs/tracker;ls'
#track启动 重启 停止
  alias  sertracker='service fdfs_trackerd'
配置生效
# source .bashrc

为方便查找目录,设置变量

################Storage################
# vi .bashrc
  alias  worksrc='cd /usr/local/src;ls'
  alias  workfastdfs='cd /usr/local/fastdfs;ls'
  alias  workstorage='cd /home/fastdfs/storage;ls'
  alias  workfastdfs='cd /usr/local/nginx;ls'
#storage启动 重启 停止
  alias  serstorage='service fdfs_storaged'
#nginx 启动 重启 停止
  alias  sernginx='service nginxd'
配置生效
# source .bashrc

1.安装libevent 和 fastdfs

首先安装libevent. fastdfs在编译源程序时fastdfs内部调用libevent的处理机制,,需要用到libevent一些依赖文件,否则编译fastdfs会出错

#卸载系统自带libevent,自带版本过低,安装fastdfs会出错
  rpm -qa|grep libevent
#  或者
  yum remove libevent*
#下载安装libevent
#worksrc;
  wget http://cloud.github.com/downloads/libevent/libevent/libevent-2.0.19-stable.tar.gz;
  tar -zxvf libevent-2.0.19-stable.tar.gz;
  cd libevent-2.0.19-stable;
#make clean;
  ./configure --prefix=/usr/local/libevent
  make && make install;
#为libevent创建软链接到/lib库下，64位系统对应/lib64
  ln -s /usr/local/libevent/lib/libevent-2.0.so.5 /usr/lib/libevent-2.0.so.5
  ln -s /usr/local/libevent/lib/libevent-2.0.so.5 /usr/lib64/libevent-2.0.so.5
#命令汇总:
  worksrc;wget http://cloud.github.com/downloads/libevent/libevent/libevent-2.0.19-stable.tar.gz;tar -zxvf libevent-2.0.19-stable.tar.gz;cd libevent-2.0.19-stable;make clean;./configure --prefix=/usr/local/libevent;make && make install;cd ../

安装fastdfs的步骤

worksrc;
# 自行下载 4.07  http://sourceforge.net/projects/fastdfs/files/ 
# wget http://fastdfs.googlecode.com/files/FastDFS_v4.06.tar.gz
  tar -zxvf FastDFS_v4.07.tar.gz
  cd FastDFS

#由于定义/usr/local/fastdfs为fastdfs安装目录,所以需要修改make.sh
  vim make.sh
#/etc/fdfs 全部替换为 /usr/local/fastdfs/conf
  %s/\/etc\/fdfs/\/usr\/local\/fastdfs\/conf/g

# TARGET_PREFIX=/usr/local 修改为 /usr/local/fastdfs
  sed -i 's:TARGET_PREFIX=.*:TARGET_PREFIX=/usr/local/fastdfs:g' make.sh

# TARGET_CONF_PATH=/etc/fdfs 修改为 /usr/local/fastdfs/conf
  sed -i 's:TARGET_CONF_PATH=.*:TARGET_CONF_PATH=/usr/local/fastdfs/conf:g' make.sh

#安装
  ./make.sh C_INCLUDE_PATH=/usr/local/libevent/include LIBRARY_PATH=/usr/local/libevent/lib
  ./make.sh install

修改 fastdfs 启动文件

# 修改 fdfs_trackerd 配置文件
  vim /etc/init.d/fdfs_trackerd
#替换
  %s/usr\/local/usr\/local\/fastdfs/g
  %s/etc\/fdfs/usr\/local\/fastdfs\/conf/g
#增加x权限
  chmod a+x /etc/init.d/fdfs_trackerd

# 修改 fdfs_storaged 配置文件
  vim /etc/init.d/fdfs_storaged
#替换
  %s/usr\/local/usr\/local\/fastdfs/g
  %s/etc\/fdfs/usr\/local\/fastdfs\/conf/g
#增加x权限
  chmod a+x /etc/init.d/fdfs_storaged

2.安装Tracker Server - 192.168.55.222

引用上例中安装libevent 和 fastdfs步骤

配置及启动Tracker Server,端口:22122

#修改tracker.conf配置
  vim /usr/local/fastdfs/conf/tracker.conf
# the tracker server port
  port=22122
# the base path to store data and log files
  base_path=/home/yuqing/fastdfs -> base_path=/home/fastdfs/tracker #日志目录
# sed -i 's:base_path=.*:base_path=/home/fastdfs/tracker:g' tracker.conf
  reserved_storage_space = 4GB -> reserved_storage_space = 1GB
# sed -i 's:reserved_storage_space=.*:reserved_storage_space = 1GB:g' tracker.conf
#unix group name to run this program,
#not set (empty) means run by the group of current user
  run_by_group= -> fastdfs
#unix username to run this program,
#not set (empty) means run by current user
  run_by_user= -> fastdfs
#开启自定义server ID取代ip形式,方便内部网络服务器更换ip#**此方式要重点理解，4.0以后新特性
  use_storage_id = true #使用server ID作为storage server标识
  storage_ids_filename = storage_ids.conf #<id> <group_name> <ip_or_hostname>
  id_type_in_filename = id #文件名反解析中包含server ID,以前是ip

复制storage_ids.conf文件

cp -r /usr/local/src/FastDFS/conf/storage_ids.conf /usr/local/fastdfs/conf/
#编辑storage服务器ID与IP地址的对应关系
  vim /usr/local/fastdfs/conf/storage_ids.conf
#<id> <group_name> <ip_or_hostname>
# 100001          group1           192.168.55.223

设置 Tracker Server 用户及组

chown -R fastdfs:fastdfs /home/fastdfs

增加x权限

chmod a+x /etc/init.d/fdfs_trackerd

启动 Tracker

service fdfs_trackerd start
#启动过程中出现的错误
  ./fdfs_trackerd: error while loading shared libraries: libevent-2.0.so.5: cannot open shared object file: No such file or directory
#解决办法
  ln -s /usr/lib/libevent-2.0.so.5 /usr/lib64/libevent-2.0.so.5
#查看日志
  vim /home/fastdfs/tracker/logs/trackerd.log
#启动后成功的日志
#[2013-10-03 20:50:08] INFO - FastDFS v4.07, base_path=/home/fastdfs/tracker, run_by_group=fastdfs, run_by_user=fastdfs, connect_timeout=30s, network_timeout=60s, port=22122, bind_addr=, max_connections=256, accept_threads=1, work_threads=4, store#_lookup=2, store_group=, store_server=0, store_path=0, reserved_storage_space=10.00%, download_server=0, allow_ip_count=-1, sync_log_buff_interval=10s, check_active_interval=120s, thread_stack_size=64 KB, storage_ip_changed_auto_adjust=1, storage_sy#nc_file_max_delay=86400s, storage_sync_file_max_time=300s, use_trunk_file=0, slot_min_size=256, slot_max_size=16 MB, trunk_file_size=64 MB, trunk_create_file_advance=0, trunk_create_file_time_base=02:00, trunk_create_file_interval=86400, trunk_create_file_sp#ace_threshold=20 GB, trunk_init_check_occupying=0, trunk_init_reload_from_binlog=0, use_storage_id=1, id_type_in_filename=id, storage_id_count=1, rotate_error_log=0, error_log_rotate_time=00:00, rotate_error_log_size=0, store_slave_file_use_link=0, use_con#nection_pool=0, g_connection_pool_max_idle_time=3600s

设置开机启动 Tracker

vim /etc/rc.d/rc.local
  service fdfs_trackerd start

附目录说明

#  tracker server目录及文件结构：
#  ${base_path}
#    |__data
#    |     |__storage_groups.dat：存储分组信息
#    |     |__storage_servers.dat：存储服务器列表
#    |__logs
#          |__trackerd.log：tracker server日志文件

3.安装Storage Server -192.168.55.223

引用上例中安装libevent 和 fastdfs步骤

修改storage.conf配置

vim /usr/local/fastdfs/conf/storage.conf
# the name of the group this storage server belongs to
  group_name=group1
# the name of the group this storage server belongs to
# the storage server port #the storage server port
  port=23000
# the base path to store data and log files #日志目录
  base_path=/home/yuqing/fastdfs -> /home/fastdfs/storage
# store_path#, based 0, if store_path0 not exists, it's value is base_path #data数据存储目录
# the paths must be exist
  store_path0=/home/fastdfs/storage
# tracker_server can ocur more than once, and tracker_server format is
#  "host:port", host can be hostname or ip address
  tracker_server=192.168.209.121:22122 ->192.168.55.222:22122
#unix group name to run this program,
#not set (empty) means run by the group of current user
  run_by_group= -> fastdfs   #这儿一定填写执行的用户名，不然会启动报错，测试环境填写的 root
#unix username to run this program,
#not set (empty) means run by current user
  run_by_user= -> fastdfs   #这儿一定填写执行的用户名，不然会启动报错，测试环境填写的 root

设置 Storage Server 用户及组

chown -R fastdfs:fastdfs /home/fastdfs

增加x权限

chmod a+x /etc/init.d/fdfs_storaged

启动 Storage

service fdfs_storaged start
#接下来会出现很多mkdir data path,这是系统在创建数据目录
#data path: /home/fastdfs/storage/data, mkdir sub dir...
#mkdir data path: 00 ...
#mkdir data path: 01 ...
#mkdir data path: 02 ...
#mkdir data path: 03 ...
#.......................
#data path: /home/fastdfs/storage/data, mkdir sub dir done.

设置开机启动 Storage

vim /etc/rc.d/rc.local
  service fdfs_storaged start

附目录说明

#  storage server目录及文件结构：
#  ${base_path}
#    |__data
#    |     |__storage_stat.dat：本地存储信息
#    |     |__sync
#    |           |__ binlog.000
#    |           |__ binlog.index
#    |__logs
#          |__storaged.log：storage server日志文件

安装fastdfs-nginx-module模块

#创建相关用户和目录创建www用户和组
  /usr/sbin/groupadd www
  /usr/sbin/useradd -g www www
#创建nginx日志目录
  mkdir -p /home/www/logs
  chmod a+w /home/www/logs
  chown -R www:www /home/www/logs

安装nginx

cd /usr/local/src
#下载 nginx
#wget http://nginx.org/download/nginx-1.5.4.tar.gz
  tar -zxvf nginx-1.5.4.tar.gz
  cd nginx-1.5.4/
  ./configure --user=www --group=www --prefix=/usr/local/nginx --with-http_stub_status_module
  make && make install
#--with-http_stub_status_module 用来监控nginx的当前状态

安装fastdfs-nginx-module插件

#worksrc;
  cd /usr/local/src
# wget http://fastdfs.googlecode.com/files/fastdfs-nginx-module_v1.15.tar.gz
  tar -zxvf fastdfs-nginx-module_v1.15.tar.gz
#修改插件配置文件
  vim /usr/local/src/fastdfs-nginx-module/src/config
ngx_addon_name=ngx_http_fastdfs_module
HTTP_MODULES="$HTTP_MODULES ngx_http_fastdfs_module"
NGX_ADDON_SRCS="$NGX_ADDON_SRCS $ngx_addon_dir/ngx_http_fastdfs_module.c"
CORE_INCS="$CORE_INCS /usr/local/fastdfs/include/fastdfs /usr/local/fastdfs/include/fastcommon/"
CORE_LIBS="$CORE_LIBS -L/usr/local/fastdfs/lib -lfastcommon -lfdfsclient"
CFLAGS="$CFLAGS -D_FILE_OFFSET_BITS=64 -DFDFS_OUTPUT_CHUNK_SIZE='256*1024' -DFDFS_MOD_CONF_FILENAME='\"/usr/local/fastdfs/conf/mod_fastdfs.conf\"'"
#复制mod_fastdfs.conf到/usr/local/fastdfs/conf/目录下
  cp /usr/local/src/fastdfs-nginx-module/src/mod_fastdfs.conf /usr/local/fastdfs/conf/

上面编译时使用的动态链接库

#启动nginx报错
#./nginx: error while loading shared libraries: libfastcommon.so: cannot open shared object file: No such file or directory
#解决办法 ---> 将/usr/local/fastdfs/lib 加入系统文件/etc/ld.so.conf中
  vim /etc/ld.so.conf
  /usr/local/fastdfs/lib
#更新库文件缓存ld.so.cache
  /sbin/ldconfig -v

编译fastdfs-nginx-module模块

# 重新编译nginx  
  cd /usr/local/src/nginx-1.5.4
  ./configure --add-module=/usr/local/src/fastdfs-nginx-module/src
  make; make install

修改mod_fastdfs.conf配置

vim /usr/local/fastdfs/conf/mod_fastdfs.conf
# the base path to store log files
  base_path=/tmp
# if load FastDFS parameters from tracker server
# since V1.12
# default value is false
  load_fdfs_parameters_from_tracker=true
# FastDFS tracker_server can ocur more than once, and tracker_server format is
#  "host:port", host can be hostname or ip address
# valid only when load_fdfs_parameters_from_tracker is true
  tracker_server=192.168.55.222:22122
# the port of the local storage server
# the default value is 23000
  storage_server_port=23000
# the group name of the local storage server
  group_name=group1
# if the url / uri including the group name
# set to false when uri like /M00/00/00/xxx
# set to true when uri like ${group_name}/M00/00/00/xxx, such as group1/M00/xxx
# default value is false
  url_have_group_name = true
# path(disk or mount point) count, default value is 1
# must same as storage.conf
  store_path_count=1
# store_path#, based 0, if store_path0 not exists, it's value is base_path
# the paths must be exist
# must same as storage.conf
  store_path0=/home/fastdfs/storage
# set the log filename, such as /usr/local/apache2/logs/mod_fastdfs.log
# empty for output to stderr (apache and nginx error_log file)
  log_filename=/home/www/logs/mod_fastdfs.log

nginx配置简洁版本

#vim /usr/local/nginx/conf/nginx.conf
user  www www;
worker_processes  2;
error_log  /home/www/logs/error.log  notice;
pid        /home/www/logs/nginx.pid;

worker_rlimit_nofile 5120;
events {
    use epoll;
    worker_connections  5120;
}

http {
    include       mime.types;
    default_type  application/octet-stream;

    sendfile        on;
    tcp_nopush     on;
    keepalive_timeout  60;
    tcp_nodelay on;

    server {
        listen       80;
        server_name  localhost;
        location /group1/M00 {
            alias /home/fastdfs/storage/data;
            ngx_fastdfs_module;
        }
    }
}

#启动nginx
  /usr/local/nginx/sbin/nginx

4.安装Storage Server -192.168.55.224

引用上例中安装libevent 和 fastdfs步骤

修改storage.conf配置

vim /usr/local/fastdfs/conf/storage.conf
# the name of the group this storage server belongs to
  group_name=group2
# the name of the group this storage server belongs to
# the storage server port #the storage server port
  port=23000
# the base path to store data and log files #日志目录
  base_path=/home/yuqing/fastdfs -> /home/fastdfs/storage
# store_path#, based 0, if store_path0 not exists, it's value is base_path #data数据存储目录
# the paths must be exist
  store_path0=/home/fastdfs/storage
#unix group name to run this program,
#not set (empty) means run by the group of current user
  run_by_group= -> fastdfs    #这儿一定填写执行的用户名，不然会启动报错，测试环境填写的 root
#unix username to run this program,
#not set (empty) means run by current user
  run_by_user= -> fastdfs   #这儿一定填写执行的用户名，不然会启动报错，测试环境填写的 root
# tracker_server can ocur more than once, and tracker_server format is
#  "host:port", host can be hostname or ip address
  tracker_server=192.168.xxx.xxxx:22122 -> tracker_server=192.168.55.222:22122

引用上例中 "编辑启动脚本" 步骤

#启动 Storage  
  service fdfs_storaged restart
#接下来会出现很多mkdir data path,这是系统在创建数据目录
#data path: /home/fastdfs/storage/data, mkdir sub dir...
#mkdir data path: 00 ...
#mkdir data path: 01 ...
#mkdir data path: 02 ...
#mkdir data path: 03 ...
#.......................
#data path: /home/fastdfs/storage/data, mkdir sub dir done.

安装fastdfs-nginx-module插件

#worksrc;
  cd /usr/local/src
# wget http://fastdfs.googlecode.com/files/fastdfs-nginx-module_v1.15.tar.gz
  tar -zxvf fastdfs-nginx-module_v1.15.tar.gz
#修改插件配置文件
  vim /usr/local/src/fastdfs-nginx-module/src/config
ngx_addon_name=ngx_http_fastdfs_module
HTTP_MODULES="$HTTP_MODULES ngx_http_fastdfs_module"
NGX_ADDON_SRCS="$NGX_ADDON_SRCS $ngx_addon_dir/ngx_http_fastdfs_module.c"
CORE_INCS="$CORE_INCS /usr/local/fastdfs/include/fastdfs /usr/local/fastdfs/include/fastcommon/"
CORE_LIBS="$CORE_LIBS -L/usr/local/fastdfs/lib -lfastcommon -lfdfsclient"
CFLAGS="$CFLAGS -D_FILE_OFFSET_BITS=64 -DFDFS_OUTPUT_CHUNK_SIZE='256*1024' -DFDFS_MOD_CONF_FILENAME='\"/usr/local/fastdfs/conf/mod_fastdfs.conf\"'"
#复制mod_fastdfs.conf到/usr/local/fastdfs/conf/目录下
  cp /usr/local/src/fastdfs-nginx-module/src/mod_fastdfs.conf /usr/local/fastdfs/conf/

上面编译时使用的动态链接库

#将/usr/local/fastdfs/lib 加入系统文件/etc/ld.so.conf中
  vim /etc/ld.so.conf
  /usr/local/fastdfs/lib
#更新库文件缓存ld.so.cache
  /sbin/ldconfig

编译fastdfs-nginx-module模块

# 重新编译nginx  
  cd /usr/local/src/nginx-1.5.4
  ./configure --add-module=/usr/local/src/fastdfs-nginx-module/src
  make; make install

修改mod_fastdfs.conf配置

vim /usr/local/fastdfs/conf/mod_fastdfs.conf
# the base path to store log files
  base_path=/tmp
# if load FastDFS parameters from tracker server
# since V1.12
# default value is false
  load_fdfs_parameters_from_tracker=true
# FastDFS tracker_server can ocur more than once, and tracker_server format is
#  "host:port", host can be hostname or ip address
# valid only when load_fdfs_parameters_from_tracker is true
  tracker_server=192.168.25.11:22122
# the port of the local storage server
# the default value is 23000
  storage_server_port=23000
# the group name of the local storage server
  group_name=group2
# if the url / uri including the group name
# set to false when uri like /M00/00/00/xxx
# set to true when uri like ${group_name}/M00/00/00/xxx, such as group1/M00/xxx
# default value is false
  url_have_group_name = true
# path(disk or mount point) count, default value is 1
# must same as storage.conf
  store_path_count=1
# store_path#, based 0, if store_path0 not exists, it's value is base_path
# the paths must be exist
# must same as storage.conf
  store_path0=/home/fastdfs/storage
# set the log filename, such as /usr/local/apache2/logs/mod_fastdfs.log
# empty for output to stderr (apache and nginx error_log file)
  log_filename=/home/www/logs/mod_fastdfs.log

nginx配置简洁版本

#vim /usr/local/nginx/conf/nginx.conf
user  www www;
worker_processes  2;
error_log  /home/www/logs/error.log  notice;
pid        /home/www/logs/nginx.pid;

worker_rlimit_nofile 5120;
events {
    use epoll;
    worker_connections  5120;
}

http {
    include       mime.types;
    default_type  application/octet-stream;

    sendfile        on;
    tcp_nopush     on;
    keepalive_timeout  60;
    tcp_nodelay on;

    server {
        listen       80;
        server_name  localhost;
        location /group2/M00 {
            alias /home/fastdfs/storage/data;
            ngx_fastdfs_module;
        }
    }
}

#启动nginx
  /usr/local/nginx/sbin/nginx

5.安装Storage Server - 192.168.55.225

参考 192.168.55.224 安装，不同点就是192.168.55.224是group2的源服务，storage.conf配置不同，需要注意。

6.测试及使用fastdfs-192.168.55.222

fastdfs之配置client

#修改 client.conf
  vim /usr/local/fastdfs/conf/client.conf
  base_path=/home/yuqing/fastdfs-> base_path=/home/fastdfs/tracker
  tracker_server=192.168.209.121:22122 -> tracker_server=192.168.55.222:22122
#或
  sed -i 's:base_path=.*:base_path=/home/fastdfs/tracker:g' /usr/local/fastdfs/conf/client.conf
  sed -i 's:tracker_server=.*:tracker_server=192.168.55.222\:22122:g' /usr/local/fastdfs/conf/client.conf

#upload
  cd /usr/local/fastdfs/bin
  ./fdfs_upload_file /usr/local/fastdfs/conf/client.conf /tmp/t1.jpg 
#-——————————————————————————————————————
#group1/M00/00/00/oYYBAFJNRnGASWekAAAXkpktHxI423.jpg

查看文件信息

./fdfs_file_info /usr/local/fastdfs/conf/client.conf group1/M00/00/00/oYYBAFJNQiiAYIXzAAAXkpktHxI095.jpg
#————————————————————————————————————————
source storage id: 100001
source ip address: 192.168.55.223
file create timestamp: 2013-10-03 18:26:57
file size: 6034
file crc32: 2569871122 (0x992D1F12)

测试上传

./fdfs_test /usr/local/fastdfs/conf/client.conf upload /tmp/t1.jpg 
#————————————————————————————————————————
This is FastDFS client test program v4.07

Copyright (C) 2008, Happy Fish / YuQing

FastDFS may be copied only under the terms of the GNU General
Public License V3, which may be found in the FastDFS source kit.
Please visit the FastDFS Home Page http://www.csource.org/ 
for more detail.

[2013-10-04 02:20:19] DEBUG - base_path=/home/fastdfs/tracker, connect_timeout=30, network_timeout=60, tracker_server_count=1, anti_steal_token=0, anti_steal_secret_key length=0, use_connection_pool=0, g_connection_pool_max_idle_time=3600s, use_storage_id=0, storage server id count: 0

tracker_query_storage_store_list_without_group: 
        server 1. group_name=, ip_addr=192.168.55.223, port=23000

group_name=group1, ip_addr=192.168.55.223, port=23000
storage_upload_by_filename
group_name=group1, remote_filename=M00/00/00/oYYBAFJNRWeAHhGuAAAXkpktHxI578.jpg
source ip address: 192.168.55.223
file timestamp=2013-10-03 18:22:31
file size=6034
file crc32=2569871122
example file url: http://192.168.55.223/group1/M00/00/00/oYYBAFJNRWeAHhGuAAAXkpktHxI578.jpg
storage_upload_slave_by_filename
group_name=group1, remote_filename=M00/00/00/oYYBAFJNRWeAHhGuAAAXkpktHxI578_big.jpg
source ip address: 192.168.55.223
file timestamp=2013-10-03 18:22:31
file size=6034
file crc32=2569871122
example file url: http://192.168.55.223/group1/M00/00/00/oYYBAFJNRWeAHhGuAAAXkpktHxI578_big.jpg

在浏览器中-->http://192.168.55.222/group1/M00/00/00/oYYBAFJNQiiAYIXzAAAXkpktHxI095.jpg
输入上图中的url地址， tracker server 会自动重定向到存储文件的 storage server，文件下载成功。至此，已经成功搭建了fastdfs。弄了两天，终于好了 - 0-：

常规命令范例:

#监控storage
/usr/local/fastdfs/bin/fdfs_monitor /usr/local/fastdfs/conf/storage.conf
#如果存在多个多个组，只需要监控其中一个组，就能调出所有组的状态

#删除组内服务器storage和查看各个组内服务器状态
/usr/local/fastdfs/bin/fdfs_monitor /usr/local/fastdfs/conf/client.conf delete group2 192.168.55.223
/usr/local/fastdfs/bin/fdfs_monitor /usr/local/fastdfs/conf/client.conf
storage server有7个状态，如下(数值从1~7)：
# FDFS_STORAGE_STATUS：INIT      :初始化，尚未得到同步已有数据的源服务器
# FDFS_STORAGE_STATUS：WAIT_SYNC :等待同步，已得到同步已有数据的源服务器
# FDFS_STORAGE_STATUS：SYNCING   :同步中
# FDFS_STORAGE_STATUS：DELETED   :已删除，该服务器从本组中摘除
# FDFS_STORAGE_STATUS：OFFLINE   :离线
# FDFS_STORAGE_STATUS：ONLINE    :在线，尚不能提供服务
# FDFS_STORAGE_STATUS：ACTIVE    :在线，可以提供服务

常用操作命令

#调整防火墙的规则,开放端口:22122
  iptables -I INPUT 5 -p tcp -m state --state NEW -m tcp --dport 22122 -j ACCEPT
  /etc/init.d/iptables save

#调整防火墙的规则,开放端口:23000
  iptables -I INPUT 5 -p tcp -m state --state NEW -m tcp --dport 23000 -j ACCEPT
  /etc/init.d/iptables save
 
#启动tracker进程:
  /etc/init.d/fdfs_trackerd start

#查看trackerd状态:
  /etc/init.d/fdfs_trackerd status

#查看trackerd监听的端口:
  netstat -plantu | grep tracker

#启动Storage进程:
  /etc/init.d/fdfs_storaged start

#查看Storage进程:
  ps -ef | grep storaged | grep -v grep

FastDFS原理

存储节点采用了分组（group）的方式。存储系统由一个或多个group组成，group与group之间的文件是相互独立的，所有group的文件容量累加就是整个存储系统中的文件容量。一个group可以由一台或多台存储服务器组成，一个group下的存储服务器中的文件都是相同的，group中的多台存储服务器起到了冗余备份和负载均衡的作用（一个组的存储容量为该组内存储服务器容量最小的那个，不同组的Storage server之间不会相互通信，同组内的Storage server之间会相互连接进行文件同步）。

在group中增加服务器时，同步已有的文件由系统自动完成，同步完成后，系统自动将新增服务器切换到线上提供服务。

当存储空间不足或即将耗尽时，可以动态添加group。只需要增加一台或多台服务器，并将它们配置为一个新的group，这样就扩大了存储系统的容量。

FastDFS只有两个角色：Tracker server和Storage server。Tracker server作为中心结点，其主要作用是负载均衡和调度。Tracker server在内存中记录分组和Storage server的状态等信息，不记录文件索引信息，占用的内存量很少。另外，客户端（应用）和Storage server访问Tracker server时，Tracker server扫描内存中的分组和Storage server信息，然后给出应答。由此可以看出Tracker server非常轻量化，不会成为系统瓶颈。

FastDFS中的Storage server在其他文件系统中通常称作Trunk server或Data server。Storage server直接利用OS的文件系统存储文件。FastDFS不会对文件进行分块存储，客户端上传的文件和Storage server上的文件一一对应（FastDFS中的文件标识分为两个部分：组名和文件名，二者缺一不可）

能够完成基于这两个作者的博文，wangying 、 zrwm thk。

转载于:https://my.oschina.net/shking/blog/165326