centos 安装FastDfs

已于 2022-07-21 11:13:06 修改
阅读量1.7k 收藏
点赞数
分类专栏： 技术运维 文章标签： centos7.X fastdfs分布式集群部署 nginx负载均衡 浮生梦浮生
于 2018-12-12 15:01:19 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/wudaoshihun/article/details/84964577
版权

本来使用3个节点部署fastdfs,其中1个tracker,2个storage(2个group）如果使用6个节点，2个tracker,4个storage(2个group）其中group中2个节点互为主备。

fastdfs命令

#/usr/local/nginx/sbin/nginx -s reload

#/usr/bin/fdfs_trackerd /etc/fdfs/tracker.conf

#/usr/bin/fdfs_storaged /etc/fdfs/storage.conf 

#/usr/bin/fdfs_monitor /etc/fdfs/storage.conf

#cd /home

#/usr/bin/fdfs_upload_file /etc/fdfs/client.conf 123.txt

#/usr/bin/fdfs_upload_file /etc/fdfs/client.conf 444.log

目录

以下可以使用SCRT的同时操作

一、环境准备

1. 安装开发编译环境,直接安装组内所有软件

2. 并不需要这么多组件，浪费资源，可以分步安装

二. 安装fastdfs

1 安装libfastcommon

2 安装fastdfs

3 配置

3.1配置tracker，即追踪节点1台（若2台，则同理配置一份）

3.2配置storage，即存储节点2台

三 配置dfs客户端并测试

1. 配置客户端连接(tracker服务器配置）

2. 测试可用性

四.配置nginx(storage服务)

2. 安装fastdfs-nginx-module

4. 安装nginx

5. fdfs-nginx配置

6. fastdfs配置

7.配置nginx

五 配置tracker-nginx的反向代理

1. 安装ngx_cache_purge

2. 安装nginx

2.配置nginx

六 命令

七 配置

1. tracker 服务 nginx.conf

2. storage 服务 nginx配置

3. storage服务 mod_fastdfs.conf配置

5. storage.conf服务配置

6. tracker.conf配置

7. client.conf配置

以下可以使用SCRT的同时操作

1. 查看--》交互窗口

2. 在窗口下面出现的输入框中右键--》选择发送交互到所有会话

当然，编辑不能使用同步交互窗口，只能scp或单独编辑

一、环境准备

1. 安装开发编译环境,直接安装组内所有软件

#yum grouplist | more 查看组内软件情况

#yum grouplist | grep Development 开发编译环境

# yum groupinfo Development tools 开发环境工具详情

#yum groupinstall "Development Tools" "Server platform Development"   一次性安装

2. 并不需要这么多组件，浪费资源，可以分步安装

2.1 安装gcc

#yum -y install make cmake gcc gcc-c++

2.2 安装zip

#yum -y install zip unzip

2.3 安装vim

#yum -y install vim-enhanced

2.4安装性能事件通知库

#yum -y install libevent

或下面wget方式

#wget --no-check-certificate http://www.monkey.org/~provos/libevent-1.2.tar.gz

#tar -zxvf libevent-1.2.tar.gz

#cd libevent-1.2

#./configure

#make & make install

2.5 安装nginx 依赖

#yum -y install pcre

#yum -y install pcre-devel

#yum -y install zlib*

#yum -y install openssl openssl--devel


2.6 安装git

#yum -y install git

二. 安装fastdfs

1 安装libfastcommon

# mkdir /usr/local/soft

#cd /usr/local/soft

#git clone https://github.com/happyfish100/libfastcommon.git

#cd libfastcommon/

#./make.sh

#./make.sh install

2 安装fastdfs

#cd /usr/local/soft/

#git clone https://github.com/happyfish100/fastdfs.git

#cd fastdfs/

#./make.sh

#./make.sh install

3 配置

通过上述安装，会自动生成配置到/etc/fdfs

3.1配置tracker，即追踪节点1台（若2台，则同理配置一份）

# cd /etc/fdfs

#cp tracker.conf.sample tracker.conf

#vi tracker.conf

修改base_path与store_lookup

base_path修改为/fastdfs/tracker

store_lookup修改为0轮训策略，默认为2负载均衡策略

如果值为1的话表明要始终向某个group进行上传下载操作，这时下图中的"store_group=group2"才会起作用

创建tracker数据目录并设置权限

 #mkdir -p /fastdfs/tracker

#chmod 777 /fastdfs/*

启动fastdfs tracker

#cd /usr/local/soft/fastdfs/

#/usr/bin/fdfs_trackerd /etc/fdfs/tracker.conf

启动成功后，我们看到tracker文件夹下多了2个包

3.2配置storage，即存储节点2台

# cd /etc/fdfs

#cp storage.conf.sample storage.conf

#vi storage.conf

配置一台后，通过scp命令拷贝即可

 scp storage.conf root@10.39.46.33:/etc/fdfs/

修改如下配置：

group_name=group1

base_path=/fastdfs/storage

store_path_count=1

store_path0=/fastdfs/storage

tracker_server=10.39.46.34:22122 

如果配置了多台tracker_server,则增加一行

tracker_server=10.39.XX:22122 

另一台机器把group_name修改为group2

如果是4台机器，则2个group1,2个group2

创建storage文件夹

#mkdir -p /fastdfs/storage

#chmod 777 /fastdfs/*

启动fastdfs storage

#cd /usr/local/soft/fastdfs

#/usr/bin/fdfs_storaged /etc/fdfs/storage.conf 

#cd /fastdfs/storage

#vi storaged.log  查看启动日志

三 配置dfs客户端并测试

1. 配置客户端连接(tracker服务器配置）

#cd /etc/fdfs

#cp client.conf.sample client.conf

#vim client.conf

修改客户端配置：

base_path=/fastdfs/tracker

tracker_server=10.39.XX:22122

如果是2台tracker,则增加tracker_server=10.39.XX:22122

2. 测试可用性

测试可用性要使用以下几部分

测试查看集群信息在storage服务骑上：/usr/bin/fdfs_monitor /etc/fdfs/storage.conf

 指定要进行上传文件操作：/usr/bin/fdfs_upload_file

 指定要进行上传文件操作使用的配置文件:/etc/fdfs/client.conf

 指定要上传的文件:filename.txt

#cd /home

#/usr/bin/fdfs_upload_file /etc/fdfs/client.conf 123.txt

#/usr/bin/fdfs_upload_file /etc/fdfs/client.conf 444.log

通过下图我们看到上传文件后，返回一个dfs路径，其中有group1与group2,代表配置文件中的2个分组

M00：代表磁盘目录，如有多个磁盘，则为M01,M02...等

00/00：代表磁盘上的2级目录，每级从00-FF共256个，2级为256*256个。

Ci...txt: 为dfs重命名的文件名。

从上图我们看到在目录/fastdfs/storage/data/00/00下有个文件

那么在33机器上有一个后缀为log的文件，因为开启的是轮训策略，所以会轮训存储。

四.配置nginx(storage服务)

1. 安装fastdfs-nginx-module在storage服务器上

2. 安装fastdfs-nginx-module

#cd /usr/local/soft

# git clone https://github.com/happyfish100/fastdfs-nginx-module.git

#cd fastdfs-nginx-module/src/

# vi config 

把local去掉，因为安装时是安装在/usr/include下

4. 安装nginx

#cd /usr/local/soft

#wget http://nginx.org/download/nginx-1.8.0.tar.gz

#tar -zxvf nginx-1.8.0.tar.gz -C /usr/local/soft/

# cd nginx-1.8.0

#./configure --add-module=/usr/local/soft/fastdfs-nginx-module/src/

#make && make install

安装成功后，查看/usr/local，会生成nginx文件夹

5. fdfs-nginx配置

找到fastdfs-nginx-module目录

#cd /usr/local/soft/fastdfs-nginx-module/src/

把mod_fastdfs.conf复制到/etc/fdfs/

#cp mod_fastdfs.conf /etc/fdfs/

#cd /etc/fdfs/

#vi mod_fastdfs.conf

修改如下配置

connect_timeout=10

tracker_server=10.39.46.34:22122

storage_server_port=23000

url_have_group_name=true
store_path0=/fastdfs/storage
group_name=group1
group_count=1

[group1]
group_name=group1
storage_server_port=23000
store_path_count=1
store_path0=/fastdfs/storage
#store_path1=/home/yuqing/fastdfs1
[group2]
group_name=group2
storage_server_port=23000
store_path_count=1
store_path0=/fastdfs/storage

拷贝文件到另一台服务器

#scp /etc/fdfs/mod_fastdfs.conf root@10.39.XX:/etc/fdfs/

6. fastdfs配置

 拷贝fastdfs目录下的配置文件到/etc/fdfs/

#cd /usr/local/soft/fastdfs/conf/

#cp http.conf mime.types /etc/fdfs/

创建软链接

#cd /etc/fdfs/

#ln -s /fastdfs/storage/data/ /fastdfs/storage/data/M00

7.配置nginx

#cd /usr/local/nginx/conf/

#vi nginx.conf

修改端口为8888

增加

location ~/group([0-9])/M00 {
              ngx_fastdfs_module; 
}

# scp nginx.conf root@10.39.46.33:/usr/local/nginx/conf/ 拷贝到33

启动nginx

#/usr/local/nginx/sbin/nginx

重启nginx

#/usr/local/nginx/sbin/nginx -s reload

验证修改配置文件是否正确

#/usr/local/nginx/sbin/nginx -t

如果验证报错，则增加端口访问，在防火墙设置：

#vim /etc/sysconfig/iptables

增加-A INPUT -m state --state NEW -m tcp -p tcp --dport 8888 -j ACCEPT

验证  

http://IP:8888/图片路径

五 配置tracker-nginx的反向代理

1. 安装ngx_cache_purge

#cd /usr/local/soft/

#wget http://labs.frickle.com/files/ngx_cache_purge-2.3.tar.gz

#tar -zxvf ngx_cache_purge-2.3.tar.gz

2. 安装nginx

#cd /usr/local/soft

#wget http://nginx.org/download/nginx-1.8.0.tar.gz

#tar -zxvf nginx-1.8.0.tar.gz -C /usr/local/soft/

# cd nginx-1.8.0

#./configure --add-module=/usr/local/soft/ngx_cache_purge-2.3

#make && make install

2.配置nginx

#cd /usr/local/nginx/conf

把下面反向代理配置nginx.conf替换掉，放在文章最后

#创建反向代理目录结构

#mkdir -p /fastdfs/cache/nginx/proxy_cache

#mkdir -p /fastdfs/cache/nginx/proxy_cache/tmp

启动nginx

# /usr/local/nginx/sbin/nginx

3.验证

#/usr/bin/fdfs_upload_file /etc/fdfs/client.conf  123.txt

#/usr/bin/fdfs_upload_file /etc/fdfs/client.conf  234.log

在返回的目录地址加上：http://10.39.46.34:8000进行直接访问

六 命令

#cd /usr/bin/ && ls | grep fdfs 查看dfs命令

#/usr/bin/fdfs_monitor /etc/fdfs/storage.conf 测试启动及集群情况

七 配置

1. tracker 服务 nginx.conf


#user  nobody;
worker_processes  1;

#error_log  logs/error.log;
#error_log  logs/error.log  notice;
#error_log  logs/error.log  info;

#pid        logs/nginx.pid;


events {
    worker_connections  1024;
}


http {
    include       mime.types;
    default_type  application/octet-stream;

    #log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
    #                  '$status $body_bytes_sent "$http_referer" '
    #                  '"$http_user_agent" "$http_x_forwarded_for"';

    #access_log  logs/access.log  main;

    sendfile        on;
    #tcp_nopush     on;

    #keepalive_timeout  0;
    keepalive_timeout  65;

    #gzip  on;
 
    #设置缓存
    server_names_hash_bucket_size 128;
    client_header_buffer_size 32k;
    large_client_header_buffers 4 32k;
    client_max_body_size 300m;

    proxy_redirect off;
    proxy_set_header Host $http_host;
    proxy_set_header X-Real-IP $remote_addr;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    proxy_connect_timeout 90;
    proxy_send_timeout 90;
    proxy_read_timeout 90;
    proxy_buffer_size 16k;
    proxy_buffers 4 64k;
    proxy_busy_buffers_size 128k;
    proxy_temp_file_write_size 128k;
    #设置缓存存储路径，存储方式，分别内存大小，磁盘最大空间，缓存期限
    proxy_cache_path /fastdfs/cache/nginx/proxy_cache levels=1:2
    keys_zone=http-cache:200m max_size=1g inactive=30d;
    proxy_temp_path /fastdfs/cache/nginx/proxy_cache/tmp;

    #group1的服务设置
    upstream fdfs_group1 {
         server 10.39.46.31:8888 weight=1 max_fails=2 fail_timeout=30s;
         #server 10.39.46.30:8888 weight=1 max_fails=2 fail_timeout=30s;
    }
    #group2的服务设置
    upstream fdfs_group2 {
         server 10.39.46.33:8888 weight=1 max_fails=2 fail_timeout=30s;
         #server 10.39.46.31:8888 weight=1 max_fails=2 fail_timeout=30s;
    }

    server {
        listen       8000;
        server_name  localhost;

        #charset koi8-r;

        #access_log  logs/host.access.log  main;

        location / {
            root   html;
            index  index.html index.htm;
        }


        #group1的负载均衡配置
        location /group1/M00 {
            proxy_next_upstream http_502 http_504 error timeout invalid_header;
            proxy_cache http-cache;
            proxy_cache_valid 200 304 12h;
            proxy_cache_key $uri$is_args$args;
            #对应group1的服务设置
            proxy_pass http://fdfs_group1;
            expires 30d;
        }

        location /group2/M00 {
            proxy_next_upstream http_502 http_504 error timeout invalid_header;
            proxy_cache http-cache;
            proxy_cache_valid 200 304 12h;
            proxy_cache_key $uri$is_args$args;
            #对应group2的服务设置
            proxy_pass http://fdfs_group2;
            expires 30d;
         }

        location ~/purge(/.*) {
            allow 127.0.0.1;
            allow 10.39.46.0/24;
            deny all;
            proxy_cache_purge http-cache $1$is_args$args;
        }

        #error_page  404              /404.html;

        # redirect server error pages to the static page /50x.html
        #
        error_page   500 502 503 504  /50x.html;
        location = /50x.html {
            root   html;
        }

        # proxy the PHP scripts to Apache listening on 127.0.0.1:80
        #
        #location ~ \.php$ {
        #    proxy_pass   http://127.0.0.1;
        #}

        # pass the PHP scripts to FastCGI server listening on 127.0.0.1:9000
        #
        #location ~ \.php$ {
        #    root           html;
        #    fastcgi_pass   127.0.0.1:9000;
        #    fastcgi_index  index.php;
        #    fastcgi_param  SCRIPT_FILENAME  /scripts$fastcgi_script_name;
        #    include        fastcgi_params;
        #}

        # deny access to .htaccess files, if Apache's document root
        # concurs with nginx's one
        #
        #location ~ /\.ht {
        #    deny  all;
        #}
    }


    # another virtual host using mix of IP-, name-, and port-based configuration
    #
    #server {
    #    listen       8000;
    #    listen       somename:8080;
    #    server_name  somename  alias  another.alias;

    #    location / {
    #        root   html;
    #        index  index.html index.htm;
    #    }
    #}


    # HTTPS server
    #
    #server {
    #    listen       443 ssl;
    #    server_name  localhost;

    #    ssl_certificate      cert.pem;
    #    ssl_certificate_key  cert.key;

    #    ssl_session_cache    shared:SSL:1m;
    #    ssl_session_timeout  5m;

    #    ssl_ciphers  HIGH:!aNULL:!MD5;
    #    ssl_prefer_server_ciphers  on;

    #    location / {
    #        root   html;
    #        index  index.html index.htm;
    #    }
    #}

}
 

2. storage 服务 nginx配置


#user  nobody;
worker_processes  1;

#error_log  logs/error.log;
#error_log  logs/error.log  notice;
#error_log  logs/error.log  info;

#pid        logs/nginx.pid;


events {
    worker_connections  1024;
}


http {
    include       mime.types;
    default_type  application/octet-stream;

    #log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
    #                  '$status $body_bytes_sent "$http_referer" '
    #                  '"$http_user_agent" "$http_x_forwarded_for"';

    #access_log  logs/access.log  main;

    sendfile        on;
    #tcp_nopush     on;

    #keepalive_timeout  0;
    keepalive_timeout  65;

    #gzip  on;

    server {
        listen       8888;
        server_name  localhost;

        #charset koi8-r;

        #access_log  logs/host.access.log  main;

        location / {
            root   html;
            index  index.html index.htm;
        }


        location ~/group([0-9])/M00 {
                ngx_fastdfs_module;
        }
        #error_page  404              /404.html;

        # redirect server error pages to the static page /50x.html
        #
        error_page   500 502 503 504  /50x.html;
        location = /50x.html {
            root   html;
        }

        # proxy the PHP scripts to Apache listening on 127.0.0.1:80
        #
        #location ~ \.php$ {
        #    proxy_pass   http://127.0.0.1;
        #}

        # pass the PHP scripts to FastCGI server listening on 127.0.0.1:9000
        #
        #location ~ \.php$ {
        #    root           html;
        #    fastcgi_pass   127.0.0.1:9000;
        #    fastcgi_index  index.php;
        #    fastcgi_param  SCRIPT_FILENAME  /scripts$fastcgi_script_name;
        #    include        fastcgi_params;
        #}

        # deny access to .htaccess files, if Apache's document root
        # concurs with nginx's one
        #
        #location ~ /\.ht {
        #    deny  all;
        #}
    }


    # another virtual host using mix of IP-, name-, and port-based configuration
    #
    #server {
    #    listen       8000;
    #    listen       somename:8080;
    #    server_name  somename  alias  another.alias;

    #    location / {
    #        root   html;
    #        index  index.html index.htm;
    #    }
    #}


    # HTTPS server
    #
    #server {
    #    listen       443 ssl;
    #    server_name  localhost;

    #    ssl_certificate      cert.pem;
    #    ssl_certificate_key  cert.key;

    #    ssl_session_cache    shared:SSL:1m;
    #    ssl_session_timeout  5m;

    #    ssl_ciphers  HIGH:!aNULL:!MD5;
    #    ssl_prefer_server_ciphers  on;

    #    location / {
    #        root   html;
    #        index  index.html index.htm;
    #    }
    #}

}
 

3. storage服务 mod_fastdfs.conf配置

# connect timeout in seconds
# default value is 30s
connect_timeout=2

# network recv and send timeout in seconds
# default value is 30s
network_timeout=30

# the base path to store log files
base_path=/tmp

# if load FastDFS parameters from tracker server
# since V1.12
# default value is false
load_fdfs_parameters_from_tracker=true

# storage sync file max delay seconds
# same as tracker.conf
# valid only when load_fdfs_parameters_from_tracker is false
# since V1.12
# default value is 86400 seconds (one day)
storage_sync_file_max_delay = 86400

# if use storage ID instead of IP address
# same as tracker.conf
# valid only when load_fdfs_parameters_from_tracker is false
# default value is false
# since V1.13
use_storage_id = false

# specify storage ids filename, can use relative or absolute path
# same as tracker.conf
# valid only when load_fdfs_parameters_from_tracker is false
# since V1.13
storage_ids_filename = storage_ids.conf

# FastDFS tracker_server can ocur more than once, and tracker_server format is
#  "host:port", host can be hostname or ip address
# valid only when load_fdfs_parameters_from_tracker is true
tracker_server=10.39.46.34:22122

# the port of the local storage server
# the default value is 23000
storage_server_port=23000

# the group name of the local storage server
group_name=group1

# if the url / uri including the group name
# set to false when uri like /M00/00/00/xxx
# set to true when uri like ${group_name}/M00/00/00/xxx, such as group1/M00/xxx
# default value is false
url_have_group_name = true

# path(disk or mount point) count, default value is 1
# must same as storage.conf
store_path_count=1

# store_path#, based 0, if store_path0 not exists, it's value is base_path
# the paths must be exist
# must same as storage.conf
store_path0=/fastdfs/storage
#store_path1=/home/yuqing/fastdfs1

# standard log level as syslog, case insensitive, value list:
### emerg for emergency
### alert
### crit for critical
### error
### warn for warning
### notice
### info
### debug
log_level=info

# set the log filename, such as /usr/local/apache2/logs/mod_fastdfs.log
# empty for output to stderr (apache and nginx error_log file)
log_filename=

# response mode when the file not exist in the local file system
## proxy: get the content from other storage server, then send to client
## redirect: redirect to the original storage server (HTTP Header is Location)
response_mode=proxy

# the NIC alias prefix, such as eth in Linux, you can see it by ifconfig -a
# multi aliases split by comma. empty value means auto set by OS type
# this paramter used to get all ip address of the local host
# default values is empty
if_alias_prefix=

# use "#include" directive to include HTTP config file
# NOTE: #include is an include directive, do NOT remove the # before include
#include http.conf


# if support flv
# default value is false
# since v1.15
flv_support = true

# flv file extension name
# default value is flv
# since v1.15
flv_extension = flv


# set the group count
# set to none zero to support multi-group on this storage server
# set to 0  for single group only
# groups settings section as [group1], [group2], ..., [groupN]
# default value is 0
# since v1.14
group_count = 2

# group settings for group #1
# since v1.14
# when support multi-group on this storage server, uncomment following section
#[group1]
#group_name=group1
#storage_server_port=23000
#store_path_count=2
#store_path0=/home/yuqing/fastdfs
#store_path1=/home/yuqing/fastdfs1

# group settings for group #2
# since v1.14
# when support multi-group, uncomment following section as neccessary
#[group2]
#group_name=group2
#storage_server_port=23000
#store_path_count=1
#store_path0=/home/yuqing/fastdfs
[group1]
group_name=group1
storage_server_port=23000
store_path_count=1
store_path0=/fastdfs/storage
#store_path1=/home/yuqing/fastdfs1
[group2]
group_name=group2
storage_server_port=23000
store_path_count=1
store_path0=/fastdfs/storage
 

5. storage.conf服务配置

# is this config file disabled
# false for enabled
# true for disabled
disabled=false

# the name of the group this storage server belongs to
#
# comment or remove this item for fetching from tracker server,
# in this case, use_storage_id must set to true in tracker.conf,
# and storage_ids.conf must be configed correctly.
group_name=group1

# bind an address of this host
# empty for bind all addresses of this host
bind_addr=

# if bind an address of this host when connect to other servers 
# (this storage server as a client)
# true for binding the address configed by above parameter: "bind_addr"
# false for binding any address of this host
client_bind=true

# the storage server port
port=23000

# connect timeout in seconds
# default value is 30s
connect_timeout=10

# network timeout in seconds
# default value is 30s
network_timeout=60

# heart beat interval in seconds
heart_beat_interval=30

# disk usage report interval in seconds
stat_report_interval=60

# the base path to store data and log files
base_path=/fastdfs/storage

# max concurrent connections the server supported
# default value is 256
# more max_connections means more memory will be used
# you should set this parameter larger, eg. 10240
max_connections=1024

# the buff size to recv / send data
# this parameter must more than 8KB
# default value is 64KB
# since V2.00
buff_size = 256KB

# accept thread count
# default value is 1
# since V4.07
accept_threads=1

# work thread count, should <= max_connections
# work thread deal network io
# default value is 4
# since V2.00
work_threads=4

# if disk read / write separated
##  false for mixed read and write
##  true for separated read and write
# default value is true
# since V2.00
disk_rw_separated = true

# disk reader thread count per store base path
# for mixed read / write, this parameter can be 0
# default value is 1
# since V2.00
disk_reader_threads = 1

# disk writer thread count per store base path
# for mixed read / write, this parameter can be 0
# default value is 1
# since V2.00
disk_writer_threads = 1

# when no entry to sync, try read binlog again after X milliseconds
# must > 0, default value is 200ms
sync_wait_msec=50

# after sync a file, usleep milliseconds
# 0 for sync successively (never call usleep)
sync_interval=0

# storage sync start time of a day, time format: Hour:Minute
# Hour from 0 to 23, Minute from 0 to 59
sync_start_time=00:00

# storage sync end time of a day, time format: Hour:Minute
# Hour from 0 to 23, Minute from 0 to 59
sync_end_time=23:59

# write to the mark file after sync N files
# default value is 500
write_mark_file_freq=500

# path(disk or mount point) count, default value is 1
store_path_count=1

# store_path#, based 0, if store_path0 not exists, it's value is base_path
# the paths must be exist
store_path0=/fastdfs/storage
#store_path1=/home/yuqing/fastdfs2

# subdir_count  * subdir_count directories will be auto created under each 
# store_path (disk), value can be 1 to 256, default value is 256
subdir_count_per_path=256

# tracker_server can ocur more than once, and tracker_server format is
#  "host:port", host can be hostname or ip address
tracker_server=10.39.46.34:22122

#standard log level as syslog, case insensitive, value list:
### emerg for emergency
### alert
### crit for critical
### error
### warn for warning
### notice
### info
### debug
log_level=info

#unix group name to run this program, 
#not set (empty) means run by the group of current user
run_by_group=

#unix username to run this program,
#not set (empty) means run by current user
run_by_user=

# allow_hosts can ocur more than once, host can be hostname or ip address,
# "*" (only one asterisk) means match all ip addresses
# we can use CIDR ips like 192.168.5.64/26
# and also use range like these: 10.0.1.[0-254] and host[01-08,20-25].domain.com
# for example:
# allow_hosts=10.0.1.[1-15,20]
# allow_hosts=host[01-08,20-25].domain.com
# allow_hosts=192.168.5.64/26
allow_hosts=*

# the mode of the files distributed to the data path
# 0: round robin(default)
# 1: random, distributted by hash code
file_distribute_path_mode=0

# valid when file_distribute_to_path is set to 0 (round robin), 
# when the written file count reaches this number, then rotate to next path
# default value is 100
file_distribute_rotate_count=100

# call fsync to disk when write big file
# 0: never call fsync
# other: call fsync when written bytes >= this bytes
# default value is 0 (never call fsync)
fsync_after_written_bytes=0

# sync log buff to disk every interval seconds
# must > 0, default value is 10 seconds
sync_log_buff_interval=10

# sync binlog buff / cache to disk every interval seconds
# default value is 60 seconds
sync_binlog_buff_interval=10

# sync storage stat info to disk every interval seconds
# default value is 300 seconds
sync_stat_file_interval=300

# thread stack size, should >= 512KB
# default value is 512KB
thread_stack_size=512KB

# the priority as a source server for uploading file.
# the lower this value, the higher its uploading priority.
# default value is 10
upload_priority=10

# the NIC alias prefix, such as eth in Linux, you can see it by ifconfig -a
# multi aliases split by comma. empty value means auto set by OS type
# default values is empty
if_alias_prefix=

# if check file duplicate, when set to true, use FastDHT to store file indexes
# 1 or yes: need check
# 0 or no: do not check
# default value is 0
check_file_duplicate=0

# file signature method for check file duplicate
## hash: four 32 bits hash code
## md5: MD5 signature
# default value is hash
# since V4.01
file_signature_method=hash

# namespace for storing file indexes (key-value pairs)
# this item must be set when check_file_duplicate is true / on
key_namespace=FastDFS

# set keep_alive to 1 to enable persistent connection with FastDHT servers
# default value is 0 (short connection)
keep_alive=0

# you can use "#include filename" (not include double quotes) directive to 
# load FastDHT server list, when the filename is a relative path such as 
# pure filename, the base path is the base path of current/this config file.
# must set FastDHT server list when check_file_duplicate is true / on
# please see INSTALL of FastDHT for detail
##include /home/yuqing/fastdht/conf/fdht_servers.conf

# if log to access log
# default value is false
# since V4.00
use_access_log = false

# if rotate the access log every day
# default value is false
# since V4.00
rotate_access_log = false

# rotate access log time base, time format: Hour:Minute
# Hour from 0 to 23, Minute from 0 to 59
# default value is 00:00
# since V4.00
access_log_rotate_time=00:00

# if rotate the error log every day
# default value is false
# since V4.02
rotate_error_log = false

# rotate error log time base, time format: Hour:Minute
# Hour from 0 to 23, Minute from 0 to 59
# default value is 00:00
# since V4.02
error_log_rotate_time=00:00

# rotate access log when the log file exceeds this size
# 0 means never rotates log file by log file size
# default value is 0
# since V4.02
rotate_access_log_size = 0

# rotate error log when the log file exceeds this size
# 0 means never rotates log file by log file size
# default value is 0
# since V4.02
rotate_error_log_size = 0

# keep days of the log files
# 0 means do not delete old log files
# default value is 0
log_file_keep_days = 0

# if skip the invalid record when sync file
# default value is false
# since V4.02
file_sync_skip_invalid_record=false

# if use connection pool
# default value is false
# since V4.05
use_connection_pool = false

# connections whose the idle time exceeds this time will be closed
# unit: second
# default value is 3600
# since V4.05
connection_pool_max_idle_time = 3600

# use the ip address of this storage server if domain_name is empty,
# else this domain name will ocur in the url redirected by the tracker server
http.domain_name=

# the port of the web server on this storage server
http.server_port=8888

6. tracker.conf配置

# is this config file disabled
# false for enabled
# true for disabled
disabled=false

# bind an address of this host
# empty for bind all addresses of this host
bind_addr=

# the tracker server port
port=22122

# connect timeout in seconds
# default value is 30s
connect_timeout=10

# network timeout in seconds
# default value is 30s
network_timeout=60

# the base path to store data and log files
base_path=/fastdfs/tracker

# max concurrent connections this server supported
# you should set this parameter larger, eg. 102400
max_connections=1024

# accept thread count
# default value is 1
# since V4.07
accept_threads=1

# work thread count, should <= max_connections
# default value is 4
# since V2.00
work_threads=4

# min buff size
# default value 8KB
min_buff_size = 8KB

# max buff size
# default value 128KB
max_buff_size = 128KB

# the method of selecting group to upload files
# 0: round robin
# 1: specify group
# 2: load balance, select the max free space group to upload file
store_lookup=0

# which group to upload file
# when store_lookup set to 1, must set store_group to the group name
store_group=group2

# which storage server to upload file
# 0: round robin (default)
# 1: the first server order by ip address
# 2: the first server order by priority (the minimal)
# Note: if use_trunk_file set to true, must set store_server to 1 or 2
store_server=0

# which path(means disk or mount point) of the storage server to upload file
# 0: round robin
# 2: load balance, select the max free space path to upload file
store_path=0

# which storage server to download file
# 0: round robin (default)
# 1: the source storage server which the current file uploaded to
download_server=0

# reserved storage space for system or other applications.
# if the free(available) space of any stoarge server in 
# a group <= reserved_storage_space, 
# no file can be uploaded to this group.
# bytes unit can be one of follows:
### G or g for gigabyte(GB)
### M or m for megabyte(MB)
### K or k for kilobyte(KB)
### no unit for byte(B)
### XX.XX% as ratio such as reserved_storage_space = 10%
reserved_storage_space = 10%

#standard log level as syslog, case insensitive, value list:
### emerg for emergency
### alert
### crit for critical
### error
### warn for warning
### notice
### info
### debug
log_level=info

#unix group name to run this program, 
#not set (empty) means run by the group of current user
run_by_group=

#unix username to run this program,
#not set (empty) means run by current user
run_by_user=

# allow_hosts can ocur more than once, host can be hostname or ip address,
# "*" (only one asterisk) means match all ip addresses
# we can use CIDR ips like 192.168.5.64/26
# and also use range like these: 10.0.1.[0-254] and host[01-08,20-25].domain.com
# for example:
# allow_hosts=10.0.1.[1-15,20]
# allow_hosts=host[01-08,20-25].domain.com
# allow_hosts=192.168.5.64/26
allow_hosts=*

# sync log buff to disk every interval seconds
# default value is 10 seconds
sync_log_buff_interval = 10

# check storage server alive interval seconds
check_active_interval = 120

# thread stack size, should >= 64KB
# default value is 64KB
thread_stack_size = 64KB

# auto adjust when the ip address of the storage server changed
# default value is true
storage_ip_changed_auto_adjust = true

# storage sync file max delay seconds
# default value is 86400 seconds (one day)
# since V2.00
 -ef | grep fdfstorage_sync_file_max_delay = 86400

# the max time of storage sync a file
# default value is 300 seconds
# since V2.00
storage_sync_file_max_time = 300

# if use a trunk file to store several small files
# default value is false
# since V3.00
use_trunk_file = false 

# the min slot size, should <= 4KB
# default value is 256 bytes
# since V3.00
slot_min_size = 256

# the max slot size, should > slot_min_size
# store the upload file to trunk file when it's size <=  this value
# default value is 16MB
# since V3.00
slot_max_size = 16MB

# the trunk file size, should >= 4MB
# default value is 64MB
# since V3.00
trunk_file_size = 64MB

# if create trunk file advancely
# default value is false
# since V3.06
trunk_create_file_advance = false

# the time base to create trunk file
# the time format: HH:MM
# default value is 02:00
# since V3.06
trunk_create_file_time_base = 02:00

# the interval of create trunk file, unit: second
# default value is 38400 (one day)
# since V3.06
trunk_create_file_interval = 86400

# the threshold to create trunk file
# when the free trunk file size less than the threshold, will create 
# the trunk files
# default value is 0
# since V3.06
trunk_create_file_space_threshold = 20G

# if check trunk space occupying when loading trunk free spaces
# the occupied spaces will be ignored
# default value is false
# since V3.09
# NOTICE: set this parameter to true will slow the loading of trunk spaces 
# when startup. you should set this parameter to true when neccessary.
trunk_init_check_occupying = false

# if ignore storage_trunk.dat, reload from trunk binlog
# default value is false
# since V3.10
# set to true once for version upgrade when your version less than V3.10
trunk_init_reload_from_binlog = false

# the min interval for compressing the trunk binlog file
# unit: second
# default value is 0, 0 means never compress
# FastDFS compress the trunk binlog when trunk init and trunk destroy
# recommand to set this parameter to 86400 (one day)
# since V5.01
trunk_compress_binlog_min_interval = 0

# if use storage ID instead of IP address
# default value is false
# since V4.00
use_storage_id = false

# specify storage ids filename, can use relative or absolute path
# since V4.00
storage_ids_filename = storage_ids.conf

# id type of the storage server in the filename, values are:
## ip: the ip address of the storage server
## id: the server id of the storage server
# this paramter is valid only when use_storage_id set to true
# default value is ip
# since V4.03
id_type_in_filename = ip

# if store slave file use symbol link
# default value is false
# since V4.01
store_slave_file_use_link = false

# if rotate the error log every day
# default value is false
# since V4.02
rotate_error_log = false

# rotate error log time base, time format: Hour:Minute
# Hour from 0 to 23, Minute from 0 to 59
# default value is 00:00
# since V4.02
error_log_rotate_time=00:00

# rotate error log when the log file exceeds this size
# 0 means never rotates log file by log file size
# default value is 0
# since V4.02
rotate_error_log_size = 0

# keep days of the log files
# 0 means do not delete old log files
# default value is 0
log_file_keep_days = 0

# if use connection pool
# default value is false
# since V4.05
use_connection_pool = false

# connections whose the idle time exceeds this time will be closed
# unit: second
# default value is 3600
# since V4.05
connection_pool_max_idle_time = 3600

# HTTP port on this tracker server
http.server_port=8080

# check storage HTTP server alive interval seconds
# <= 0 for never check
# default value is 30
http.check_alive_interval=30

# check storage HTTP server alive type, values are:
#   tcp : connect to the storge server with HTTP port only, 
#        do not request and get response
#   http: storage check alive url must return http status 200
# default value is tcp
http.check_alive_type=tcp

# check storage HTTP server alive uri/url
# NOTE: storage embed HTTP server support uri: /status.html
http.check_alive_uri=/status.html

7. client.conf配置

# connect timeout in seconds
# default value is 30s
connect_timeout=30

# network timeout in seconds
# default value is 30s
network_timeout=60

# the base path to store log files
base_path=/fastdfs/tracker

# tracker_server can ocur more than once, and tracker_server format is
#  "host:port", host can be hostname or ip address
tracker_server=10.39.46.34:22122

#standard log level as syslog, case insensitive, value list:
### emerg for emergency
### alert
### crit for critical
### error
### warn for warning
### notice
### info
### debug
log_level=info

# if use connection pool
# default value is false
# since V4.05
use_connection_pool = false

# connections whose the idle time exceeds this time will be closed
# unit: second
# default value is 3600
# since V4.05
connection_pool_max_idle_time = 3600

# if load FastDFS parameters from tracker server
# since V4.05
# default value is false
load_fdfs_parameters_from_tracker=false

# if use storage ID instead of IP address
# same as tracker.conf
# valid only when load_fdfs_parameters_from_tracker is false
# default value is false
# since V4.05
use_storage_id = false

# specify storage ids filename, can use relative or absolute path
# same as tracker.conf
# valid only when load_fdfs_parameters_from_tracker is false
# since V4.05
storage_ids_filename = storage_ids.conf


#HTTP settings
http.tracker_server_port=80

#use "#include" directive to include HTTP other settiongs
##include http.conf


 

浮生梦浮生
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
centos系统上安装fastdfs
08-24
CentOS 系统上安装 FastDFS FastDFS 是一个开源的分布式文件系统，能够提供高性能、高可靠性和高扩展性的文件存储服务。下面是 CentOS 系统上安装 FastDFS 的详细步骤和相关知识点。 安装 libfastcommon ...
centos安装FastDFS.md
05-12
centos安装FastDFS.md
FastDFS扩展存储
qq_41303447的博客
12-01 2073
FastDFS扩展存储
Ubuntu配置fastfds时报错error:request for member 'path' in something not a structure or union
GMCN的博客
03-13 1727
具体报错信息 make 出现的/common.c:1088:42: error: request for member ‘path’ in something not a structure or union pStorePaths->paths[store_path_index].path, 解决办法 需要将FastDFS升级到v6.03及以上版本，建议使用v6.04。 贴下 HIST...
CentOS7安装 fastDFS 教程
最新发布
weixin_62632929的博客
04-21 1169
在一台主机上部署 fastDFS 文件系统的 tracker 服务器和 storage 服务器，提供了搭建 fastDFS 系统的示例。
CentOs搭建fastdfs服务器
空明的博客
08-21 885
centos搭建fastdfs服务器（单机部署）
FastDFS安装教程
weixin_45853582的博客
07-10 6019
FastDFS安装教程
Fastdfs集群部署以及基本操作
无名小生
04-12 730
FastDFS引言 本地存储与分布式文件系统 本地存储的缺点： 是否有备份？ 没有 成本角度？ 贵 ​ 服务器 ：用于计算 ---- cpu/内存 ​ 用于存储 ---- 硬盘大 存储瓶颈？ 容量有限 是否使用于应用服务器的集群环境？ 不适用 。。。等等 解决本地存储的缺点 : 使用分布式文件系统 — 引入存储服务的概念 支持冗余备份；可以增加节点，所以理论上没有瓶颈；支持集群环境；支持负载均衡特性，可以在一个存储节点压力大时，将请求分给其他存储节点。 数据存储的方式： 关系型数据库(mysql,orac
centos安装FastDFS.docx
04-29
在CentOS系统中安装FastDFS是一项基础的系统管理和运维任务，尤其对于那些需要构建分布式文件存储系统的用户来说。FastDFS是一个开源的、轻量级的高性能文件系统，它设计用于互联网应用，支持高并发访问和大容量存储...
CentOS6.5下安装fastDFS
12-06
自己整理的fastDFS安装文档，可能存在不完整的地方，需结合自己实际状况做调整
Centos6安装FastDFS分布式全套软件.zip
05-11
fastdfs-nginx-module_v1.16.tar.gz, FastDFS_v4.06.tar.gz libevent-headers-1.4.13-4.el6.noarch.rpm libevent-doc-1.4.13-4.el6.noarch.rpm libevent-devel-1.4.13-4.el6.x86_64.rpm nginx-1.7.10.tar.gz
Linux Centos7.5 安装FastDFS所需软件
11-21
FastDFS是一个开源的轻量级分布式文件系统，它对文件进行管理，功能包括：文件存储、文件同步、文件访问（文件上传、文件下载）等，解决了大容量存储和负载均衡的问题。
fastDFS所需要的软件CentOS7
01-15
fastDFS所需的软件，可以安装运行，亲测，文档在网上找一个就ok，软件相关的都在压缩包内
CentOS7离线安装fastdfs包
04-07
CentOS7离线安装fastdfs包，配合博客步骤使用
CentOS7安装FastDFS-单机版亲测
01-20
FastDFS是一款开源的轻量级分布式文件系统纯C实现，支持Linux、FreeBSD等UNIX系统类google FS，...安装介质：  fastdfs-master.zip  libfastcommon-master.zip  fastdfs-nginx-module-master.zip  下载地址：  
centos7安装FastDFS_v5.08及配置
10-26
在Centos7的环境下完成FastDFS的环境搭建，提供完整的操作步骤手册及所需要的资源包，仅供大家学习参考
fdfs文件服务环境搭建详细教程
~~~~~~~BUG FLY~~~~~~~~~
05-13 2045
前言 Linux环境搭建少不了FastDFS的安装，本文记录Linux环境下安装fdfs的步骤。 一、安装包和环境准备 1.所需安装包 将安装包上传至服务器 2.编译环境 环境安装好的跳过此步骤 yum install git gcc gcc-c++ make automake autoconf libtool pcre pcre-devel zlib zlib-devel openssl-devel wget vim -y 3.创建目录 mkdir data mkdir fastdfs 在data目
centos7 fastdfs 5.0.5 离线安装
m0_37566009的博客
09-21 590
centos7 fastdfs 5.0.5 离线安装
centOs安装fastdfs
11-09
是在CentOS上安装FastDFS的步骤： 1. 安装依赖库和工具： ```shell yum install -y wget gcc gcc-c++ make automake autoconf libtool pcre pcre-devel zlib zlib-devel openssl openssl-devel ``` 2. 下载FastDFS： ```shell wget https://github.com/happyfish100/fastdfs/archive/V5.11.tar.gz ``` 3. 解压并编译FastDFS： ```shell tar -zxvf V5.11.tar.gz cd fastdfs-5.11/ ./make.sh ./make.sh install ``` 4. 配置Tracker服务器： ```shell cp /etc/fdfs/tracker.conf.sample /etc/fdfs/tracker.conf ``` 编辑tracker.conf文件，修改以下配置： ```shell base_path=/var/fdfs/tracker port=22122 ``` 5. 配置Storage服务器： ```shell cp /etc/fdfs/storage.conf.sample /etc/fdfs/storage.conf ``` 编辑storage.conf文件，修改以下配置： ```shell base_path=/var/fdfs/storage store_path0=/var/fdfs/storage tracker_server=10.39.XX.XX:22122 ``` 6. 配置客户端： ```shell cp /etc/fdfs/client.conf.sample /etc/fdfs/client.conf ``` 编辑client.conf文件，修改以下配置： ```shell base_path=/var/fdfs/client tracker_server=10.39.XX.XX:22122 ``` 7. 启动Tracker和Storage服务器： ```shell /usr/bin/fdfs_trackerd /etc/fdfs/tracker.conf start /usr/bin/fdfs_storaged /etc/fdfs/storage.conf start ``` 8. 测试FastDFS是否安装成功： ```shell /usr/bin/fdfs_test ```

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值