2. 程式人生 > >FastDFS集群tracker實現負載均衡

FastDFS集群tracker實現負載均衡

阿新 • • 發佈：2017-06-27
fastdfs

簡單介紹：


FastDFS作者余慶，是一套開源的分布式文件系統。


功能：文件存儲、同步、上傳、下載，提供負載均衡功能，適合用於圖片、視頻的存放。


角色：


tracker


作用：任務調度接受客戶端的訪問，檢索存儲節點，為客戶端提供一臺可用的storage。


storage


作用：接受Tracker的調度，響應客戶端請求，將客戶端發來的文件存儲至相應存儲位置，讀取請求的文件，發送給客戶端。


以下使用三臺虛擬機搭建實驗環境:


三臺機器充當存儲節點，其中兩臺配置tracker做主備關系同時充當storage角色，當一臺tracker down機後另外一臺可以提供正常的訪問連接。


tracker01： 192.168.56.101

tracker02： 192.168.56.102

storage03：192.168.56.103


準備工作：


OS: CentoOS6.8

在所有節點上安裝依賴庫：

yum install -y gcc libevent libevent-doc libevent-devel libevent-headers make


所需軟件包：

FastDFS_v4.06.tar.gz

fastdfs-nginx-module_v1.15.tar.gz (配置web訪問時需要nginx支持此模塊)

開始：第一步

[[email protected] ~]# tar -xf FastDFS_v4.06.tar.gz
[[email protected]
/* */ ~]# cd FastDFS [[email protected] FastDFS]# ll total 124 drwxrwxr-x. 3 nginx nginx 4096 Feb 15 2013 client drwxrwxr-x. 2 nginx nginx 4096 Feb 15 2013 common drwxrwxr-x. 2 nginx nginx 4096 Feb 15 2013 conf -rw-rw-r--. 1 nginx nginx 35067 Jul 28 2008 COPYING-3_0.txt -rw-rw-r--. 1 nginx nginx 28437 Jan 24 2013 HISTORY drwxrwxr-x. 2 nginx nginx 4096 Feb 15 2013 init.d -rw-rw-r--. 1 nginx nginx 7757 Dec 23 2011 INSTALL -rwxrwxr-x. 1 nginx nginx 5133 Dec 27 2012 make.sh drwxrwxr-x. 2 nginx nginx 4096 Feb 15 2013 php_client -rw-rw-r--. 1 nginx nginx 2380 Jul 28 2008 README -rwxrwxr-x. 1 nginx nginx 1768 Apr 12 2010 restart.sh -rwxrwxr-x. 1 nginx nginx 1680 Apr 10 2010 stop.sh drwxrwxr-x. 4 nginx nginx 4096 Feb 15 2013 storage drwxrwxr-x. 2 nginx nginx 4096 Feb 15 2013 test drwxrwxr-x. 2 nginx nginx 4096 Feb 15 2013 tracker [[email protected]
/* */ FastDFS]# ./make.sh && ./make.sh install [[email protected] FastDFS]# cp conf/storage_ids.conf /etc/fdfs/ [[email protected] FastDFS]# cp init.d/fdfs_trackerd /etc/init.d #拷貝tracker啟動文件 [[email protected] FastDFS]# cp init.d/fdfs_storaged /etc/init.d #拷貝storage啟動文件

建議：編譯前請先閱讀INSTALL file

第二步：創建數據目錄

mkdir -p /data/fastdfs/tracker #創建tracker文件存放路徑
mkdir -p /data/fastdfs/storage #創建storage 文件存放路徑
mkdir -p /data/fastdfs/client  #創建client 文件存放路徑


第三步：修改配置文件

[[email protected] fdfs]# ll
total 64
-rw-r--r--. 1 root root  1500 Jun 26 14:36 client.conf
-rw-r--r--. 1 root root   858 Jun 23 15:42 http.conf
-rw-r--r--. 1 root root 31172 Jun 23 15:42 mime.types
-rw-r--r--. 1 root root  3898 Jun 26 15:35 mod_fastdfs.conf
-rw-r--r--. 1 root root  7496 Jun 26 15:22 storage.conf
-rw-r--r--. 1 root root   171 Jun 26 15:45 storage_ids.conf
-rw-r--r--. 1 root root  6624 Jun 26 16:04 tracker.conf
#以上目錄處mod_fastdfs.conf文件外如缺少其他文件請檢查 libevent 是否安裝

[[email protected] fdfs]# grep -vE "^#|^$" tracker.conf

disabled=false
bind_addr=
port=22122
connect_timeout=30
network_timeout=60
base_path=/data/fastdfs/tracker
max_connections=4096
work_threads=4
store_lookup=0
store_server=0
store_path=0
download_server=0
reserved_storage_space = 10%
log_level=info
run_by_group=
run_by_user=
allow_hosts=*
sync_log_buff_interval = 10
check_active_interval = 120
thread_stack_size = 64KB
storage_ip_changed_auto_adjust = true
storage_sync_file_max_delay = 86400
storage_sync_file_max_time = 300
use_trunk_file = false
slot_min_size = 256
slot_max_size = 16MB
trunk_file_size = 64MB
trunk_create_file_advance = false
trunk_create_file_time_base = 02:00
trunk_create_file_interval = 86400
trunk_create_file_space_threshold = 20G
trunk_init_check_occupying = false
trunk_init_reload_from_binlog = false
use_storage_id = false
storage_ids_filename = storage_ids.conf
id_type_in_filename = ip
store_slave_file_use_link = false
rotate_error_log = false
error_log_rotate_time=00:00
rotate_error_log_size = 0
use_connection_pool = false
connection_pool_max_idle_time = 3600
http.server_port=8080
http.check_alive_interval=30
http.check_alive_type=tcp
http.check_alive_uri=/status.html

#以上為配置文件內容，各參數的含義請自行了解。

cat /etc/fdfs/storage_ids.conf

[[email protected] fdfs]# cat storage_ids.conf
# <id>  <group_name>  <ip_or_hostname>
 100001   group1  192.168.56.101
 100002   group1  192.168.56.102
 100003   group1  192.168.56.103


[[email protected] fdfs]# grep -vE ‘^#|^$‘ client.conf

connect_timeout=30
network_timeout=60
base_path=/data/fastdfs/client
tracker_server=192.168.56.101:22122
tracker_server=192.168.56.102:22122
log_level=info
use_connection_pool = false
connection_pool_max_idle_time = 3600
load_fdfs_parameters_from_tracker=false
use_storage_id = false
storage_ids_filename = storage_ids.conf
http.tracker_server_port=8080



請在所有tracker主機修改/etc/fdfs/tracker.conf文件


請在所有storage主機修改/etc/fdfs/storage.conf文件

cat /etc/fdfs/storage.conf

[[email protected] fdfs]# grep -vE "^#|^$" storage.conf
disabled=false
group_name=group1
bind_addr=
client_bind=true
port=23000
connect_timeout=30
network_timeout=60
heart_beat_interval=30
stat_report_interval=60
base_path=/data/fastdfs/storage
max_connections=256
buff_size = 256KB
work_threads=4
disk_rw_separated = true
disk_reader_threads = 1
disk_writer_threads = 1
sync_wait_msec=50
sync_interval=0
sync_start_time=00:00
sync_end_time=23:59
write_mark_file_freq=500
store_path_count=1
store_path0=/data/fastdfs/storage
subdir_count_per_path=256
tracker_server=192.168.56.101:22122
tracker_server=192.168.56.102:22122
log_level=info
run_by_group=
run_by_user=
allow_hosts=*
file_distribute_path_mode=0
file_distribute_rotate_count=100
fsync_after_written_bytes=0
sync_log_buff_interval=10
sync_binlog_buff_interval=10
sync_stat_file_interval=300
thread_stack_size=512KB
upload_priority=10
if_alias_prefix=
check_file_duplicate=0
file_signature_method=hash
key_namespace=FastDFS
keep_alive=0
use_access_log = false
rotate_access_log = false
access_log_rotate_time=00:00
rotate_error_log = false
error_log_rotate_time=00:00
rotate_access_log_size = 0
rotate_error_log_size = 0
file_sync_skip_invalid_record=false
use_connection_pool = false
connection_pool_max_idle_time = 3600
http.domain_name=
http.server_port=8888


第四步：啟動tracker and storage

[[email protected] fdfs]# /etc/init.d/fdfs_trackerd start
[[email protected] fdfs]# /etc/init.d/fdfs_storaged start
[[email protected] fdfs]# ps -ef|grep fdfs
root      3157     1  0 11:55 ?        00:00:00 /usr/local/bin/fdfs_trackerd /etc/fdfs/tracker.conf
root      3188     1  0 11:56 ?        00:00:00 /usr/local/bin/fdfs_storaged /etc/fdfs/storage.conf
root      3217  2434  0 11:57 pts/0    00:00:00 grep fdfs
[[email protected] fdfs]#

註意：如果啟動失敗請查看日誌/data/fastdfs/tracker/logs/trackerd.log


至此：tracker和storage啟動完畢。


查看集群狀態：


[[email protected] ~]# /usr/local/bin/fdfs_monitor /etc/fdfs/storage.conf


[2017-06-27 12:02:31] DEBUG - base_path=/data/fastdfs/storage, connect_timeout=30, network_timeout=60, tracker_server_count=2, anti_steal_token=0, anti_steal_secret_key length=0, use_connection_pool=0, g_connection_pool_max_idle_time=3600s, use_storage_id=0, storage server id count: 0

server_count=2, server_index=0

tracker server is 192.168.56.101:22122

group count: 1

Group 1:
group name = group1
disk total space = 8447 MB
disk free space = 4924 MB
trunk free space = 0 MB
storage server count = 3
active server count = 1
storage server port = 23000
storage HTTP port = 8888
store path count = 1
subdir count per path = 256
current write server index = 0
current trunk file id = 0

Storage 1:
id = 192.168.56.101
ip_addr = 192.168.56.101 (Master) WAIT_SYNC
http domain =
version = 4.06
join time = 2017-06-26 15:22:46
up time = 2017-06-27 11:49:39
total storage = 0 MB
free storage = 0 MB
upload priority = 10
store_path_count = 1
subdir_count_per_path = 256
storage_port = 23000
storage_http_port = 8888
current_write_path = 0
source storage id=
if_trunk_server= 0
total_upload_count = 0
success_upload_count = 0
total_append_count = 0
success_append_count = 0
total_modify_count = 0
success_modify_count = 0
total_truncate_count = 0
success_truncate_count = 0
total_set_meta_count = 0
success_set_meta_count = 0
total_delete_count = 0
success_delete_count = 0
total_download_count = 0
success_download_count = 0
total_get_meta_count = 0
success_get_meta_count = 0
total_create_link_count = 0
success_create_link_count = 0
total_delete_link_count = 0
success_delete_link_count = 0
total_upload_bytes = 0
success_upload_bytes = 0
total_append_bytes = 0
success_append_bytes = 0
total_modify_bytes = 0
success_modify_bytes = 0
stotal_download_bytes = 0
success_download_bytes = 0
total_sync_in_bytes = 0
success_sync_in_bytes = 0
total_sync_out_bytes = 0
success_sync_out_bytes = 0
total_file_open_count = 0
success_file_open_count = 0
total_file_read_count = 0
success_file_read_count = 0
total_file_write_count = 0
success_file_write_count = 0
last_heart_beat_time = 1970-01-01 08:00:00
last_source_update = 1970-01-01 08:00:00
last_sync_update = 1970-01-01 08:00:00
last_synced_timestamp = 1970-01-01 08:00:00 (never synced)
Storage 2:
id = 192.168.56.102
ip_addr = 192.168.56.102 (Minion02) ACTIVE
http domain =
version = 4.06
join time = 2017-06-26 15:12:53
up time = 2017-06-27 11:50:08
total storage = 8447 MB
free storage = 4945 MB
upload priority = 10
store_path_count = 1
subdir_count_per_path = 256
storage_port = 23000
storage_http_port = 8888
current_write_path = 0
source storage id=
if_trunk_server= 0
total_upload_count = 6
success_upload_count = 6
total_append_count = 0
success_append_count = 0
total_modify_count = 0
success_modify_count = 0
total_truncate_count = 0
success_truncate_count = 0
total_set_meta_count = 6
success_set_meta_count = 6
total_delete_count = 0
success_delete_count = 0
total_download_count = 0
success_download_count = 0
total_get_meta_count = 0
success_get_meta_count = 0
total_create_link_count = 0
success_create_link_count = 0
total_delete_link_count = 0
success_delete_link_count = 0
total_upload_bytes = 63284
success_upload_bytes = 63284
total_append_bytes = 0
success_append_bytes = 0
total_modify_bytes = 0
success_modify_bytes = 0
stotal_download_bytes = 0
success_download_bytes = 0
total_sync_in_bytes = 120
success_sync_in_bytes = 120
total_sync_out_bytes = 240
success_sync_out_bytes = 240
total_file_open_count = 10
success_file_open_count = 10
total_file_read_count = 0
success_file_read_count = 0
total_file_write_count = 10
success_file_write_count = 10
last_heart_beat_time = 2017-06-27 12:02:14
last_source_update = 2017-06-27 12:01:01
last_sync_update = 2017-06-26 15:55:03
last_synced_timestamp = 1970-01-01 08:00:00 (never synced)
Storage 3:
id = 192.168.56.103
ip_addr = 192.168.56.103 (Minion03) WAIT_SYNC
http domain =
version = 4.06
join time = 2017-06-26 15:14:03
up time = 2017-06-27 11:50:25
total storage = 8447 MB
free storage = 4924 MB
upload priority = 10
store_path_count = 1
subdir_count_per_path = 256
storage_port = 23000
storage_http_port = 8888
current_write_path = 0
source storage id= 192.168.56.102
if_trunk_server= 0
total_upload_count = 2
success_upload_count = 2
total_append_count = 0
success_append_count = 0
total_modify_count = 0
success_modify_count = 0
total_truncate_count = 0
success_truncate_count = 0
total_set_meta_count = 2
success_set_meta_count = 2
total_delete_count = 0
success_delete_count = 0
total_download_count = 0
success_download_count = 0
total_get_meta_count = 0
success_get_meta_count = 0
total_create_link_count = 0
success_create_link_count = 0
total_delete_link_count = 0
success_delete_link_count = 0
total_upload_bytes = 22
success_upload_bytes = 22
total_append_bytes = 0
success_append_bytes = 0
total_modify_bytes = 0
success_modify_bytes = 0
stotal_download_bytes = 0
success_download_bytes = 0
total_sync_in_bytes = 995
success_sync_in_bytes = 240
total_sync_out_bytes = 120
success_sync_out_bytes = 120
total_file_open_count = 10
success_file_open_count = 10
total_file_read_count = 0
success_file_read_count = 0
total_file_write_count = 10
success_file_write_count = 10
last_heart_beat_time = 2017-06-27 12:02:10
last_source_update = 2017-06-26 15:54:52
last_sync_update = 2017-06-26 16:04:33
last_synced_timestamp = 1970-01-01 08:00:00 (never synced)



測試：


  1. 上傳文件至FastDFS，上傳多個文件至storage查看上傳位置是否有變化

  2. 停掉tracker01 查看是否切換至tracker02



上傳文件：

[[email protected] ~]# /usr/local/bin/fdfs_test /etc/fdfs/client.conf upload install.log



至此：end



如有問題歡迎留言探討。。。。3Q






本文出自 “蝸牛的嘲諷” 博客，請務必保留此出處http://imork.blog.51cto.com/11642843/1942342

FastDFS集群tracker實現負載均衡

相關推薦

FastDFS集群tracker實現負載均衡

fastdfs簡單介紹： FastDFS作者余慶，是一套開源的分布式文件系統。 功能：文件存儲、同步、上傳、下載，提供負載均衡功能，適合用於圖片、視頻的存放。角色：tracker 作用：任務調度接受客戶端的訪問，檢索存儲節點，為客戶端提供一臺可用的storage。storage 作用：接受Tracke

基於騰訊雲CLB實現K8S v1.10.1集群高可用+負載均衡

開源 可能 管理平臺 可用 st3 tab OS 1.10 style 概述： 最近對K8S非常感興趣,同時對容器的管理等方面非常出色，是一款非常開源，強大的容器管理方案,最後經過1個月的本地實驗，最終決定在騰訊雲平臺搭建屬於我們的K8S集群管理平臺~ 采購之後已經在本

0551-期中集群架構nginx負載均衡實踐

linux 一 環境準備服務器說明外網IP（NAT）內網IP（NAT）主機名稱規劃A1-nginx負載服務器0110.0.0.5/24172.16.1.5/24lb01A2-nginx負載服務器0210.0.0.6/24172.16.1.6/24lb02安裝反向代理，負載均衡就是安裝nginx，安裝ng

mariadb集群與nginx負載均衡配置--centos7版本

red listen 1.5 ike log-bin ati 主機 方便 openssl 這裏配置得是單nginx主機。。先準備4臺主機，三臺mariadb集群，一臺nginx。 -----------------------------------------------

Linux集群：搭建負載均衡集群(一)

LVS 負載均衡。 一、負載均衡介紹 主流開源軟件LVS、keepalived、haproxy、Nginx等； 其中LVS屬於4層（網絡OSI 7層模型），nginx屬於7層，haproxy既可以認為是4層，可以當做7層使用； keepalived的負載均衡功能其實就是lvs； lvs這種4層的負

使用haproxy實現負載均衡集群

backend body 失敗 內核版本 class ima 虛擬 運行 killall 一、HAProxy概述： 　　HAProxy提供高可用性、負載均衡以及基於TCP和HTTP應用的代理，支持虛擬主機，它是免費、快速並且可靠的一種解決方案。根據官方數據，其最高極限支持

Keepalived結合LVS-DR實現負載均衡高可用集群

table 開啟 strong 部署 toc ifconf cal 指向 protocol 簡介 Keepalived期初是專門針對LVS設計的一款強大的輔助工具，主要用來提供故障切換和健康檢查功能—判斷LVS負載調度器、節點服務器的可用性，及時隔離並替換新的服務器，當故障

架構之路：nginx與IIS服務器搭建集群實現負載均衡（二）

原創 not c盤 鏈接 發布 原創文章 hang 實戰 負載均衡 【前言】 在《架構之路：nginx與IIS服務器搭建集群實現負載均衡（一）》中小編簡單的講解了Nginx的原理！俗話說：光說不練假把式。接下來，小編就和大家一起來做個小Demo來體會一下Nginx的

架構之路：nginx與IIS服務器搭建集群實現負載均衡（三）

blog 存儲 bsp 知識 exe ESS 步驟 校驗 con 參考網址：https://blog.csdn.net/zhanghan18333611647/article/details/50811980 【前言】 在《架構之路：nginx與IIS服務器搭建集群

搭建服務器集群——Windows7系統中nginx與IIS服務器搭建集群實現負載均衡

文件 優化 安裝 ngnix nginx 忽略 總結 器） image 分布式，集群，雲計算機、大數據、負載均衡、高並發······當耳邊響起這些詞時，做為一個菜鳥程序猿無疑心中會激動一番（

lvs+keepalived實現負載均衡

keepalive 裝載 announce log loopback -s scheduler sad apr LVS簡介： lvs是負載均衡較常用的軟件之一，lvs官方提供了一個命名的約定： vip：虛擬ip地址，縮寫是vip，vip是負載均衡器對外提供服務的ip。 ri

Nginx配置upstream實現負載均衡

不同 實現負載均衡 不能 多臺 bake crc 實現 所有 crc32 Nginx可以配置代理多臺服務器，當一臺服務器宕機之後，仍能保持系統可用。 具體配置過程如下： 1. 在http節點下，添加upstream節點。 upstream linuxidc {

nginx+tomcat實現負載均衡以及session共享(linux centos7環境)

processes 解壓 smo eve cti 下載 gen cli -c 一、nginx的安裝 1.準備三份tomcat tomcat1 設置端口 8080 tomcat2 設置端口 8081 tomcat3 設置端口 8082 2. 下載nginx 3. 解壓到/ho

EG:nginx反向代理兩臺web服務器,實現負載均衡 所有的web服務共享一臺nfs的存儲

分享 代理服 /dev/ 負載均衡 chmod 修改 修改配置 防火墻 usr step1： 三臺web服務器環境配置：iptables -F; setenforce 0 關閉防火墻；關閉setlinux step2:三臺web服務器 裝軟件 step3:主機修改配置文件

Nginx 服務器 之Nginx與tomcat實現負載均衡

nobody 服務器 listen server events 本文講解我們如何使用Nginx做反向帶服務器，實現nginx與tomcat服務器集群做負載均衡。一、nginx與tomcat實現負載均衡1、在/usr/local/ngnix/conf 創建文件 nginx-tomcat.

Linux平臺雙網卡綁定技術實現負載均衡(網卡聚合)bonding

網卡綁定Linux平臺雙網卡綁定技術實現負載均衡保持服務器的高可用性是企業級 IT 環境的重要因素。其中最重要的一點是服務器網絡連接的高可用性。網卡（NIC）綁定技術有助於保證高可用性特性並提供其它優勢以提高網絡性能。 雙網卡綁定實現就是使用兩塊網卡虛擬成為一塊網卡，這個聚合起來的設備看起來是一個單獨的以太網

nginx實現負載均衡

nginx實現負載均衡1.修改nginx.conf配置文件,在http大括號中添加如下配置 upstream nginx { server 192.168.2.140:8080; server 192.168.2.136:8080; }2.修改server的location中的配置loc

Java + Tomcat + Memcached + Ecs 實現負載均衡~上

itl 說明 figure trying roo context use ges ip地址 前言: 公司的產品上線了, 對於大並發量的客戶訪問和對手的攻擊,真是苦不堪言,所以集群的部署重要,現在集群的部署一般有兩種方式,第一種,看到大部分人的做法一般是Nginx+Me

corosync+pacemaker+crmsh的高可用web集群的實現

corosync pacemaker crmsh httpd網絡規劃：node1：eth0：172.16.31.10/16node2: eth0: 172.16.31.11/16nfs: eth0: 172.16.31.12/15註：nfs在提供NFS服務的同時是一臺NTP服務器，可以讓node1和nod

heartbeat v2版CRM的高可用web集群的實現

heartbeat heartbeat v2 crm on上篇文章：heartbeat v1版CRM的高可用集群的實現集群架構圖 ： 主節點(172.16.31.10)客戶端(172.16.31.12) Vitual IP(172.16.3