1. 程式人生 > >lvs + keepalived + nginx 實現高可用

lvs + keepalived + nginx 實現高可用

1.目的

 lvs是四層的負載均衡,keepalived為lvs提供高可用服務,同時檢查後端nginx的健康狀態,nginx主要用來做七層的負載均衡

2.拓撲圖

lvs + keepalived + nginx 實現高可用

伺服器 IP地址    說明
Director主節點 192.168.3.105  lvs keepalived
Director備節點 192.168.3.104   lvs keepalived
Real server1:   192.168.3.106:89    nginx
Real server1:   192.168.3.107:89    nginx
vip     192.168.3.114   vip只需要還沒有分配出去的ip,不需要分配磁碟、cpu

3.軟體

keepalived-1.4.2.tar.gz
ipvsadm-1.27-7.el7.x86_64.rpm
nginx-1.12.2.tar.gz

4.安裝步驟
4.1更改伺服器名

hostnamectl set-hostname lvs01(3.105)
hostnamectl set-hostname lvs02 (3.104)
hostnamectl set-hostname rs01(3.107)
hostnamectl set-hostname rs02 (3.106)

4.2關閉防火牆和selinux

firewall-cmd --state
systemctl stop firewalld.service
systemctl disable firewalld.service
sed -i 's/^ *SELINUX=disabled/SELINUX=disabled/g' /etc/selinux/config
setenforce 0

4.3ipvs安裝(192.168.3.105,192.168.3.104)

yum install ipvsadm( yum install --downloadonly ipvsadm(下載安裝包)rpm -ivh ipvsadm*)
ipvsadm
lsmod | grep ip_vs

4.4 在2臺 rs 上配置指令碼(192.168.3.106,192.168.3.107)

#! /bin/bash
vip=192.168.3.114
ifconfig lo:0 $vip broadcast $vip netmask 255.255.255.255 up
route add -host $vip lo:0
echo "1" >/proc/sys/net/ipv4/conf/lo/arp_ignore
echo "2" >/proc/sys/net/ipv4/conf/lo/arp_announce
echo "1" >/proc/sys/net/ipv4/conf/all/arp_ignore
echo "2" >/proc/sys/net/ipv4/conf/all/arp_announce
在lvs兩臺上分別執行bash /usr/local/sbin/lvs_dr_rs.sh

4.5keepalived安裝

yum -y install openssl openssl-devel  
yum -y install libnl libnl-devel
yum install -y libnfnetlink-devel

./configure --prefix=/usr/local/keepalived
make
make install

cp /usr/local/keepalived/etc/sysconfig/keepalived /etc/sysconfig/
cp /usr/local/keepalived/sbin/keepalived /usr/sbin/keepalived
mkdir /etc/keepalived
cp /usr/local/keepalived/etc/keepalived/keepalived.conf /etc/keepalived/
cp /usr/local/keepalived/etc/init.d/keepalived /etc/init.d/

4.6keepalived配置

192.168.3.105
vrrp_instance VI_1 {
    state MASTER
interface ens160
virtual_router_id 51
    priority 100
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.3.114
    }
}

virtual_server 192.168.3.114 89 {
    delay_loop 6
    lb_algo rr
    lb_kind DR
    persistence_timeout 0
    protocol TCP

    real_server 192.168.3.106 89 {
        weight 1
        TCP_CHECK {
            connect_timeout 10
            nb_get_retry 3
            delay_before_retry 3
            connect_port 89
        }
    }

    real_server 192.168.3.107 89 {
        weight 1
        TCP_CHECK {
            connect_timeout 10
            nb_get_retry 3
            delay_before_retry 3
            connect_port 89
        }
    }
}
192.168.3.104
vrrp_instance VI_1 {
    state BACKUP
    interface ens160
    virtual_router_id 51
    priority 90
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.3.114
    }
}

virtual_server 192.168.3.114 89 {
    delay_loop 6
    lb_algo rr
    lb_kind DR
    persistence_timeout 0
    protocol TCP

    real_server 192.168.3.106 89 {
        weight 1
        TCP_CHECK {
            connect_timeout 10
            nb_get_retry 3
            delay_before_retry 3
            connect_port 89
        }
    }

    real_server 192.168.3.107 89 {
        weight 1
        TCP_CHECK {
            connect_timeout 10
            nb_get_retry 3
            delay_before_retry 3
            connect_port 89
        }
    }
}
keepalived的2個節點執行如下命令,開啟轉發功能
echo 1 > /proc/sys/net/ipv4/ip_forward
先主後從分別啟動keepalive
service keepalived start

5.驗證
5.1lvs負載均衡

手動關閉192.168.3.107的nginx
不再出現107

重新開啟nginx
107又出現了

5.2 驗證keepalived高可用

此時vip192.168.3.114在192.168.3.1105上

模擬宕機,關閉192.168.3.105的keepalived,192.168.3.114漂移到了備用節點192.168.3.104

仍然可以正常訪問

6.參考
https://www.cnblogs.com/liwei0526vip/p/6370103.html