在上次實驗“saltstsck自動化運維工具實現負載均衡”的基礎上，也就是在server3端配置實現server4端的httpd和server5端的nginx負載均衡，繼續進行操作實現高可用：
（本文所有主機ip均為172.25.17網段，主機名和ip相對應。比如172.25.17.3對應server3，並且所有salt包和python包需要自行下載並配置到yum源中）
環境： linxu 6.5
配置：
server3： 172.25.17.3 服務：keepalived、 salt-master、 haproxy
server4： 172.25.17.4 服務：httpd、 salt-minion
server5： 172.25.17.5 服務：nginx、 salt-minion
server6： 172.25.17.6 服務：keepalived、 salt-minion、haproxy
大體思想：

在實現server4端httpd和server5端nginx負載均衡的基礎上，新建一個master-minion端server6。通過在server3端建立install.sls的yml指令碼並推送給server6實現server6端keepalived的安裝。接著將server6端的keepalived配置檔案和啟動指令碼發到server3端。server3端新建指令碼service.sls設定對keepalived的相關配置。編輯指令碼檔案，按照主機名寫入對應的變數，再將這些變數應用到server3端的keepalived配置檔案中並進行keepalived的相關配置。最後在top.sls指令碼檔案中針對不同的主機推送不同的指令碼檔案進行不同的服務配置，推送top.sls指令碼實現高可用負載均衡。

具體實現

server3端/srv目錄結構：

[[email protected] srv]# tree .
.
├── pillar
│   ├── keepalived
│   │   └── install.sls
│   ├── top.sls
│   └── web
│       └── install.sls
└── salt
    ├── files
    ├── _grains
    │   └── my_grains.py
    ├── haproxy
    │   ├── files
    │   │   └── haproxy.cfg
    │   └── install.sls
 

    ├── httpd
    │   ├── files
    │   │   └── httpd.conf
    │   ├── install.sls
    │   └── lib.sls
    ├── keepalived
    │   ├── files
    │   │   ├── keepalived
    │   │   ├── keepalived-2.0.6.tar.gz
    │   │   └── keepalived.conf
    │   ├── install.sls
    │   └── service.sls
    ├── nginx
    │   ├── files
    │   │   ├── nginx
    │   │   ├── nginx-1.14.0.tar.gz
    │   │   └── nginx.conf
    │   ├── install.sls
    │   ├── make.sls
    │   ├── nginx.sls
    │   └── service.sls
    └── top.sls

1.要使用keepalived實現高可用，首先將需要新建salt-minion伺服器server6並配置master為172.25.17.3（具體操作參見上面連結）。並在server6端的yum源中配置負載均衡模組，否則keepalived無法安裝：

  1 [rhel-source]
  2 name=Red Hat Enterprise Linux $releasever - $basearch - Source
  3 baseurl=http://172.25.17.250/source6.5
  4 enabled=1
  5 gpgcheck=1
  6 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
  7 
  8 [saltstack]
  9 name=saltstack
 10 baseurl=http://172.25.17.250/rhel6
 11 gpgcheck=0
 12 
 13 [LoadBalancer]   #加入負載均衡模組包
 14 name=LoadBalancer
 15 baseurl=http://172.25.17.250/source6.5/LoadBalancer
 16 gpgcheck=0

2.在server3端的/srv/salt目錄下新建目錄keepalived及其子目錄files，並將keepalived壓縮包放在這裡：

[root@server3 nginx]# cd /srv/salt/
[root@server3 salt]# mkdir keepalived/files -p
[root@server3 salt]# ls keepalived/files/
keepalived-2.0.6.tar.gz

進入keepalived目錄新建指令碼檔案install.sls：

[root@server3 salt]# cd keepalived/
[root@server3 keepalived]# vim install.sls

指令碼內容：
實現keepalived的在server6端的安裝：

  1 include:
  2   - nginx.make    #將make.sls指令碼匯入，這個指令碼功能是進行依賴包安裝
  3 
  4 kp-install:
  5   file.managed:
  6     - name: /mnt/keepalived-2.0.6.tar.gz
  7     - source: salt://keepalived/files/keepalived-2.0.6.tar.gz
  8   cmd.run:
  9     - name: cd /mnt && tar zxf keepalived-2.0.6.tar.gz && cd keepalived-2.0.    6 && ./configure --prefix=/usr/local/keepalived --with-init=SYSV &> /dev/nul    l && make &> /dev/null && make install &> /dev/null
 10     - creates: /usr/local/keepalived

make.sls指令碼內容：

  1 make-depends:
  2   pkg.installed:
  3     - pkgs:
  4       - pcre-devel
  5       - openssl-devel
  6       - gcc
  7       - mailx

將install.sls指令碼推送到server6端進行安裝keepalived：

[root@server3 keepalived]# salt server6 state.sls keepalived.install

**3.**server6端keepalived安裝成功之後，將keepalived配置檔案傳送到servre3端的/srv/salt/keepalied/files目錄下：

[root@server6 init.d]# cd /usr/local/keepalived/etc/keepalived/
[root@server6 keepalived]# ls
keepalived.conf  samples
[root@server6 keepalived]# scp keepalived.conf server3:/srv/salt/keepalived/files/

同樣將keepalived的啟動指令碼放到這個目錄下：

[[email protected] yum.repos.d]# cd /usr/local/keepalived/etc/rc.d/init.d/
[[email protected] init.d]# scp keepalived server3:/srv/salt/keepalived/files

4.在server3端/srv/salt.keepalived目錄下新建指令碼檔案service.sls：

[root@server3 keepalived]# vim service.sls

指令碼內容：

  1 include:
  2   - keepalived.install   #將剛才新建的指令碼檔案install.sls匯入
  3 
  4 /etc/keepalived/keepalived.conf:
  5   file.managed:
  6     - source: salt://keepalived/files/keepalived.conf
  7     - template: jinja    #匯入jinja模板
  8     - context:
  9       STATE: {{ pillar['state'] }}         #引用變數，變數在後面有新建，也可以新建變數再寫入引用變數這部分
 10       VRID: {{ pillar['vrid'] }}           #引用變數
 11       PRIORITY: {{ pillar['priority'] }}   #引用變數
 12 
 13 kp-service:
 14   file.managed:
 15     - name: /etc/init.d/keepalived
 16     - source: salt://keepalived/files/keepalived
 17     - mode: 755
 18   service.running:
 19     - name: keepalived
 20     - reload: True
 21     - watch:
 22       - file: /etc/keepalived/keepalived.conf

5.進入到/srv/pillar目錄下新建目錄keepalived，並將web目錄中的install.sls檔案複製過來並編輯：

[root@server3 keepalived]# cd /srv/pillar/
[root@server3 pillar]# ls
top.sls  web
[root@server3 pillar]# mkdir keepalived
[root@server3 pillar]# cd keepalived/
[root@server3 keepalived]# cp ../web/install.sls .
[root@server3 keepalived]# vim install.sls 

編輯install.sls新建變數:

  1 {% if grains['fqdn'] == 'server3' %}
  2 state: MASTER     #新建變數
  3 vrid: 17
  4 priority: 100
  5 {% elif grains['fqdn'] == 'server6' %}
  6 state: BACKUP     #新建變數
  7 vrid: 17
  8 priority: 50
  9 {% endif %}

6.在server3端編輯keepalived的配置檔案：

[root@server3 keepalived]# vim files/keepalived.conf 

修改配置檔案：

  1 ! Configuration File for keepalived
  2 
  3 global_defs {
  4    notification_email {
  5      [email protected]
  6    }
  7    notification_email_from [email protected]
  8    smtp_server 127.0.0.1
  9    smtp_connect_timeout 30
 10    router_id LVS_DEVEL
 11    vrrp_skip_check_adv_addr
 12    #vrrp_strict
 13    vrrp_garp_interval 0
 14    vrrp_gna_interval 0
 15 }
 16 
 17 vrrp_instance VI_1 {
 18     state {{ STATE }}   #引用變數
 19     interface eth0
 20     virtual_router_id {{ VRID }}
 21     priority {{ PRIORITY }}
 22     advert_int 1
 23     authentication {
 23     authentication {
 24         auth_type PASS
 25         auth_pass 1111
 26     }
 27     virtual_ipaddress {
 28         172.25.17.100    #設定VIP
 29     }
 30 }
 31 
後面的內容全部刪除

7.編輯/srv/sakt目錄下的top.sls檔案：

[root@server3 salt]# vim top.sls 

內容：

  1 base:
  2   'server3':       #不同服務端推送不同指令碼
  3     - haproxy.install
  4     - keepalived.service
  5   'server6':
  6     - haproxy.install
  7     - keepalived.service
  8   'server4':
  9     - httpd.install
 10   'server5':
 11     - nginx.service

之後推送top.sls指令碼到所有服務端:

[root@server3 salt]# salt '*' state.highstate

測試：

訪問VIP實現負載均衡：


高可用測試：
停掉server3端keepalived服務：

[root@server3 salt]# /etc/init.d/keepalived stop
Stopping keepalived:                                       [  OK  ]

負載均衡依然可以實現，由於server3服務停掉了，所以在server6端接管了服務。可以看到VIP加到了server6端：

[root@server6 sysconfig]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
    link/ether 52:54:00:f2:65:82 brd ff:ff:ff:ff:ff:ff
    inet 172.25.17.6/24 brd 172.25.17.255 scope global eth0
    inet 172.25.17.100/32 scope global eth0   #VIP加到了server6端
    inet6 fe80::5054:ff:fef2:6582/64 scope link 
       valid_lft forever preferred_lft forever