Redis Cluster 添加/刪除完整折騰步驟

阿新 • • 發佈：2017-09-16

slot redis clust

Redis還是挺好玩的，今天測試了集群的添加、刪除節點、重分配slot等。更深入的理解redis的遊戲規則。步驟繁多，但是詳細。

環境解釋：

我是在一臺Centos 6.9上測試的，各個redis節點以端口號區分。文中針對各個redis，我只是以端口號代表。

~~~~Master Node~~~~~
172.16.32.116:7000
172.16.32.116:7001
172.16.32.116:7002
~~~~Slave Node~~~~~
172.16.32.116:8000
172.16.32.116:8001
172.16.32.116:8002
~~~~用來折騰的Node~~~~~
172.16.32.116:9000
172.16.32.116:9001

1. 創建redis集群

註：更多redis集群創建，請參閱

Redis Cluster集群部署搭建

# ./redis-trib.rb create --replicas 1 172.16.32.116:7000 172.16.32.116:7001 172.16.32.116:7002 172.16.32.116:8000 172.16.32.116:8001 172.16.32.116:8002
>>> Creating cluster
>>> Performing hash slots allocation on 6 nodes...
Using 3 masters:
172.16.32.116:7000
172.16.32.116:7001
172.16.32.116:7002
Adding replica 172.16.32.116:8000 to 172.16.32.116:7000
Adding replica 172.16.32.116:8001 to 172.16.32.116:7001
Adding replica 172.16.32.116:8002 to 172.16.32.116:7002
M: a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000
   slots:0-5460 (5461 slots) master
M: 273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001
   slots:5461-10922 (5462 slots) master
M: 88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002
   slots:10923-16383 (5461 slots) master
S: aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000
   replicates a0b91f48e933c1f1d427c54917ce970bd25d29f8
S: a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001
   replicates 273107e5ac994d675749be0979556e761274bb93
S: 3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002
   replicates 88fe075375295b59eabe69fa1438ed7c7c314f43
Can I set the above configuration? (type ‘yes‘ to accept): yes
>>> Nodes configuration updated
>>> Assign a different config epoch to each node
>>> Sending CLUSTER MEET messages to join the cluster
Waiting for the cluster to join...
>>> Performing Cluster Check (using node 172.16.32.116:7000)
M: a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000
   slots:0-5460 (5461 slots) master
M: 273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001
   slots:5461-10922 (5462 slots) master
M: 88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002
   slots:10923-16383 (5461 slots) master
M: aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000
   slots: (0 slots) master
   replicates a0b91f48e933c1f1d427c54917ce970bd25d29f8
M: a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001
   slots: (0 slots) master
   replicates 273107e5ac994d675749be0979556e761274bb93
M: 3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002
   slots: (0 slots) master
   replicates 88fe075375295b59eabe69fa1438ed7c7c314f43
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.

2. 檢查集群狀態

# ./redis-trib.rb check 172.16.32.116:7000
>>> Performing Cluster Check (using node 172.16.32.116:7000)
M: a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
M: 273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
S: 3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002
   slots: (0 slots) slave
   replicates 88fe075375295b59eabe69fa1438ed7c7c314f43
S: a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001
   slots: (0 slots) slave
   replicates 273107e5ac994d675749be0979556e761274bb93
S: aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000
   slots: (0 slots) slave
   replicates a0b91f48e933c1f1d427c54917ce970bd25d29f8
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.

~~~~~~~~~~~~~~~~~~~~~~~~~~~添加節點~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

3. 添加新節點redis-trib.rb add-node 新增節點名原集群節點名

# ./redis-trib.rb add-node 172.16.32.116:9000 172.16.32.116:7000
>>> Adding node 172.16.32.116:9000 to cluster 172.16.32.116:7000
>>> Performing Cluster Check (using node 172.16.32.116:7000)
M: a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
M: 273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
S: 3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002
   slots: (0 slots) slave
   replicates 88fe075375295b59eabe69fa1438ed7c7c314f43
S: a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001
   slots: (0 slots) slave
   replicates 273107e5ac994d675749be0979556e761274bb93
S: aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000
   slots: (0 slots) slave
   replicates a0b91f48e933c1f1d427c54917ce970bd25d29f8
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...

4. 查看當前集群狀態，9000是一個空的Master

# ./redis-cli  -p 9000 cluster nodes
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505321254767 1 connected 0-5460
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 master - 0 1505321250759 2 connected 5461-10922
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505321251761 3 connected 10923-16383
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505321255769 3 connected
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505321253765 1 connected
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505321256771 2 connected

5. 為9000分配slot， redis的solt是固定的，就16384個，只能從其他節點獲取slot，然後分配到9000

# ./redis-trib.rb reshard  172.16.32.116:9000
>>> Performing Cluster Check (using node 172.16.32.116:9000)
M: 364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000
   slots: (0 slots) master
   0 additional replica(s)
M: a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
S: 3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002
   slots: (0 slots) slave
   replicates 88fe075375295b59eabe69fa1438ed7c7c314f43
S: aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000
   slots: (0 slots) slave
   replicates a0b91f48e933c1f1d427c54917ce970bd25d29f8
M: 88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001
   slots: (0 slots) slave
   replicates 273107e5ac994d675749be0979556e761274bb93
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 
What is the receiving node ID? 364ae8322ab2627e25b05d45b702448c74afad10 Please enter all the source node IDs.
  Type ‘all‘ to use all the nodes as source nodes for the hash slots.
  Type ‘done‘ once you entered all the source nodes IDs.
Source node #1:all      
Ready to move 300 slots.
  Source nodes:
    M: a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
    M: 273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
    M: 88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
  Destination node:
    M: 364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000
   slots: (0 slots) master
   0 additional replica(s)
  Resharding plan:
    Moving slot 5461 from 273107e5ac994d675749be0979556e761274bb93
    Moving slot 5469 from 273107e5ac994d675749be0979556e761274bb93
Do you want to proceed with the proposed reshard plan (yes/no)? yes
Moving slot 5461 from 172.16.32.116:7001 to 172.16.32.116:9000:

6. 可以看到，9000已經分配到的slot是0-98 5461-5561 10923-11021

# ./redis-cli  -p 9000 cluster nodes
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505324905062 1 connected 99-5460
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 master - 0 1505324910075 2 connected 5562-10922
364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000 myself,master - 0 0 7 connected 0-98 5461-5561 10923-11021
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505324908070 3 connected
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505324911077 1 connected
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505324902057 3 connected 11022-16383
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505324909073 2 connected

~~~~~~~~~~~~~~~~~~~~~~~~~~~將9000變為slave~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

7. 希望將9000變成7000的slave，但是由於有slot，執行失敗，需要先轉移slot

# redis-cli -c -p 9000 cluster replicate a0b91f48e933c1f1d427c54917ce970bd25d29f8
(error) ERR To set a master the node must be empty and without assigned slots.

8. 刪除節點也是不可以的，總之，只要上面有slot。redis是不會讓你刪除的，而且需要人工介入，rebalance這些slot之後才行

# ./redis-trib.rb del-node 172.16.32.116:9000 364ae8322ab2627e25b05d45b702448c74afad10
>>> Removing node 364ae8322ab2627e25b05d45b702448c74afad10 from cluster 172.16.32.116:9000
[ERR] Node 172.16.32.116:9000 is not empty! Reshard data away and try again.

9.重新分配9000的slot到7000上

# ./redis-trib.rb reshard  172.16.32.116:9000   <<<<<<重新分配slot
>>> Performing Cluster Check (using node 172.16.32.116:9000)
M: 364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000
   slots:0-98,5461-5561,10923-11021 (299 slots) master
   0 additional replica(s)
M: a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000
   slots:99-5460 (5362 slots) master
   1 additional replica(s)
M: 273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001
   slots:5562-10922 (5361 slots) master
   1 additional replica(s)
S: 3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002
   slots: (0 slots) slave
   replicates 88fe075375295b59eabe69fa1438ed7c7c314f43
S: aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000
   slots: (0 slots) slave
   replicates a0b91f48e933c1f1d427c54917ce970bd25d29f8
M: 88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002
   slots:11022-16383 (5362 slots) master
   1 additional replica(s)
S: a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001
   slots: (0 slots) slave
   replicates 273107e5ac994d675749be0979556e761274bb93
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 300     <<<9000節點全部需要遷移的節點
What is the receiving node ID? a0b91f48e933c1f1d427c54917ce970bd25d29f8  <<<<<<7000的ID
Please enter all the source node IDs.
  Type ‘all‘ to use all the nodes as source nodes for the hash slots.
  Type ‘done‘ once you entered all the source nodes IDs.
Source node #1:364ae8322ab2627e25b05d45b702448c74afad10    <<<<<<9000的ID
Source node #2:done
Ready to move 300 slots.
  Source nodes:
    M: 364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000   <<<<<<Source nodes
   slots:0-98,5461-5561,10923-11021 (299 slots) master
   0 additional replica(s)
  Destination node:
    M: a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000   <<<<<<<Destination node
   slots:99-5460 (5362 slots) master
   1 additional replica(s)
  Resharding plan:
    Moving slot 0 from 364ae8322ab2627e25b05d45b702448c74afad10
.........
    Moving slot 11021 from 364ae8322ab2627e25b05d45b702448c74afad10
Do you want to proceed with the proposed reshard plan (yes/no)? yes
Moving slot 0 from 172.16.32.116:9000 to 172.16.32.116:7000:
Moving slot 1 from 172.16.32.116:9000 to 172.16.32.116:7000:
........

10. 查詢，可以看到9000已經沒有slot了

# ./redis-cli  -p 9000 cluster nodes
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505328938056 8 connected 0-5561 10923-11021
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 master - 0 1505328939059 2 connected 5562-10922
364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000 myself,master - 0 0 7 connected
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505328936053 3 connected
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505328933046 8 connected
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505328937054 3 connected 11022-16383
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505328934049 2 connected

11. 再次執行命令，將9000變成7000的slave，成功

# redis-cli -c -p 9000 cluster replicate a0b91f48e933c1f1d427c54917ce970bd25d29f8
OK

12. 查看狀態,9000已經成為7000的slave

# ./redis-cli  -p 9000 cluster nodes
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505329564286 8 connected 0-5561 10923-11021
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 master - 0 1505329561281 2 connected 5562-10922
364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000 myself,slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 0 7 connected    <<<<<<<<<<<<<<
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505329558274 3 connected
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505329554266 8 connected
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505329563285 3 connected 11022-16383
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505329562283 2 connected

13. 刪除節點9000，成功刪除

# ./redis-trib.rb del-node 172.16.32.116:9000 364ae8322ab2627e25b05d45b702448c74afad10
>>> Removing node 364ae8322ab2627e25b05d45b702448c74afad10 from cluster 172.16.32.116:9000
>>> Sending CLUSTER FORGET messages to the cluster...
>>> SHUTDOWN the node.

14. 連接9000，發現已經shutdown，無法連接

# ./redis-cli  -p 9000 cluster nodes
Could not connect to Redis at 127.0.0.1:9000: Connection refused
Could not connect to Redis at 127.0.0.1:9000: Connection refused

15. 查看集群狀態，9000已經不見了

# ./redis-cli  -p 7000 cluster nodes
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505329693835 3 connected 11022-16383
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 master - 0 1505329694837 2 connected 5562-10922
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 myself,master - 0 0 8 connected 0-5561 10923-11021
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505329696841 6 connected
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505329695840 5 connected
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505329692833 8 connected

~~~~~~~~~~~~~~~~~~~~~~~~~~~再次啟動9000，發現不同~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

16. 再次啟動9000，發現一個有意思的事情。上面檢查7000，集群已經沒有9000了

# ./redis-cli  -p 7000 cluster nodes
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505329898241 3 connected 11022-16383
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 master - 0 1505329899242 2 connected 5562-10922
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 myself,master - 0 0 8 connected 0-5561 10923-11021
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505329902249 6 connected
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505329901246 5 connected
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505329900244 8 connected

17. 但是查看9000，確仍然能看到整個集群的信息。說明，在刪除節點的過程，只是在原有集群中刪除9000的信息。但是9000自身的信息並沒有被刪除，依然保留全部的信息，只是9000實例被關閉而已。

# ./redis-cli  -p 9000 cluster nodes
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505329902003 8 connected 0-5561 10923-11021
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 master - 0 1505329903006 2 connected 5562-10922
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505329906013 3 connected
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505329908019 2 connected
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505329904008 8 connected
364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000 myself,slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 0 7 connected
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505329907016 3 connected 11022-16383

18. 而9000的全部信息，是記錄在自身目錄的nodes.conf中

# more nodes.conf
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505329544244 8 connected 0-5561 10923-11021
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 master - 0 1505329542241 2 connected 5562-10922
364ae8322ab2627e25b05d45b702448c74afad10 172.16.32.116:9000 myself,slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 0 7 connected
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505329541239 3 connected
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505329545246 8 connected
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505329543242 3 connected 11022-16383
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505329546248 2 connected
vars currentEpoch 8 lastVoteEpoch 0

19. 到7001等其他節點中查看，nodes.conf已經沒有9000的信息

# more nodes.conf
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 myself,master - 0 0 2 connected 5562-10922
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505329680312 8 connected 0-5561 10923-11021
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505329684319 8 connected
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505329686321 6 connected
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505329685318 5 connected
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505329683317 3 connected 11022-16383
vars currentEpoch 8 lastVoteEpoch 0

~~~~~~~~~~~~~~~~~~~~~~~~~~~再次添加9000，以及9001~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

20. 將9000和9001再次加入集群，開始下面的折騰。

註意：需要將9000和9001下的redis.conf外的文件清除，重啟。然後才能再次加入集群。不然會遇到錯誤：

[ERR] Node 172.16.32.116:9001 is not empty. Either the node already knows other nodes (check with CLUSTER NODES) or contains some key in database 0.

21. 加入集群

./redis-trib.rb add-node 172.16.32.116:9000 172.16.32.116:7002
./redis-trib.rb add-node 172.16.32.116:9001 172.16.32.116:7002

22. 現在是兩個空的Master節點

# ./redis-trib.rb check 172.16.32.116:9001
>>> Performing Cluster Check (using node 172.16.32.116:9001)
M: c4ba7a1f537ac66076791461d6af9012741fee74 172.16.32.116:9001
   slots: (0 slots) master
   0 additional replica(s)
M: dbf78b73f2ab9e37cbf31abbc2beb3d5413d5516 172.16.32.116:9000
   slots: (0 slots) master
   0 additional replica(s)
 
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.

23. 重分配100個slot到9000上，其實redis很聰明的，我連接的是9001，但是在分配的時候，它會問你，receiving node是誰，Source node 是誰。

# ./redis-trib.rb reshard 172.16.32.116:9001
>>> Performing Cluster Check (using node 172.16.32.116:9001)
......
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 100
What is the receiving node ID? dbf78b73f2ab9e37cbf31abbc2beb3d5413d5516  <<<<<<<<<receiving node ID
Please enter all the source node IDs.
  Type ‘all‘ to use all the nodes as source nodes for the hash slots.
  Type ‘done‘ once you entered all the source nodes IDs.
Source node #1:aeb684429d220c0fd1392574d193cc1ae7577782  <<<<<<<Source node我選的是 8000
*** The specified node is not known or is not a master, please retry. <<<<<<<然而，並沒能欺騙redis，它發現了，這個是slave，沒有slot可以提供的。 
Source node #1:273107e5ac994d675749be0979556e761274bb93   <<<<<<<<Source node再次指定為7001，開始分配了
Source node #2:done
Ready to move 100 slots.
  Source nodes:
    M: 273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001
   slots:5562-10922 (5361 slots) master
   1 additional replica(s)
  Destination node:
    M: dbf78b73f2ab9e37cbf31abbc2beb3d5413d5516 172.16.32.116:9000
   slots: (0 slots) master
   0 additional replica(s)
  Resharding plan:
    Moving slot 5562 from 273107e5ac994d675749be0979556e761274bb93
    Moving slot 5563 from 273107e5ac994d675749be0979556e761274bb93

24. 查看分配情況，redis還是很聰明靈活的。

# redis-cli -p 7001 cluster nodes
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 myself,master - 0 0 2 connected 5662-10922
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505330856605 8 connected 0-5561 10923-11021
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505330853598 8 connected
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505330860611 6 connected
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505330859608 5 connected
c4ba7a1f537ac66076791461d6af9012741fee74 172.16.32.116:9001 master - 0 1505330862615 9 connected                         <<<<<<<<<<<<<<<<<<<<<依然是空的
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505330861612 3 connected 11022-16383
dbf78b73f2ab9e37cbf31abbc2beb3d5413d5516 172.16.32.116:9000 master - 0 1505330858607 10 connected 5562-5661              <<<<<<<<<<<<<<<<<<<<<從7001要來100個slot

25. 將9001添加為9000的slave節點 redis-cli -p <slave IP:port> cluster nodes <Master ID 號>

# redis-cli -p 9001 cluster nodes dbf78b73f2ab9e37cbf31abbc2beb3d5413d5516
273107e5ac994d675749be0979556e761274bb93 172.16.32.116:7001 myself,master - 0 0 2 connected 5662-10922
a0b91f48e933c1f1d427c54917ce970bd25d29f8 172.16.32.116:7000 master - 0 1505331457798 8 connected 0-5561 10923-11021
aeb684429d220c0fd1392574d193cc1ae7577782 172.16.32.116:8000 slave a0b91f48e933c1f1d427c54917ce970bd25d29f8 0 1505331454791 8 connected
3d27f60a1cc4d9c8f09aca928b03f0e083722d3b 172.16.32.116:8002 slave 88fe075375295b59eabe69fa1438ed7c7c314f43 0 1505331456795 6 connected
a96cad95dca2a8e1e0302bff4f835260d92e3d31 172.16.32.116:8001 slave 273107e5ac994d675749be0979556e761274bb93 0 1505331458799 10 connected
c4ba7a1f537ac66076791461d6af9012741fee74 172.16.32.116:9001 slave dbf78b73f2ab9e37cbf31abbc2beb3d5413d5516 0 1505331459801 10 connected
88fe075375295b59eabe69fa1438ed7c7c314f43 172.16.32.116:7002 master - 0 1505331455793 3 connected 11022-16383
dbf78b73f2ab9e37cbf31abbc2beb3d5413d5516 172.16.32.116:9000 master - 0 1505331453788 10 connected 5562-5661

經過各種折騰，redis添加，刪除，重分配slot等操作，都測試完了。

中間有很多命令輸出部門，視乎有點重復。但是為了更好的閱讀理解，觀察每一步操作的變化。後面查閱也更容易一些。

畢竟，年紀大了，記性不好。好多自己寫過的blog，回頭翻閱的時候，發現某些步驟，不是很好理解了。雖然我的blog，都是基於自己測試的結果，但是依然會忘記。

本文出自 “小小狗窩” 博客，請務必保留此出處http://hsbxxl.blog.51cto.com/181620/1965706

Redis Cluster 添加/刪除完整折騰步驟

slot redis clust Redis還是挺好玩的，今天測試了集群的添加、刪除節點、重分配slot等。更深入的理解redis的遊戲規則。步驟繁多，但是詳細。環境解釋：我是在一臺Centos 6.9上測試的，各個redis節點以端口號區分。文中針對各個redis，我只是以端口號代表。~~~~M

WinForm 控件TabelControl對TabelPage頁的添加,刪除操作

sender control dex bsp for class spa pri void 一般是寫一個按鈕點擊事件實現了選中那個關那個 //點擊添加按鈕 private void button1_Click(object send

在一個文件中添加刪除檢查用戶腳本

del format nbsp arc 文件中 form err 用戶腳本 $2 #!/bin/bash Path=/etc/user.conf if [ ! -f $Path ];then 　　touch $Path fi chmod 644 $Path if [

jQuery添加刪除DOM元素

ron 使用 pagedown oot empty tab pan after div 1.添加DOM元素 append prepend before after //append 添加在同級元素的之前實例： <div class="header"&g

1.SQL語句添加刪除修改字段

add arc var column 語句 .sql span clas 字段 1.增加字段 alter table [table_NAME] add 字段名 varchar(N) 2.刪除字段 ALTER TABLE [table_NAME] DROP COLUMN co

jquery17 DOM操作 : 添加刪除獲取包裝 DOM篩選

點擊事件標題 ndt 篩選 after 子元素 ace script 對象 <!DOCTYPE HTML> <html> <head> <meta http-equiv="Content-Type" content="text/

XMPP添加刪除好友

logs ise ngs rac commit ron tlab otto 定義　　在現階段的通信服務中。各種標準都有，因此會出現無法實現相互連通，而XMPP(Extensible Message and presence Protocol)協議的出現，實現了整個及時

添加/刪除圖片

logs charset eat ech 創建 button text 瀏覽器引用 1 <!DOCTYPE html> 2 <html> 3 <head lang="en"> 4 <meta charset="U

雙鏈集合添加刪除算法

ddl list 集合 test 一個 ram keyword doc link 雙鏈集合添加刪除算法: package com.linkes; public class MyLinkeList { /** * 更多資料歡迎瀏覽凱哥學堂官網：http://kaige12

用WebService實現對數據庫進行操作(添加+刪除+修改)（轉）

add exe dispose eth 連接字段 article log conn 轉自：http://blog.csdn.net/beyondqd/article/details/6703169 表為User，字段有編號： int id，用戶名：string User

集合遍歷過程iterator，添加刪除元素報異常

exc asn 一致性使用遍歷 one mov exceptio 刪除 list set 遍歷過程中添加或者刪除元素，報異常。使用iterator 也會報異常 ConcurrentModificationException remove只能用叠代器的remov

35課時可變列表list常用操作添加/刪除/插入

2-2 cnblogs 操作 http mage src 刪除 app .cn x.append(1)單個元素 x.extend([1,2]) 多個元素刪除 del 此處有誤應該是在第i+1個位置插入m 35課時可變列表list常用操作添加/刪除/插入

內核網絡子系統--添加/刪除ip地址

fad 目標 destroy insert use ip地址 rest routes oid kernel: 4.12.6 添加ip地址：主從ip的判斷，並且插入到合適的位置中； static int __inet_insert_ifa(struct i

JQuery添加刪除標簽

src rip col -h 事件委托 block -a move 未渲染 html ________________________________________________________________________ <!DOCTYPE html>

<linux小腳本>批量添加/刪除用戶

linux腳本批量添加/刪除用戶，當輸入add時，判斷用戶是否存在，存在則顯示存在，不存在則添加；當輸入del時，判斷用戶是否存在，存在則刪除用戶，不存在則顯示不存在。#!/bin/bashif [ $1 == "add" ];then for i in {1..10}; do i

<linux小腳本>case實現批量添加/刪除用戶

linux 腳本 #!/bin/bash#輸入add添加用戶，輸入del刪除用戶，-v選擇是否顯示結果信息 DEBUG=0ADD=0DEL=0 for i in `seq 0 $#`; do if [ $# -gt 0 ];then case $1 in -v)

db2數據庫基本添加刪除表字段總結

alter 原來默認值 ren 設置不同 def 數據如果 1.添加字段 alter table [table_name] add [column_name] [column_type] 2.更改字段類型 alter table [table_name] alter

Mac OS X中Launchpad的圖標添加刪除方法（添加方法別試了，和Linux很大區別）

com nsh usr folders 單純 ron bsp blank 結構說明：在Mac下的Launchpad圖標添加和刪除都與應用程序的app文件有關，如果單純的只想在Launchpad添加自定義的圖標，然後指定要某條命令運行時，建議不要這麽幹，Launchpad的

Ceph添加/刪除Mon（ceph.conf）

ron cti bsp red quorum 環境當前 reat ddr 操作環境 ceph 0.87.7 Openstack liberty ubuntu 14.04 當前ceph配置文件如下 [global]fsid = c010eb34-ccc6-458d-9a0

indexOf()返回首次出現位置，splice() 方法向/從數組中添加/刪除項目

span blog 位置 pre bsp col 方法項目 sch indexOf(): http://www.w3school.com.cn/jsref/jsref_indexOf.asp splice(): http://www.w3school.com.cn/j

Redis Cluster 添加/刪除 完整折騰步驟

相關推薦

Redis Cluster 添加/刪除完整折騰步驟