叢集規劃

前置準備

• 克隆4臺虛擬機器

• 網路配置

  • vim /etc/netplan/01-network-manager-all.yaml 修改配置檔案

  • 叢集網路配置如下:

    # flink01
    network:
      version: 2
      renderer: NetworkManager
    
      ethernets:
        ens33:
            dhcp4: no
            dhcp6: no
            addresses: [192.168.180.160/24]
            gateway4: 192.168.180.2
            nameservers:
                addresses: [114.114.114.114, 8.8.8.8]
    
     # flink02
     network:
      version: 2
      renderer: NetworkManager
    
      ethernets:
        ens33:
            dhcp4: no
            dhcp6: no
            addresses: [192.168.180.161/24]
            gateway4: 192.168.180.2
            nameservers:
                addresses: [114.114.114.114, 8.8.8.8]
    
    # flink03
    network:
      version: 2
      renderer: NetworkManager
    
      ethernets:
        ens33:
            dhcp4: no
            dhcp6: no
            addresses: [192.168.180.162/24]
            gateway4: 192.168.180.2
            nameservers:
                addresses: [114.114.114.114, 8.8.8.8]
    
       #flink04
       network:
      version: 2
      renderer: NetworkManager
    
      ethernets:
        ens33:
            dhcp4: no
            dhcp6: no
            addresses: [192.168.180.163/24]
            gateway4: 192.168.180.2
            nameservers:
                addresses: [114.114.114.114, 8.8.8.8]
    
     
    

  • 能 ping 通 baidu 連上 xshell 即可, 連不上的可能是防火牆問題, ubuntu 用的防火牆是ufw, selinux 預設是disabled, 正常來說應該不會連不上。

• 修改 hostname 及 hosts檔案

  • vim /etc/hostname 修改 hostname 為 flink01

  • vim /etc/hosts 修改 host檔案

    127.0.0.1       localhost
    192.168.180.160    flink01
    192.168.180.161    flink02
    192.168.180.162    flink03
    192.168.180.163    flink04
    
    # The following lines are desirable for IPv6 capable hosts
    ::1     ip6-localhost ip6-loopback
    fe00::0 ip6-localnet
    ff00::0 ip6-mcastprefix
    ff02::1 ip6-allnodes
    ff02::2 ip6-allrouters
     
    

• JDK配置
  • 如果沒有配置jdk請參考https://www.cnblogs.com/ronnieyuan/p/11461377.html
    • 如果之前有下過別的版本的jdk請將jdk的tar包解壓到/usr/lib/jvm,然後再修改配置檔案並選擇jdk

• 免密登入

  • root@flink01:~# ssh-keygen -t rsa -P ""
    Generating public/private rsa key pair.
    Enter file in which to save the key (/root/.ssh/id_rsa): 
    Created directory '/root/.ssh'.
    Your identification has been saved in /root/.ssh/id_rsa.
    Your public key has been saved in /root/.ssh/id_rsa.pub.
    The key fingerprint is:
    SHA256:2P9NCcuEljhcWBndG8FBoAxOeGbZDIHIdw06r3bbsug root@flink01
    The key's randomart image is:
    +---[RSA 2048]----+
    |   . . o*Oo+.=+o |
    |    o ++*==.. +  |
    |     .o=o +    o |
    |       * o o  .  |
    |      . S + o    |
    |       . + o o . |
    |      o . . o o  |
    |     . o.o . o   |
    |     .E oo. . .  |
    +----[SHA256]-----+
    
     
    

  • 在~目錄下vim .ssh/authorized_keys:

    將5臺虛擬機器公鑰都存入該檔案中, 每臺的authorized_keys都一致

    ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZGR9+3bTIq6kZ5c+1O2mvyPBM790/0QUuVcjPSREK1pMpyyKRu6CUaBlTOM8JJzkCnEe7DVKY8lV2q7Zv7VVXTLI2dKuUmo0oMSGo5ABvfjGUJfFWdNkqgrPgT+Opl/1kIqr6wTGGCJsRx+Nfkic31WhnPij2IM/Zpqu88kiXmUbaNwBDM5jaRqB/nk7DW4aMwF5oeX6LvEuI1SVmY3DH0w6Cf1EDtOyYG1f9Vof8ao88JOwRZazTNbBdsVcPKDbtvovs/lP+CrtwmAcGFGZSjA22I0dc9ek0puQ5pNUgindpb9egJJFoGhtduut6OfmmvbB8u9PjdBkHcp3Vof4j root@flink01
    
    ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMgNUIzT1YRTGX5E4MiWyQ9UxfQ1pRwCSMy3wqJOuyqv/kW5VsL0BS1VAwtSS9FqCBon3lT0zfgPEkscDdKugMtpgSeREjbQQJSDYPQGyCsHcXQgne5dfaWbvLvaFbNO1G5wqW6E3zC5zy85mSdg9qg8NmqYwyz0O8WSRottuAMHfhoNkHemdrIHhVBBZeKxFbsiXxiWi1EQJUYhYWU1LAqcpiIgFhjAGJkH91qULmm8FxkbB3ytcMlkFBNbcr3UkN5EK0VGV/Ly1qgs9UmXtS7xb5Lw5RlqjUMvwc28oHZYSfPRS1TL/oaFBZSIIGPjudke5wsBwNnzHGE44sTWUt root@flink02
    
    ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRYkED/hA9nqmCBClIByAIcrT94edjno1HXn/KIgrCXy0aoIfsgY5FDr/3iZgaEdvnDz1woyKyj5gqkYxdQw0vLiJGOefgSC4yx7j6vKaK+2aSxJD+DLFB6toFAlyfWziTnyoPj3hPhlpSdG1P4YSEpMub5p1gVsEX9+vRvyazIabsbY9YsCsv/WDs3aAYyalfuvN+AXTrXI8di+AGgsjbwmo0/VQWQfItHY+WdTGcfBQQ8Ad9UX2wVRQPXq7gHh3LlBWKZnB+nZxavnI/G9Lo9w9MODSBgxfCfKNu6fpnpcvh8u+AqmT6rNKZg5NuZWW16siGvLNReSnWn7KwHzzD root@flink03
    
    ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkBQxFdKvg2MzGl1eFeDO1iqL2+fdJ9b4ktU9fjO/APEkumbftfrDTgJAnQhcXMsU7RjCJ+Zwt/dpeGhql3o7hXuhjQiUXf+8GXYre8cw9+xaYmaVhCZYbpcFiSrd/8TK3qv+gf21YIT7iQEFEl384qxPbyoU4Lm+M/1aY3m4gHvELv3jfg8oVBypxgaAJpJj9ZnnA0zN470cod1E67yVbfIkoSTy8BXd8UhVedYODD1ddaFX8MF53acUdJgLCGzh4axxivlGqdXWB7lhjbBvjllt2LYb7hW+O1qyCFNiRx/+zR9dSu5ZSW3QNg2EP/ljcCjDWa7AHgTvw6BYkdpj1 root@flink04
    

  • 依次測試免密登入是否成功

    • 成功案例：

      root@flink01:~# ssh [email protected]
      Welcome to Ubuntu 18.04.2 LTS (GNU/Linux 4.18.0-17-generic x86_64)
      
       * Documentation:  https://help.ubuntu.com
       * Management:     https://landscape.canonical.com
       * Support:        https://ubuntu.com/advantage
      
      
       * Canonical Livepatch is available for installation.
         - Reduce system reboots and improve kernel security. Activate at:
           https://ubuntu.com/livepatch
      
      273 packages can be updated.
      272 updates are security updates.
      
      Your Hardware Enablement Stack (HWE) is supported until April 2023.
      Last login: Sun Oct 27 11:11:26 2019 from 192.168.180.160
      root@flink02:~# 
      

叢集搭建

• Zookeeper 搭建

  • 上傳 tar 包 並解壓到指定目錄 並修改解壓後的目錄名稱

    tar -zxvf apache-zookeeper-3.5.5-bin.tar.gz -C /opt/ronnie/
    
    cd /opt/ronnie
    
    mv apache-zookeeper-3.5.5-bin/ zookeeper-3.5.5

  • 建立並修改zookeeper配置檔案

    • cd zookeeper-3.5.5/conf/ 進入Zookeeper配置檔案目錄

    • cp zoo_sample.cfg zoo.cfg 拷貝一份zoo_sample.cfg 為 zoo.cfg

    • vim zoo.cfg 修改配置檔案

      # The number of milliseconds of each tick
      tickTime=2000
      # The number of ticks that the initial 
      # synchronization phase can take
      initLimit=10
      # The number of ticks that can pass between 
      # sending a request and getting an acknowledgement
      syncLimit=5
      # the directory where the snapshot is stored.
      # do not use /tmp for storage, /tmp here is just 
      # example sakes.
      dataDir=/opt/ronnie/zookeeper-3.5.5/data/zk
      dataLogDir=/opt/ronnie/zookeeper-3.5.5/data/log
      # the port at which the clients will connect
      clientPort=2181
      # the maximum number of client connections.
      # increase this if you need to handle more clients
      #maxClientCnxns=60
      #
      # Be sure to read the maintenance section of the 
      # administrator guide before turning on autopurge.
      #
      # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
      #
      # The number of snapshots to retain in dataDir
      #autopurge.snapRetainCount=3
      # Purge task interval in hours
      # Set to "0" to disable auto purge feature
      #autopurge.purgeInterval=1
      server.1=flink01:2888:3888
      server.2=flink02:2888:3888
      server.3=flink03:2888:3888
      server.4=flink04:2888:3888

      • 建立data目錄:

        mkdir -p /opt/ronnie/zookeeper-3.5.5/data

      • 建立data目錄下的日誌目錄:

        mkdir -p /opt/ronnie/zookeeper-3.5.5/data/log

      • 建立data目錄下的zk目錄

        mkdir -p /opt/ronnie/zookeeper-3.5.5/data/zk

  • cd zk/, 建立myid, 四臺虛擬機器flink01, flink02, flink03, flink04 分別對應 myid 1,2,3,4

  • 新增環境變數

    • vim ~/.bashrc , 完成後 source ~/.bashrc

      # Zookeeper
      export ZOOKEEPER_HOME=/opt/ronnie/zookeeper-3.5.5
      export PATH=$ZOOKEEPER_HOME/bin:$PATH

  • 將Zookeeper目錄傳送給其他幾臺虛擬機器(記得改myid)

    cd /opt/ronnie
    scp -r zookeeper-3.5.5/ [email protected]:/opt/ronnie/
    scp -r zookeeper-3.5.5/ [email protected]:/opt/ronnie/
    scp -r zookeeper-3.5.5/ [email protected]:/opt/ronnie/

  • 啟動Zookeeper: zkServer.sh start

  • 檢查Zookeeper 狀態: zkServer.sh status

  • 有顯示該節點狀態就表示啟動成功了

    root@flink01:~# zkServer.sh status
    ZooKeeper JMX enabled by default
    Using config: /opt/ronnie/zookeeper-3.5.5/bin/../conf/zoo.cfg
    Client port found: 2181. Client address: localhost.
    Mode: follower

  • 報錯請檢視日誌定位錯誤

• Hadoop叢集搭建(主要還是為了hdfs, On-Yarn後面再弄)

  • 叢集分配

    	NN-1	NN-2	DN	ZK	ZKFC	JN
    flink01	*		*	*	*	*
    flink02		*	*	*	*	*
    flink03			*	*		*
    flink04			*	*		*