硬體環境：6臺伺服器，IP為172.16.172.17/18/19/20/21/22

軟體環境：作業系統為Centos7.5

                 Ambari版本為2.5.0.3

                 HDP版本為2.6.0.3

一、安裝前準備工作：

1.安裝以下軟體：

            yum,rpm,scp,curl,unzip,tar,wget,OpenSSL(v1.01,build 16以上版本)，Python(2.7.x以上版本)；

            JDK版本1.8以上；

2.資料庫：可自行安裝資料庫，也可使用Ambari安裝的PostgreSQL資料庫。

                本叢集搭建，使用HDP-Utils下的mysql資料庫，不單獨安裝資料庫。

3.配置叢集FQDN：

                （1）. 修改各個伺服器的hostname，172.16.172.17-22分別修改/etc/hostname為dsj1.zkhy.com-dsj6.zkhy.com。

                     以172.16.172.17為例，hostname修改為：dsj1.zkhy.com。

                （2）.修改各個伺服器的/etc/hosts。

                     新增如下內容，原來hosts檔案已有的內容繼續保留：

                                       172.16.172.17 dsj1.zkhy.com

                                       172.16.172.18 dsj2.zkhy.com

                                       172.16.172.19 dsj3.zkhy.com

                                       172.16.172.20 dsj4.zkhy.com

                                       172.16.172.21 dsj5.zkhy.com

                                       172.16.172.22 dsj6.zkhy.com

                      可在編輯完172.16.172.17的hosts檔案後，使用命令xsync hosts傳送給其他叢集中的伺服器。

4.配置ssh信任:

          (1).安裝：

               yum install openssh-server -y

           (2).配置：

                 使用SSH的重要前提是虛擬機器上都是同一使用者

          ssh–keygen –t rsa –P ‘’ –f ~/.ssh/id_rsa //生成金鑰對

          cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys    //將公鑰匯入金鑰庫（授權KEY集）

            (3).舉例：

比如把dsj1的公鑰傳給dsj2（用NC）

     a.nc -l 8888 >id_rsa.pub.dsj1 //dsj2準備接收公鑰，並重命名為dsj1的公鑰id_rsa.pub.dsj1。

     b.nc dsj2.zkhy.com 8888 < id_rsa.pub   //dsj1端，傳送公鑰給dsj2。

     c.cat ~/.ssh/id_rsa.pub.dsj1 >> ~/.ssh/authorized_keys      //在dsj2上新增dsj1的公鑰檔案。

(4).使用：

登陸到dsj2（已傳入dsj1公鑰）

          ssh dsj2.zkhy.com

          ....yes

          exit

          ssh dsj2.zkhy.com //再次登陸就不需要yes了

（5）注意：

      Centos7版本除了做以上四步外，還需要

a.關閉SElinux才能實現免密登入。

                  vi /etc/selinux/config

                        修改內容如下：

                     把SELINUX=enforcing修改為SELINUX=disabled

b.修改資料夾許可權

chmod 700 ~/.ssh
chmod 600 ~/.ssh/authorized_keys 

c.修改sshd_config和ssh_config檔案：vi /etc/ssh/sshd_config

將下面的內容放開，也就是去掉註釋。

RSAAuthentication yes

PubkeyAuthentication yes

AuthorizedKeysFile      .ssh/authorized_keys

若仍然無法ssh免密登入，則用root使用者登陸檢視系統的日誌檔案：$tail /var/log/secure -n 20，再進一步定位。

5.更改系統環境配置：

      echo umask 0022 >> /etc/profile

6.ntp時鐘同步配置：

6臺裝置：

IP	用途
172.16.172.17	ntpd伺服器，用於與外部公共ntpd同步標準時間
172.16.172.18	ntpd客戶端，用於與ntpd同步時間
172.16.172.19	ntpd客戶端，用於與ntpd同步時間
172.16.172.20	ntpd客戶端，用於與ntpd同步時間
172.16.172.21	ntpd客戶端，用於與ntpd同步時間
172.16.172.22	ntpd客戶端，用於與ntpd同步時間

• 使用rpm檢查ntp包是否安裝

[[email protected] kevin]# rpm -q ntp

• 如果已經安裝則略過此步，否則使用yum進行安裝，並設定系統開機自動啟動並啟動服務

[[email protected] kevin]# yum -y install ntp

[[email protected] kevin]# systemctl enable ntpd

[[email protected] kevin]# systemctl start ntpd

 設定ntp伺服器: 172.16.172.17

• 修改/etc/ntp.conf檔案，加粗字型是修改的內容

# For more information about this file, see the man pages

# ntp.conf(5), ntp_acc(5), ntp_auth(5), ntp_clock(5), ntp_misc(5), ntp_mon(5).

driftfile /var/lib/ntp/drift

# Permit time synchronization with our time source, but do not

# permit the source to query or modify the service on this system.

restrict default nomodify notrap nopeer noquery

# Permit all access over the loopback interface.  This could

# be tightened as well, but to do so would effect some of

# the administrative functions.

restrict 127.0.0.1

restrict ::1

# Hosts on local network are less restricted.

#restrict 192.168.1.0 mask 255.255.255.0 nomodify notrap

restrict 172.16.248.0 mask 255.255.255.0 nomodify notrap

# Use public servers from the pool.ntp.org project.

# Please consider joining the pool (http://www.pool.ntp.org/join.html).

#server 0.centos.pool.ntp.org iburst

server 2.cn.pool.ntp.org

server 1.asia.pool.ntp.org

server 2.asia.pool.ntp.org

#broadcast 192.168.1.255 autokey        # broadcast server

#broadcastclient                        # broadcast client

#broadcast 224.0.1.1 autokey            # multicast server

#multicastclient 224.0.1.1              # multicast client

#manycastserver 239.255.254.254         # manycast server

#manycastclient 239.255.254.254 autokey # manycast client

# 允許上層時間伺服器主動修改本機時間

restrict 2.cn.pool.ntp.org nomodify notrap noquery

restrict 1.asia.pool.ntp.org nomodify notrap noquery

restrict 2.asia.pool.ntp.org nomodify notrap noquery

server 127.127.1.0 # local clock

fudge 127.127.1.0 stratum 10

# Enable public key cryptography.

#crypto

includefile /etc/ntp/crypto/pw

# Key file containing the keys and key identifiers used when operating

# with symmetric key cryptography.

keys /etc/ntp/keys

# Specify the key identifiers which are trusted.

#trustedkey 4 8 42

# Specify the key identifier to use with the ntpdc utility.

#requestkey 8

# Specify the key identifier to use with the ntpq utility.

#controlkey 8

# Enable writing of statistics records.

#statistics clockstats cryptostats loopstats peerstats

# Disable the monitoring facility to prevent amplification attacks using ntpdc

# monlist command when default restrict does not include the noquery flag. See

# CVE-2013-5211 for more details.

# Note: Monitoring will not be disabled with the limited restriction flag.

disable monitor

配置檔案修改完成，儲存退出，啟動服務。

# service ntpd start

等待5-10分鐘，通過命令查詢NTPD服務情況。

檢視服務連線和監聽

# netstat -tlunp | grep ntp      

ntpq -p 檢視網路中的NTP伺服器，同時顯示客戶端和每個伺服器的關係

# ntpq -p

#ntpstat 命令檢視時間同步狀態

設定ntp客戶端: 172.16.248.129|130|131

編輯/etc/ntp.conf檔案，加粗字型為變化的內容。

# For more information about this file, see the man pages

# ntp.conf(5), ntp_acc(5), ntp_auth(5), ntp_clock(5), ntp_misc(5), ntp_mon(5).

driftfile /var/lib/ntp/drift

# Permit time synchronization with our time source, but do not

# permit the source to query or modify the service on this system.

restrict default nomodify notrap nopeer noquery

# Permit all access over the loopback interface.  This could

# be tightened as well, but to do so would effect some of

# the administrative functions.

restrict 127.0.0.1

restrict ::1

# Hosts on local network are less restricted.

#restrict 192.168.1.0 mask 255.255.255.0 nomodify notrap

# Use public servers from the pool.ntp.org project.

# Please consider joining the pool (http://www.pool.ntp.org/join.html).

#server 0.centos.pool.ntp.org iburst

server 172.16.172.17

restrict 172.16.172.17 nomodify notrap noquery

server 127.127.1.0

fudge 127.127.1.0  stratum 10

#broadcast 192.168.1.255 autokey        # broadcast server

#broadcastclient                        # broadcast client

#broadcast 224.0.1.1 autokey            # multicast server

#multicastclient 224.0.1.1              # multicast client

#manycastserver 239.255.254.254         # manycast server

#manycastclient 239.255.254.254 autokey # manycast client

# Enable public key cryptography.

#crypto

includefile /etc/ntp/crypto/pw

# Key file containing the keys and key identifiers used when operating

# with symmetric key cryptography.

keys /etc/ntp/keys

# Specify the key identifiers which are trusted.

#trustedkey 4 8 42

# Specify the key identifier to use with the ntpdc utility.

#requestkey 8

# Specify the key identifier to use with the ntpq utility.

#controlkey 8

# Enable writing of statistics records.

#statistics clockstats cryptostats loopstats peerstats

# Disable the monitoring facility to prevent amplification attacks using ntpdc

# monlist command when default restrict does not include the noquery flag. See

# CVE-2013-5211 for more details.

# Note: Monitoring will not be disabled with the limited restriction flag.

disable monitor

重啟ntpd服務

#systemctl restart ntpd

啟動後，檢視同步情況

# ntpq -p

# ntpstat

7.安裝jdk

在叢集中的所有伺服器上都安裝jdk，版本最好在1.8以上，叢集內伺服器版本保持一致。