1. 程式人生 > >五、本地yum源的配置

五、本地yum源的配置

企業級大資料平臺Ambari搭建與管理

本節中我們將介紹Ambari叢集安裝時候的本地yum源配置

本節的操作只需要在Hadoop01節點上進行:

1、ambari離線安裝包的下載:

2、將下載好的ambari的離線安裝包通過FileZilla上傳到Hadoop01節點上:

上傳檔案:

在這裡插入圖片描述

檢查檔案:

[[email protected] ~]$ cd /home/hadoop/Download/
[[email protected] Download]$ ls
ambari-2.6.2.2-centos7.tar.gz   HDP-GPL-2.6.5.0-centos7-gpl.tar.gz  jdk-8u181-linux-x64.tar.gz
HDP-2.6.5.0-centos7-rpm.tar.gz  HDP-UTILS-1.1.0.22-centos7.tar.gz

在這裡插入圖片描述

3、搭建Http站點:

安裝httpd服務:

[[email protected] ~]$ yum install -y httpd
Loaded plugins: fastestmirror
You need to be root to perform this command.
[[email protected] ~]$ sudo yum install -y httpd
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.cn99.com
 * extras: mirrors.zju.edu.cn
 * updates: mirrors.cn99.com
Resolving Dependencies
--> Running transaction check
---> Package httpd.x86_64 0:2.4.6-80.el7.centos.1 will be installed
--> Processing Dependency: httpd-tools = 2.4.6-80.el7.centos.1 for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: /etc/mime.types for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: libaprutil-1.so.0()(64bit) for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: libapr-1.so.0()(64bit) for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Running transaction check
---> Package apr.x86_64 0:1.4.8-3.el7_4.1 will be installed
---> Package apr-util.x86_64 0:1.5.2-6.el7 will be installed
---> Package httpd-tools.x86_64 0:2.4.6-80.el7.centos.1 will be installed
---> Package mailcap.noarch 0:2.1.41-2.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

===========================================================================================================================
 Package                     Arch                   Version                                  Repository               Size
===========================================================================================================================
Installing:
 httpd                       x86_64                 2.4.6-80.el7.centos.1                    updates                 2.7 M
Installing for dependencies:
 apr                         x86_64                 1.4.8-3.el7_4.1                          base                    103 k
 apr-util                    x86_64                 1.5.2-6.el7                              base                     92 k
 httpd-tools                 x86_64                 2.4.6-80.el7.centos.1                    updates                  90 k
 mailcap                     noarch                 2.1.41-2.el7                             base                     31 k

Transaction Summary
===========================================================================================================================
Install  1 Package (+4 Dependent packages)

Total download size: 3.0 M
Installed size: 10 M
Downloading packages:
(1/5): apr-util-1.5.2-6.el7.x86_64.rpm                                                              |  92 kB  00:00:00     
(2/5): apr-1.4.8-3.el7_4.1.x86_64.rpm                                                               | 103 kB  00:00:00     
(3/5): httpd-tools-2.4.6-80.el7.centos.1.x86_64.rpm                                                 |  90 kB  00:00:00     
(4/5): mailcap-2.1.41-2.el7.noarch.rpm                                                              |  31 kB  00:00:00     
(5/5): httpd-2.4.6-80.el7.centos.1.x86_64.rpm                                                       | 2.7 MB  00:00:01     
---------------------------------------------------------------------------------------------------------------------------
Total                                                                                      2.3 MB/s | 3.0 MB  00:00:01     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : apr-1.4.8-3.el7_4.1.x86_64                                                                              1/5 
  Installing : apr-util-1.5.2-6.el7.x86_64                                                                             2/5 
  Installing : httpd-tools-2.4.6-80.el7.centos.1.x86_64                                                                3/5 
  Installing : mailcap-2.1.41-2.el7.noarch                                                                             4/5 
  Installing : httpd-2.4.6-80.el7.centos.1.x86_64                                                                      5/5 
  Verifying  : mailcap-2.1.41-2.el7.noarch                                                                             1/5 
  Verifying  : httpd-tools-2.4.6-80.el7.centos.1.x86_64                                                                2/5 
  Verifying  : apr-util-1.5.2-6.el7.x86_64                                                                             3/5 
  Verifying  : apr-1.4.8-3.el7_4.1.x86_64                                                                              4/5 
  Verifying  : httpd-2.4.6-80.el7.centos.1.x86_64                                                                      5/5 

Installed:
  httpd.x86_64 0:2.4.6-80.el7.centos.1                                                                                     

Dependency Installed:
  apr.x86_64 0:1.4.8-3.el7_4.1        apr-util.x86_64 0:1.5.2-6.el7       httpd-tools.x86_64 0:2.4.6-80.el7.centos.1      
  mailcap.noarch 0:2.1.41-2.el7      

Complete!

在這裡插入圖片描述

啟動http服務:

[[email protected] ~]$ sudo service httpd start
Redirecting to /bin/systemctl start httpd.service

在這裡插入圖片描述

建立http站點下的ambari和hdp資料夾:

[[email protected] ~]$ sudo mkdir /var/www/html/ambari
[[email protected] ~]$ sudo mkdir /var/www/html/hdp

在這裡插入圖片描述

測試http站點連線:

使用瀏覽器開啟以下連結:
http://192.168.10.101/ambari/
http:
//192.168.10.101/hdp/

在這裡插入圖片描述 在這裡插入圖片描述 成功開啟,代表站點建立成功。

4、解壓ambari檔案:

將ambari-2.6.2.2-centos7.tar.gz解壓到 /var/www/html/ambari路徑下,將 HDP-GPL-2.6.5.0-centos7-gpl.tar.gz 、HDP-2.6.5.0-centos7-rpm.tar.gz 、 HDP-UTILS-1.1.0.22-centos7.tar.gz這3個檔案解壓到/var/www/html/hdp路徑下:

[[email protected] ~]$ sudo tar -zxf /home/hadoop/Download/ambari-2.6.2.2-centos7.tar.gz -C /var/www/html/ambari
[[email protected] ~]$ sudo tar -zxf /home/hadoop/Download/HDP-2.6.5.0-centos7-rpm.tar.gz -C /var/www/html/hdp
[[email protected] ~]$ sudo tar -zxf /home/hadoop/Download/HDP-UTILS-1.1.0.22-centos7.tar.gz -C /var/www/html/hdp
[[email protected] ~]$ sudo tar -zxf /home/hadoop/Download/HDP-GPL-2.6.5.0-centos7-gpl.tar.gz -C /var/www/html/hdp

在這裡插入圖片描述

5、下載修改repo檔案

安裝wget服務

wget 可以直接從網上下載檔案

[[email protected] ~]$ sudo yum install -y httpd
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.cn99.com
 * extras: mirrors.zju.edu.cn
 * updates: mirrors.cn99.com
Resolving Dependencies
--> Running transaction check
---> Package httpd.x86_64 0:2.4.6-80.el7.centos.1 will be installed
--> Processing Dependency: httpd-tools = 2.4.6-80.el7.centos.1 for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: /etc/mime.types for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: libaprutil-1.so.0()(64bit) for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: libapr-1.so.0()(64bit) for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Running transaction check
---> Package apr.x86_64 0:1.4.8-3.el7_4.1 will be installed
---> Package apr-util.x86_64 0:1.5.2-6.el7 will be installed
---> Package httpd-tools.x86_64 0:2.4.6-80.el7.centos.1 will be installed
---> Package mailcap.noarch 0:2.1.41-2.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

===========================================================================================================================
 Package                     Arch                   Version                                  Repository               Size
===========================================================================================================================
Installing:
 httpd                       x86_64                 2.4.6-80.el7.centos.1                    updates                 2.7 M
Installing for dependencies:
 apr                         x86_64                 1.4.8-3.el7_4.1                          base                    103 k
 apr-util                    x86_64                 1.5.2-6.el7                              base                     92 k
 httpd-tools                 x86_64                 2.4.6-80.el7.centos.1                    updates                  90 k
 mailcap                     noarch                 2.1.41-2.el7                             base                     31 k

Transaction Summary
===========================================================================================================================
Install  1 Package (+4 Dependent packages)

Total download size: 3.0 M
Installed size: 10 M
Downloading packages:
(1/5): apr-util-1.5.2-6.el7.x86_64.rpm                                                              |  92 kB  00:00:00     
(2/5): apr-1.4.8-3.el7_4.1.x86_64.rpm                                                               | 103 kB  00:00:00     
(3/5): httpd-tools-2.4.6-80.el7.centos.1.x86_64.rpm                                                 |  90 kB  00:00:00     
(4/5): mailcap-2.1.41-2.el7.noarch.rpm                                                              |  31 kB  00:00:00     
(5/5): httpd-2.4.6-80.el7.centos.1.x86_64.rpm                                                       | 2.7 MB  00:00:01     
---------------------------------------------------------------------------------------------------------------------------
Total                                                                                      2.3 MB/s | 3.0 MB  00:00:01     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : apr-1.4.8-3.el7_4.1.x86_64                                                                              1/5 
  Installing : apr-util-1.5.2-6.el7.x86_64                                                                             2/5 
  Installing : httpd-tools-2.4.6-80.el7.centos.1.x86_64                                                                3/5 
  Installing : mailcap-2.1.41-2.el7.noarch                                                                             4/5 
  Installing : httpd-2.4.6-80.el7.centos.1.x86_64                                                                      5/5 
  Verifying  : mailcap-2.1.41-2.el7.noarch                                                                             1/5 
  Verifying  : httpd-tools-2.4.6-80.el7.centos.1.x86_64                                                                2/5 
  Verifying  : apr-util-1.5.2-6.el7.x86_64                                                                             3/5 
  Verifying  : apr-1.4.8-3.el7_4.1.x86_64                                                                              4/5 
  Verifying  : httpd-2.4.6-80.el7.centos.1.x86_64                                                                      5/5 

Installed:
  httpd.x86_64 0:2.4.6-80.el7.centos.1                                                                                     

Dependency Installed:
  apr.x86_64 0:1.4.8-3.el7_4.1        apr-util.x86_64 0:1.5.2-6.el7       httpd-tools.x86_64 0:2.4.6-80.el7.centos.1      
  mailcap.noarch 0:2.1.41-2.el7      

Complete!
[[email protected] ~]$ sudo service httpd start
Redirecting to /bin/systemctl start httpd.service
[[email protected] ~]$ sudo service httpd start
Redirecting to /bin/systemctl start httpd.service
[[email protected] ~]$ sudo service httpd stop
Redirecting to /bin/systemctl stop httpd.service
[[email protected] ~]$ sudo service httpd start
Redirecting to /bin/systemctl start httpd.service
[[email protected] ~]$ sudo mkdir /var/www/html/ambari
[[email protected] ~]$ sudo mkdir /var/www/html/hdp
[[email protected] ~]$ sudo yum install -y wget
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.cn99.com
 * extras: mirrors.zju.edu.cn
 * updates: mirrors.cn99.com
Resolving Dependencies
--> Running transaction check
---> Package wget.x86_64 0:1.14-15.el7_4.1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

===========================================================================================================================
 Package                  Arch                       Version                                Repository                Size
===========================================================================================================================
Installing:
 wget                     x86_64                     1.14-15.el7_4.1                        base                     547 k

Transaction Summary
===========================================================================================================================
Install  1 Package

Total download size: 547 k
Installed size: 2.0 M
Downloading packages:
wget-1.14-15.el7_4.1.x86_64.rpm                                                                     | 547 kB  00:00:00     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : wget-1.14-15.el7_4.1.x86_64                                                                             1/1 
  Verifying  : wget-1.14-15.el7_4.1.x86_64                                                                             1/1 

Installed:
  wget.x86_64 0:1.14-15.el7_4.1                                                                                            

Complete!

在這裡插入圖片描述

獲取repo檔案:

[[email protected] ~]$ cd /etc/yum.repos.d
[[email protected] yum.repos.d]$ sudo wget http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.2.2/ambari.repo
--2018-10-01 16:20:56--  http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.2.2/ambari.repo
Resolving public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)... 13.35.99.12, 13.35.99.3, 13.35.99.21, ...
Connecting to public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)|13.35.99.12|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 304 [binary/octet-stream]
Saving to: ‘ambari.repo’

100%[==============================================================>] 304         --.-K/s   in 0s      

2018-10-01 16:20:58 (13.5 MB/s) - ‘ambari.repo’ saved [304/304]

[[email protected] yum.repos.d]$ sudo wget http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.0/hdp.repo
--2018-10-01 16:21:12--  http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.0/hdp.repo
Resolving public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)... 13.35.99.12, 13.35.99.3, 13.35.99.21, ...
Connecting to public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)|13.35.99.12|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 575 [binary/octet-stream]
Saving to: ‘hdp.repo’

100%[==============================================================>] 575         --.-K/s   in 0s      

2018-10-01 16:21:12 (27.7 MB/s) - ‘hdp.repo’ saved [575/575]

在這裡插入圖片描述

修改repo檔案:

修改ambari.repo檔案

[[email protected] yum.repos.d]$ sudo vi ambari.repo
修改為:
#VERSION_NUMBER=2.6.2.2-1
[ambari-2.6.2.2]
name=ambari Version - ambari-2.6.2.2
baseurl=http://192.168.10.101/ambari/ambari/centos7/2.6.2.2-1
gpgcheck=1
gpgkey=http://192.168.10.101/ambari/ambari/centos7/2.6.2.2-1/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

在這裡插入圖片描述

修改hdp.repo檔案

[[email protected] yum.repos.d]$ sudo vi hdp.repo
修改為:
#VERSION_NUMBER=2.6.5.0-292
[HDP-2.6.5.0]
name=HDP Version - HDP-2.6.5.0
baseurl=http://192.168.10.101/hdp/HDP/centos7
path=/
enabled=1
gpgcheck=0

[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.22
baseurl=http://192.168.10.101/hdp/HDP-UTILS
enabled=1
gpgcheck=1

在這裡插入圖片描述

6、配置本地源

配置HDP本地源:

[[email protected] ~]$ cd /var/www/html/hdp/HDP/centos7/
[[email protected] centos7]$ sudo createrepo .
Spawning worker 0 with 60 pkgs
Spawning worker 1 with 60 pkgs
Spawning worker 2 with 59 pkgs
Spawning worker 3 with 59 pkgs
Workers Finished
Saving Primary metadata
Saving file lists metadata
Saving other metadata
Generating sqlite DBs
Sqlite DBs complete

在這裡插入圖片描述

配置HDP-UTILS本地源:

[[email protected] ~]$ cd /var/www/html/hdp/HDP-UTILS
[[email protected] HDP-UTILS]$ sudo createrepo .
Spawning worker 0 with 4 pkgs
Spawning worker 1 with 4 pkgs
Spawning worker 2 with 4 pkgs
Spawning worker 3 with 4 pkgs
Workers Finished
Saving Primary metadata
Saving file lists metadata
Saving other metadata
Generating sqlite DBs
Sqlite DBs complete

在這裡插入圖片描述

至此:Ambari安裝時需要的本地源就搭建完成了。