五、本地yum源的配置
阿新 • • 發佈:2018-12-13
企業級大資料平臺Ambari搭建與管理
本節中我們將介紹Ambari叢集安裝時候的本地yum源配置
本節的操作只需要在Hadoop01節點上進行:
1、ambari離線安裝包的下載:
2、將下載好的ambari的離線安裝包通過FileZilla上傳到Hadoop01節點上:
上傳檔案:
檢查檔案:
[[email protected] ~]$ cd /home/hadoop/Download/ [[email protected] Download]$ ls ambari-2.6.2.2-centos7.tar.gz HDP-GPL-2.6.5.0-centos7-gpl.tar.gz jdk-8u181-linux-x64.tar.gz HDP-2.6.5.0-centos7-rpm.tar.gz HDP-UTILS-1.1.0.22-centos7.tar.gz
3、搭建Http站點:
安裝httpd服務:
[[email protected] ~]$ yum install -y httpd Loaded plugins: fastestmirror You need to be root to perform this command. [[email protected] ~]$ sudo yum install -y httpd Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.cn99.com * extras: mirrors.zju.edu.cn * updates: mirrors.cn99.com Resolving Dependencies --> Running transaction check ---> Package httpd.x86_64 0:2.4.6-80.el7.centos.1 will be installed --> Processing Dependency: httpd-tools = 2.4.6-80.el7.centos.1 for package: httpd-2.4.6-80.el7.centos.1.x86_64 --> Processing Dependency: /etc/mime.types for package: httpd-2.4.6-80.el7.centos.1.x86_64 --> Processing Dependency: libaprutil-1.so.0()(64bit) for package: httpd-2.4.6-80.el7.centos.1.x86_64 --> Processing Dependency: libapr-1.so.0()(64bit) for package: httpd-2.4.6-80.el7.centos.1.x86_64 --> Running transaction check ---> Package apr.x86_64 0:1.4.8-3.el7_4.1 will be installed ---> Package apr-util.x86_64 0:1.5.2-6.el7 will be installed ---> Package httpd-tools.x86_64 0:2.4.6-80.el7.centos.1 will be installed ---> Package mailcap.noarch 0:2.1.41-2.el7 will be installed --> Finished Dependency Resolution Dependencies Resolved =========================================================================================================================== Package Arch Version Repository Size =========================================================================================================================== Installing: httpd x86_64 2.4.6-80.el7.centos.1 updates 2.7 M Installing for dependencies: apr x86_64 1.4.8-3.el7_4.1 base 103 k apr-util x86_64 1.5.2-6.el7 base 92 k httpd-tools x86_64 2.4.6-80.el7.centos.1 updates 90 k mailcap noarch 2.1.41-2.el7 base 31 k Transaction Summary =========================================================================================================================== Install 1 Package (+4 Dependent packages) Total download size: 3.0 M Installed size: 10 M Downloading packages: (1/5): apr-util-1.5.2-6.el7.x86_64.rpm | 92 kB 00:00:00 (2/5): apr-1.4.8-3.el7_4.1.x86_64.rpm | 103 kB 00:00:00 (3/5): httpd-tools-2.4.6-80.el7.centos.1.x86_64.rpm | 90 kB 00:00:00 (4/5): mailcap-2.1.41-2.el7.noarch.rpm | 31 kB 00:00:00 (5/5): httpd-2.4.6-80.el7.centos.1.x86_64.rpm | 2.7 MB 00:00:01 --------------------------------------------------------------------------------------------------------------------------- Total 2.3 MB/s | 3.0 MB 00:00:01 Running transaction check Running transaction test Transaction test succeeded Running transaction Installing : apr-1.4.8-3.el7_4.1.x86_64 1/5 Installing : apr-util-1.5.2-6.el7.x86_64 2/5 Installing : httpd-tools-2.4.6-80.el7.centos.1.x86_64 3/5 Installing : mailcap-2.1.41-2.el7.noarch 4/5 Installing : httpd-2.4.6-80.el7.centos.1.x86_64 5/5 Verifying : mailcap-2.1.41-2.el7.noarch 1/5 Verifying : httpd-tools-2.4.6-80.el7.centos.1.x86_64 2/5 Verifying : apr-util-1.5.2-6.el7.x86_64 3/5 Verifying : apr-1.4.8-3.el7_4.1.x86_64 4/5 Verifying : httpd-2.4.6-80.el7.centos.1.x86_64 5/5 Installed: httpd.x86_64 0:2.4.6-80.el7.centos.1 Dependency Installed: apr.x86_64 0:1.4.8-3.el7_4.1 apr-util.x86_64 0:1.5.2-6.el7 httpd-tools.x86_64 0:2.4.6-80.el7.centos.1 mailcap.noarch 0:2.1.41-2.el7 Complete!
啟動http服務:
[[email protected] ~]$ sudo service httpd start
Redirecting to /bin/systemctl start httpd.service
建立http站點下的ambari和hdp資料夾:
[[email protected] ~]$ sudo mkdir /var/www/html/ambari
[[email protected] ~]$ sudo mkdir /var/www/html/hdp
測試http站點連線:
使用瀏覽器開啟以下連結:
http://192.168.10.101/ambari/
http: //192.168.10.101/hdp/
成功開啟,代表站點建立成功。
4、解壓ambari檔案:
將ambari-2.6.2.2-centos7.tar.gz解壓到 /var/www/html/ambari路徑下,將 HDP-GPL-2.6.5.0-centos7-gpl.tar.gz 、HDP-2.6.5.0-centos7-rpm.tar.gz 、 HDP-UTILS-1.1.0.22-centos7.tar.gz這3個檔案解壓到/var/www/html/hdp路徑下:
[[email protected] ~]$ sudo tar -zxf /home/hadoop/Download/ambari-2.6.2.2-centos7.tar.gz -C /var/www/html/ambari
[[email protected] ~]$ sudo tar -zxf /home/hadoop/Download/HDP-2.6.5.0-centos7-rpm.tar.gz -C /var/www/html/hdp
[[email protected] ~]$ sudo tar -zxf /home/hadoop/Download/HDP-UTILS-1.1.0.22-centos7.tar.gz -C /var/www/html/hdp
[[email protected] ~]$ sudo tar -zxf /home/hadoop/Download/HDP-GPL-2.6.5.0-centos7-gpl.tar.gz -C /var/www/html/hdp
5、下載修改repo檔案
安裝wget服務
wget 可以直接從網上下載檔案
[[email protected] ~]$ sudo yum install -y httpd
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
* base: mirrors.cn99.com
* extras: mirrors.zju.edu.cn
* updates: mirrors.cn99.com
Resolving Dependencies
--> Running transaction check
---> Package httpd.x86_64 0:2.4.6-80.el7.centos.1 will be installed
--> Processing Dependency: httpd-tools = 2.4.6-80.el7.centos.1 for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: /etc/mime.types for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: libaprutil-1.so.0()(64bit) for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Processing Dependency: libapr-1.so.0()(64bit) for package: httpd-2.4.6-80.el7.centos.1.x86_64
--> Running transaction check
---> Package apr.x86_64 0:1.4.8-3.el7_4.1 will be installed
---> Package apr-util.x86_64 0:1.5.2-6.el7 will be installed
---> Package httpd-tools.x86_64 0:2.4.6-80.el7.centos.1 will be installed
---> Package mailcap.noarch 0:2.1.41-2.el7 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
===========================================================================================================================
Package Arch Version Repository Size
===========================================================================================================================
Installing:
httpd x86_64 2.4.6-80.el7.centos.1 updates 2.7 M
Installing for dependencies:
apr x86_64 1.4.8-3.el7_4.1 base 103 k
apr-util x86_64 1.5.2-6.el7 base 92 k
httpd-tools x86_64 2.4.6-80.el7.centos.1 updates 90 k
mailcap noarch 2.1.41-2.el7 base 31 k
Transaction Summary
===========================================================================================================================
Install 1 Package (+4 Dependent packages)
Total download size: 3.0 M
Installed size: 10 M
Downloading packages:
(1/5): apr-util-1.5.2-6.el7.x86_64.rpm | 92 kB 00:00:00
(2/5): apr-1.4.8-3.el7_4.1.x86_64.rpm | 103 kB 00:00:00
(3/5): httpd-tools-2.4.6-80.el7.centos.1.x86_64.rpm | 90 kB 00:00:00
(4/5): mailcap-2.1.41-2.el7.noarch.rpm | 31 kB 00:00:00
(5/5): httpd-2.4.6-80.el7.centos.1.x86_64.rpm | 2.7 MB 00:00:01
---------------------------------------------------------------------------------------------------------------------------
Total 2.3 MB/s | 3.0 MB 00:00:01
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : apr-1.4.8-3.el7_4.1.x86_64 1/5
Installing : apr-util-1.5.2-6.el7.x86_64 2/5
Installing : httpd-tools-2.4.6-80.el7.centos.1.x86_64 3/5
Installing : mailcap-2.1.41-2.el7.noarch 4/5
Installing : httpd-2.4.6-80.el7.centos.1.x86_64 5/5
Verifying : mailcap-2.1.41-2.el7.noarch 1/5
Verifying : httpd-tools-2.4.6-80.el7.centos.1.x86_64 2/5
Verifying : apr-util-1.5.2-6.el7.x86_64 3/5
Verifying : apr-1.4.8-3.el7_4.1.x86_64 4/5
Verifying : httpd-2.4.6-80.el7.centos.1.x86_64 5/5
Installed:
httpd.x86_64 0:2.4.6-80.el7.centos.1
Dependency Installed:
apr.x86_64 0:1.4.8-3.el7_4.1 apr-util.x86_64 0:1.5.2-6.el7 httpd-tools.x86_64 0:2.4.6-80.el7.centos.1
mailcap.noarch 0:2.1.41-2.el7
Complete!
[[email protected] ~]$ sudo service httpd start
Redirecting to /bin/systemctl start httpd.service
[[email protected] ~]$ sudo service httpd start
Redirecting to /bin/systemctl start httpd.service
[[email protected] ~]$ sudo service httpd stop
Redirecting to /bin/systemctl stop httpd.service
[[email protected] ~]$ sudo service httpd start
Redirecting to /bin/systemctl start httpd.service
[[email protected] ~]$ sudo mkdir /var/www/html/ambari
[[email protected] ~]$ sudo mkdir /var/www/html/hdp
[[email protected] ~]$ sudo yum install -y wget
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
* base: mirrors.cn99.com
* extras: mirrors.zju.edu.cn
* updates: mirrors.cn99.com
Resolving Dependencies
--> Running transaction check
---> Package wget.x86_64 0:1.14-15.el7_4.1 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
===========================================================================================================================
Package Arch Version Repository Size
===========================================================================================================================
Installing:
wget x86_64 1.14-15.el7_4.1 base 547 k
Transaction Summary
===========================================================================================================================
Install 1 Package
Total download size: 547 k
Installed size: 2.0 M
Downloading packages:
wget-1.14-15.el7_4.1.x86_64.rpm | 547 kB 00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : wget-1.14-15.el7_4.1.x86_64 1/1
Verifying : wget-1.14-15.el7_4.1.x86_64 1/1
Installed:
wget.x86_64 0:1.14-15.el7_4.1
Complete!
獲取repo檔案:
[[email protected] ~]$ cd /etc/yum.repos.d
[[email protected] yum.repos.d]$ sudo wget http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.2.2/ambari.repo
--2018-10-01 16:20:56-- http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.2.2/ambari.repo
Resolving public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)... 13.35.99.12, 13.35.99.3, 13.35.99.21, ...
Connecting to public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)|13.35.99.12|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 304 [binary/octet-stream]
Saving to: ‘ambari.repo’
100%[==============================================================>] 304 --.-K/s in 0s
2018-10-01 16:20:58 (13.5 MB/s) - ‘ambari.repo’ saved [304/304]
[[email protected] yum.repos.d]$ sudo wget http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.0/hdp.repo
--2018-10-01 16:21:12-- http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.0/hdp.repo
Resolving public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)... 13.35.99.12, 13.35.99.3, 13.35.99.21, ...
Connecting to public-repo-1.hortonworks.com (public-repo-1.hortonworks.com)|13.35.99.12|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 575 [binary/octet-stream]
Saving to: ‘hdp.repo’
100%[==============================================================>] 575 --.-K/s in 0s
2018-10-01 16:21:12 (27.7 MB/s) - ‘hdp.repo’ saved [575/575]
修改repo檔案:
修改ambari.repo檔案
[[email protected] yum.repos.d]$ sudo vi ambari.repo
修改為:
#VERSION_NUMBER=2.6.2.2-1
[ambari-2.6.2.2]
name=ambari Version - ambari-2.6.2.2
baseurl=http://192.168.10.101/ambari/ambari/centos7/2.6.2.2-1
gpgcheck=1
gpgkey=http://192.168.10.101/ambari/ambari/centos7/2.6.2.2-1/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
修改hdp.repo檔案
[[email protected] yum.repos.d]$ sudo vi hdp.repo
修改為:
#VERSION_NUMBER=2.6.5.0-292
[HDP-2.6.5.0]
name=HDP Version - HDP-2.6.5.0
baseurl=http://192.168.10.101/hdp/HDP/centos7
path=/
enabled=1
gpgcheck=0
[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.22
baseurl=http://192.168.10.101/hdp/HDP-UTILS
enabled=1
gpgcheck=1
6、配置本地源
配置HDP本地源:
[[email protected] ~]$ cd /var/www/html/hdp/HDP/centos7/
[[email protected] centos7]$ sudo createrepo .
Spawning worker 0 with 60 pkgs
Spawning worker 1 with 60 pkgs
Spawning worker 2 with 59 pkgs
Spawning worker 3 with 59 pkgs
Workers Finished
Saving Primary metadata
Saving file lists metadata
Saving other metadata
Generating sqlite DBs
Sqlite DBs complete
配置HDP-UTILS本地源:
[[email protected] ~]$ cd /var/www/html/hdp/HDP-UTILS
[[email protected] HDP-UTILS]$ sudo createrepo .
Spawning worker 0 with 4 pkgs
Spawning worker 1 with 4 pkgs
Spawning worker 2 with 4 pkgs
Spawning worker 3 with 4 pkgs
Workers Finished
Saving Primary metadata
Saving file lists metadata
Saving other metadata
Generating sqlite DBs
Sqlite DBs complete
至此:Ambari安裝時需要的本地源就搭建完成了。