2. 程式人生 > >Ubuntu14.04下完美安裝cloudermanage多種方式（圖文詳解）（博主推薦）

Ubuntu14.04下完美安裝cloudermanage多種方式（圖文詳解）（博主推薦）

阿新 • • 發佈：2019-01-13

說在前面的話

　　我的機器是總共4臺，分別為ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4。

　　ClouderaManager官網

https://www.cloudera.com/documentation/manager/5-0-x/Cloudera-Manager-Installation-Guide/cm5ig_install_path_B.html

　　在ubuntucmbigdata1上執行了

sudo apt-get install cloudera-manager-daemons cloudera-manager-server 


sudo apt-get install cloudera-manager-daemons  cloudera-manager-agent

　　即，ubuntucmbigdata1是既做server，又做agent。

　　在ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4上執行了

sudo apt-get install cloudera-manager-daemons  cloudera-manager-agent

　　即，ubuntucmbigdata2、3、和4是隻做agent。

　　在ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上

新建檔案sudo vi /etc/apt/sources.list.d/cloudera-manager.list

，複製以下內容到cloudera.list裡

# Packages for Cloudera Manager, Version 5, on Ubuntu 14.04 x86_64
deb [arch=amd64] http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib
deb-src http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib

　　並且在在ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上

　　向apt新增cloudera源公鑰，在所有節點執行如下命令：

curl -s http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm/archive.key | sudo apt-key add -

然後，再

sudo apt-get update

方式1、將CDH5的軟體源新增到Apt中，通過線上安裝。

參考

 https://www.zybuluo.com/ncepuwanghui/note/474966

 配置Cloudera軟體倉庫

Cloudera官方文件提供了兩種管理倉庫策略： 
• Standard Cloudera repositories 
• Internally hosted repositories

本文采用Standard Cloudera repositories，步驟如下： 
① 在ubuntucmbigdata1節點下載cloudera.list

wget https://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm/cloudera.list?_ga=1.37493987.2113753785.1471598714

② 在ubuntucmbigdata1節點新建檔案sudo vi /etc/apt/sources.list.d/cloudera-manager.list，複製cloudera.list的內容

# Packages for Cloudera Manager, Version 5, on Ubuntu 14.04 x86_64
deb [arch=amd64] http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib
deb-src http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib

③ 將cloudera-manager.list分發到所有slave節點：

scp /etc/apt/sources.list.d/cloudera-manager.list [email protected]:/etc/apt/sources.list.d/cloudera-manager.list
scp /etc/apt/sources.list.d/cloudera-manager.list [email protected]:/etc/apt/sources.list.d/cloudera-manager.list
scp /etc/apt/sources.list.d/cloudera-manager.list [email protected]:/etc/apt/sources.list.d/cloudera-manager.list
  1. ④ 向apt新增cloudera源公鑰，在所有節點執行如下命令：
curl -s http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm/archive.key | sudo apt-key add -
  1. ⑤ 在所有節點，更新源
sudo apt-get update

若更新出錯，提示如下：

  1. W: GPG error: http://archive.cloudera.com trusty-cm5 InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 327574EE02A818DD

可執行如下命令，新增cloudera源的公鑰，重新更新源：

    1. curl -s http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm/archive.key | sudo apt-key add -

安裝Cloudera Manager Server

    • 安裝Cloudera Manager Server軟體包 
      在maubuntucmbigdata1ster節點上執行：

      1. sudo apt-get install cloudera-manager-daemons cloudera-manager-server

    • 建立Cloudera Manager Server資料庫scm

    • mysql -u root -p
create database scm DEFAULT CHARACTER SET utf8;
grant all on scm.* TO 'scm'@'%' IDENTIFIED BY 'scm_password';
grant all on *.* TO 'scm'@'ubuntucmbigdata1' IDENTIFIED BY 'scm_password';
grant all on scm.* TO 'scm'@'localhost' IDENTIFIED BY 'scm_password';
flush privileges;
    • 同時，關於這裡的mysql配置，還要加上，我這篇部落格裡的mysql內容 
      • mysql> create database hive DEFAULT CHARACTER SET utf8;
Ignoring query to other database
mysql> grant all on hive.* TO 'hive'@'localhost' IDENTIFIED BY 'hive_password';
Ignoring query to other database
mysql> grant all on *.* TO 'hive'@'ubuntucmbigdata1' IDENTIFIED BY 'hive_password';
Ignoring query to other database
mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive_password';  
Ignoring query to other database
mysql> create database oozie DEFAULT CHARACTER SET utf8;
Ignoring query to other database
mysql> grant all on oozie.* TO 'oozie'@'localhost' IDENTIFIED BY 'oozie_password';
Ignoring query to other database
mysql> grant all on *.* TO 'oozie'@'ubuntucmbigdata1' IDENTIFIED BY 'oozie_password';
Ignoring query to other database
mysql> grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie_password';
Ignoring query to other database
mysql> create database amon DEFAULT CHARACTER SET utf8;
Ignoring query to other database
mysql> grant all on amon.* TO 'amon'@'localhost' IDENTIFIED BY 'amon_password';
Ignoring query to other database
mysql> grant all on *.* TO 'amon'@'ubuntucmbigdata1' IDENTIFIED BY 'amon_password';
Ignoring query to other database
mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password';
Ignoring query to other database
mysql> create database smon DEFAULT CHARACTER SET utf8;
Ignoring query to other database
mysql> grant all on smon.* TO 'smon'@'localhost' IDENTIFIED BY 'smon_password';
Ignoring query to other database
mysql> grant all on *.* TO 'smon'@'ubuntucmbigdata1' IDENTIFIED BY 'smon_password';
Ignoring query to other database
mysql> grant all on smon.* TO 'smon'@'%' IDENTIFIED BY 'smon_password';
Ignoring query to other database
mysql> create database rman DEFAULT CHARACTER SET utf8;
Ignoring query to other database
mysql> grant all on rman.* TO 'rman'@'localhost' IDENTIFIED BY 'rman_password';
Ignoring query to other database
mysql> grant all on *.* TO 'rman'@'ubuntucmbigdata1' IDENTIFIED BY 'rman_password';
Ignoring query to other database
mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password';
Ignoring query to other database
mysql> create database hmon DEFAULT CHARACTER SET utf8;
Ignoring query to other database
mysql> grant all on hmon.* TO 'hmon'@'localhost' IDENTIFIED BY 'hmon_password';
Ignoring query to other database
mysql> grant all on *.* TO 'hmon'@'ubuntucmbigdata1' IDENTIFIED BY 'hmon_password';
Ignoring query to other database
mysql> grant all on hmon.* TO 'hmon'@'%' IDENTIFIED BY 'hmon_password';
Ignoring query to other database
mysql> create database nav DEFAULT CHARACTER SET utf8;
Ignoring query to other database
mysql> grant all on nav.* TO 'nav'@'localhost' IDENTIFIED BY 'nav_password';
Ignoring query to other database
mysql> grant all on *.* TO 'nav'@'ubuntucmbigdata1' IDENTIFIED BY 'nav_password';
Ignoring query to other database
mysql> grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav_password';
Ignoring query to other database
mysql> flush privileges;
        mysql> exit;
Bye
[email protected]:~#

    • 配置啟動Cloudera Manager Server （只在ubuntucmbigdata1上執行）

      1. sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm scm_password

    • 也許大家會出現這個錯誤。

    • [email protected]:~# sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm scm_password
+======================================================================+
|      Error: JAVA_HOME is not set and Java could not be found         |
+----------------------------------------------------------------------+
| Please download the latest Oracle JDK from the Oracle Java web site  |
|  > http://www.oracle.com/technetwork/java/javase/index.html <        |
|                                                                      |
| Cloudera Manager requires Java 1.6 or later.                         |
| NOTE: This script will find Oracle Java whether you install using    |
|       the binary or the RPM based installer.                         |
+======================================================================+
[email protected]:~#

      則，需要安裝jdk。

    • 成功的話，則是如下
    • [email protected]:/usr/java$ sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm scm_password
JAVA_HOME=/usr/java/jdk1.7.0_80
Verifying that we can write to /etc/cloudera-scm-server
Creating SCM configuration file in /etc/cloudera-scm-server
Executing:  /usr/java/jdk1.7.0_80/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db.
[                          main] DbCommandExecutor              INFO  Successfully connected to database.
All done, your SCM database is configured correctly!
[email protected]:/usr/java$

    • 安裝JDK1.7 （所有節點）
      CDH要求至少是Oracle JDK7，Ubuntu自帶的是OpenJDK，Ubuntu沒有自帶的Oracle JDK,必須新增外部源才能安裝JDK。 
      ① 採用Cloudera軟體源 
      在上一步配置Cloudera軟體源後，可直接執行下面命令安裝：

      1. sudo apt-get install oracle-j2sdk1.7

      ② 採用PPP源 
      新增PPA repository到系統,配置PPP源安裝：

      1. sudo add-apt-repository ppa:webupd8team/java
      2. sudo apt-get update
      3. sudo apt-get upgrade
      4. sudo apt-get install oracle-java7-installer
      5. sudo apt-get install oracle-java7-set-default
      6. java -version

      注：若提示如下資訊：

      1. sha256sum mismatch jdk-7u80-linux-x64.tar.gz
      2. Oracle JDK 7 is NOT installed.

      可能是jdk軟體包沒有下載完全，可執行如下命令刪除後重新安裝：

      1. sudo apt-get purge oracle-java7-installer

      ③ 手動安裝 
      從Oracle官網下載JDK7u80：jdk-7u80-linux-x64.tar.gz，解壓到/usr/java/jdk.1.7.0_80

      1. mkdir /usr/java
      2. sudo tar -zxvf jdk-7u80-linux-x64.tar.gz -C /usr/java

      配置JDK環境變數： 

    • vim /etc/profile

      • source /etc/profile

        #jdk
export JAVA_HOME=/usr/java/jdk1.7.0_80
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$PATH:$JAVA_HOME/bin

　　如果上述安裝錯了，檢視和解除安裝命令。

　　則為

dpkg --list | grep -i jdk
sudo apt-get remove oracle-j2sdk1.6
sudo apt-get purge oracle-java7-set-default
sudo apt-get purge  oracle-java7-installer

　　　　安裝orcal-java7-installer出錯，則見

　　orcal-java7-installer中斷錯誤 CSDN

  • 　sudo service cloudera-scm-server start（只在ubuntucmbigdata1上執行）
  • 成功，則出現
  • [email protected]:/usr/java$ sudo service cloudera-scm-server start
Starting cloudera-scm-server:  * cloudera-scm-server started

[email protected]:/usr/java$

  • 若啟動報錯：

    1. /etc/init.d/cloudera-scm-server: line 292: [[: [error] JVM PermGen is set less than 256m, CM server may run out of PermGen space. Update CMF_JAVA_OPTS in /etc/default/cloudera-scm-server to fix this.: syntax error: operand expected (error token is "[error] JVM PermGen is set less than 256m, CM server may run out of PermGen space. Update CMF_JAVA_OPTS in /etc/default/cloudera-scm-server to fix this.")
    2. /etc/init.d/cloudera-scm-server: line 292: [[: [error] JVM MaxHeap is set less than 2G, CM server may run out of Heap space. Update CMF_JAVA_OPTS in /etc/default/cloudera-scm-server to fix this.: syntax error: operand expected (error token is "[error] JVM MaxHeap is set less than 2G, CM server may run out of Heap space. Update CMF_JAVA_OPTS in /etc/default/cloudera-scm-server to fix this.")

    修改配置檔案/etc/default/cloudera-scm-server，找到export CM_JAVA_OPTS部分，將-Xmx2G修改為-Xmx4G

  • 檢視日誌，驗證是否成功啟動

    1. tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

安裝Cloudera Manager Agents

    • 安裝Cloudera Manager Agent軟體包 
      在所有節點（包括ubuntucmbigdata1）上執行：

      1. sudo apt-get install cloudera-manager-agent cloudera-manager-daemons

    • 配置Cloudera Manager Agent 
      在所有節點上，修改配置檔案sudo vi /etc/cloudera-scm-agent/config.ini，配置Cloudera Manager Server的主機和埠：

      1. server_host=ubuntucmbigdata1
      2. server_port=7182 #預設埠即可

    • 啟動Cloudera Manager Agent（包含ubuntucmbigdata1）

      1. sudo service cloudera-scm-agent start
[email protected]ubuntucmbigdata1:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
[email protected]:~$ 

[email protected]ubuntucmbigdata2:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
[email protected]:~$ 



[email protected]ubuntucmbigdata3:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
[email protected]:~$ 





[email protected]ubuntucmbigdata4:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
[email protected]:~$

方式2、放在/opt/softwares/cm-5.6.0

參考

　　先不用安裝什麼jdk，以及什麼其他的。只如下執行就是

　　執行cloudera-manager-installer.bin

複製程式碼 複製程式碼 
[email protected]:~$ sudo mkdir -p /opt/softwares/cm-5.6.0
[sudo] password for bigdata: 
[email protected]:~$ cd /opt/softwares/cm-5.6.0/
[email protected]:/opt/softwares/cm-5.6.0$ pwd
/opt/softwares/cm-5.6.0
[email protected]:/opt/softwares/cm-5.6.0$ ll
total 8
drwxr-xr-x 2 root root 4096  6月 25 22:19 ./
drwxr-xr-x 3 root root 4096  6月 25 22:19 ../
[email protected]:/opt/softwares/cm-5.6.0$ sudo chown -R bigdata:bigdata /opt/softwares/*
[email protected]:/opt/softwares/cm-5.6.0$ ll
total 8
drwxr-xr-x 2 bigdata bigdata 4096  6月 25 22:19 ./
drwxr-xr-x 3 root    root    4096  6月 25 22:19 ../
[email protected]:/opt/softwares/cm-5.6.0$ sudo rz
rz waiting to receive.
[email protected]:/opt/softwares/cm-5.6.0$ ll
total 516
drwxr-xr-x 2 bigdata bigdata   4096  6月 25 22:21 ./
drwxr-xr-x 3 root    root      4096  6月 25 22:19 ../
-rw-r--r-- 1 root    root    517878  6月 25 22:17 cloudera-manager-installer.bin
[email protected]:/opt/softwares/cm-5.6.0$ sudo chown -R bigdata:bigdata cloudera-manager-installer.bin 
[email protected]:/opt/softwares/cm-5.6.0$ ll
total 516
drwxr-xr-x 2 bigdata bigdata   4096  6月 25 22:21 ./
drwxr-xr-x 3 root    root      4096  6月 25 22:19 ../
-rw-r--r-- 1 bigdata bigdata 517878  6月 25 22:17 cloudera-manager-installer.bin
[email protected]:/opt/softwares/cm-5.6.0$ sudo chmod +x ./cloudera-manager-installer.bin
[email protected]:/opt/softwares/cm-5.6.0$ ll
total 516
drwxr-xr-x 2 bigdata bigdata   4096  6月 25 22:21 ./
drwxr-xr-x 3 root    root      4096  6月 25 22:19 ../
-rwxr-xr-x 1 bigdata bigdata 517878  6月 25 22:17 cloudera-manager-installer.bin*
[email protected]:/opt/softwares/cm-5.6.0$
複製程式碼 複製程式碼

 

複製程式碼 複製程式碼 
[email protected]:/etc/apt/sources.list.d$ pwd
/etc/apt/sources.list.d
[email protected]:/etc/apt/sources.list.d$ ll
total 12
drwxr-xr-x 2 root root 4096  6月 25 20:26 ./
drwxr-xr-x 6 root root 4096  6月 25 20:26 ../
-rw-r--r-- 1 root root  136  6月 25 20:26 webupd8team-java-trusty.list
[email protected]:/etc/apt/sources.list.d$ sudo curl "http://archive.cloudera.com/cm5/ubuntu/precise/amd64/cm/cloudera.list" -o /etc/apt/sources.list.d/cloudera_precise.list
[sudo] password for bigdata: 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   263  100   263    0     0    422      0 --:--:-- --:--:-- --:--:--   422
[email protected]:/etc/apt/sources.list.d$ ll
total 16
drwxr-xr-x 2 root root 4096  6月 25 22:26 ./
drwxr-xr-x 6 root root 4096  6月 25 20:26 ../
-rw-r--r-- 1 root root  263  6月 25 22:26 cloudera_precise.list
-rw-r--r-- 1 root root  136  6月 25 20:26 webupd8team-java-trusty.list
[email protected]:/etc/apt/sources.list.d$ sudo curl -s http://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/archive.key | sudo apt-key add -
OK
[email protected]:/etc/apt/sources.list.d$ sudo apt-get update
複製程式碼 複製程式碼 

[email protected]:~$ cd /etc/apt/sources.list.d
[email protected]:/etc/apt/sources.list.d$ ll
total 16
drwxr-xr-x 2 root root 4096 Jun 26 11:10 ./
drwxr-xr-x 6 root root 4096 Jun 26 11:10 ../
-rw-r--r-- 1 root root  175 Oct 20  2015 cloudera-cm5.list
-rw-r--r-- 1 root root  263 Jun 26 11:10 cloudera_precise.list
[email protected]:/etc/apt/sources.list.d$

 

[email protected]:/opt/softwares/cm-5.6.0$ ll
total 516
drwxr-xr-x 2 bigdata bigdata   4096  6月 25 22:21 ./
drwxr-xr-x 3 root    root      4096  6月 25 22:19 ../
-rwxr-xr-x 1 bigdata bigdata 517878  6月 25 22:17 cloudera-manager-installer.bin*
[email protected]:/opt/softwares/cm-5.6.0$ sudo ./cloudera-manager-installer.bin

 

 

 

 　　省略。

　　也許中間，會報錯，這個一一解決就是了

 

[email protected]:~$ cat /var/log/cloudera-manager-installer/3.install-oracle-j2sdk1.7.log
Reading package lists...
Building dependency tree...
Reading state information...
The following packages were automatically installed and are no longer required:
  libntdb1 python-ntdb
Use 'apt-get autoremove' to remove them.
The following NEW packages will be installed:
  oracle-j2sdk1.7
0 upgraded, 1 newly installed, 0 to remove and 6 not upgraded.
2 not fully installed or removed.
Need to get 142 MB of archives.
After this operation, 292 MB of additional disk space will be used.
Get:1 http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm/ trusty-cm5/contrib oracle-j2sdk1.7 amd64 1.7.0+update67-1 [142 MB]
Fetched 142 MB in 15min 9s (157 kB/s)
Selecting previously unselected package oracle-j2sdk1.7.
(Reading database ... 172281 files and directories currently installed.)
Preparing to unpack .../oracle-j2sdk1.7_1.7.0+update67-1_amd64.deb ...
Unpacking oracle-j2sdk1.7 (1.7.0+update67-1) ...
Setting up oracle-java7-installer (7u80+7u60arm-0~webupd8~1) ...
Downloading Oracle Java 7...
--2017-06-26 00:20:41--  http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
Resolving download.oracle.com (download.oracle.com)... 23.2.16.218, 23.2.16.121
Connecting to download.oracle.com (download.oracle.com)|23.2.16.218|:80... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https://edelivery.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz [following]
--2017-06-26 00:20:41--  https://edelivery.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
Resolving edelivery.oracle.com (edelivery.oracle.com)... 96.16.169.83, 2402:4f00:4001:197::2d3e, 2402:4f00:4001:180::2d3e
Connecting to edelivery.oracle.com (edelivery.oracle.com)|96.16.169.83|:443... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1498407762_def59b5e0df725a8c8cee2b6d12ac74e [following]
--2017-06-26 00:20:42--  http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1498407762_def59b5e0df725a8c8cee2b6d12ac74e
Connecting to download.oracle.com (download.oracle.com)|23.2.16.218|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2017-06-26 00:20:43 ERROR 404: Not Found.

download failed
Oracle JDK 7 is NOT installed.
dpkg: error processing package oracle-java7-installer (--configure):
 subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of oracle-java7-set-default:
 oracle-java7-set-default depends on oracle-java7-installer; however:
  Package oracle-java7-installer is not configured yet.

dpkg: error processing package oracle-java7-set-default (--configure):
 dependency problems - leaving unconfigured
Setting up oracle-j2sdk1.7 (1.7.0+update67-1) ...
No apport report written because the error message indicates its a followup error from a previous failure.
Errors were encountered while processing:
 oracle-java7-installer
 oracle-java7-set-default
E: Sub-process /usr/bin/dpkg returned an

　　解決這個問題，還是得自己手動下載來安裝，才得以解決。

 　　它的下載連結

http://download.oracle.com/otn/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz

 

#java
export JAVA_HOME=/usr/java/jdk1.7.0_80
export JRE_HOME=$JAVA_HOME/jre
export CLASSPATH=.:$JAVA_HOME/lib:$JRE_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin

[email protected]:/usr/java$ sudo vim ~/.bashrc

 

總結

　　對於這步安裝jdk，需要注意，見

https://www.zybuluo.com/ncepuwanghui/note/474966

Ubuntu Server 14.04 安裝部署 CDH5.7.2

　　這裡，我也覺得很奇怪，在ubuntu系統裡，是localhost，可我明明登出掉了。這跟centos下安裝有點不同。

 　　但是呢，竟然可以用ubuntucmbigdata1:7810或者192.168.86.31來訪問。

　　當安裝完成，Cloudera Manager 管理控制檯會提供一個完成的url包括預設埠7180。（這個安裝過程可能持續很長時間，網速較慢，可能會持續一上午，甚至一天）
這時候把這個地址輸入瀏覽器位址列，就能看到頁面了。預設使用者名稱和密碼都為admin.

 

 　　成功！

 　　若是通過bin方式安裝的話，則

 

[email protected]:/etc/init.d$ pwd
/etc/init.d
[email protected]:/etc/init.d$ ls
acpid    apparmor      bluetooth            cloudera-scm-server-db  cups          dns-clean          halt        killprocs  mysql       ondemand    procps      rc.local  reboot      rsync    sendsigs  speech-dispatcher  thermald  umountnfs.sh         urandom
anacron  apport        brltty               console-setup           cups-browsed  friendly-recovery  irqbalance  kmod       networking  postgresql  pulseaudio  rcS       resolvconf  rsyslog  single    ssh                udev      umountroot           x11-common
apache2  avahi-daemon  cloudera-scm-server  cron                    dbus          grub-common        kerneloops  lightdm    ntp         pppd-dns    rc          README    rpcbind     saned    skeleton  sudo               umountfs  unattended-upgrades
[email protected]:/etc/init.d$ sudo /etc/init.d/cloudera-scm-server start
Starting cloudera-scm-server:  * cloudera-scm-server started

[email protected]:/etc/init.d$ sudo /etc/init.d/cloudera-scm-server-db start
 * Cloudera manager database already started
[email protected]:/etc/init.d$

 

[email protected]:~$ cd /etc/init.d/
[email protected]:/etc/init.d$ ls
acpid    apparmor      bluetooth           console-setup  cups-browsed  friendly-recovery  irqbalance  kmod        ntp       procps      rc.local  reboot      rsync    sendsigs  speech-dispatcher  thermald  umountnfs.sh         urandom
anacron  apport        brltty              cron           dbus          grub-common        kerneloops  lightdm     ondemand  pulseaudio  rcS       resolvconf  rsyslog  single    ssh                udev      umountroot           x11-common
apache2  avahi-daemon  cloudera-scm-agent  cups           dns-clean     halt               killprocs   networking  pppd-dns  rc          README    rpcbind     saned    skeleton  sudo               umountfs  unattended-upgrades
[email protected]:/etc/init.d$ sudo ./cloudera-scm-agent start
cloudera-scm-agent is already running
[email protected]:/etc/init.d$

 方式3，通過tar,gz方法

其實很簡單，網上寫的資料各種雜活。就是如下！（博主，我是很喜歡這個人寫的這篇部落格）！！！！

　　的確，我也跟這位博主一樣，也需要在實驗室裡部署。以及也是4臺機器。（至於原因，大家都懂得，中國高校研究生喜歡4、3、2、1來進行加速比做實驗論文）

     在實驗室安裝過社群版的Hadoop，當時用的是普通PC機，安裝的過程遇到了好多問題。當解決了大部分的安裝問題之後由於實驗室的需求，需要安裝一個商業發行版的hadoop ，我們就採用的Cloudera 公司發行的版本。首先要說明的是CDH對記憶體要求比較高，當我們採用原來的4G記憶體的PC機，只要啟動基本記憶體就滿了，並且會拖慢整個叢集的運算速度。所以說安裝CDH對硬體的要求比較高。安裝CDH 有三種安裝方式：線上安裝、半離線安裝、離線安裝。線上安裝和離線安裝我都安裝過，雖然線上安裝貌似簡單但是實際用起來還是沒有離線安裝方便，我還是建議大家採用離線安裝的方式。不過下面都會介紹線上安裝的方式和離線安裝的方式。希望對別人有所幫助。

 　　關於，前期的介紹、硬體基礎、安裝Ubuntu14.04系統、設定hosts、關閉防火牆、設定靜態IP、安裝Oracle JDK 8（所有節點）、所有節點免密碼SSH登陸、建立資料庫（僅主機）、設定叢集時間同步(所有節點）。我都上面已經做好了。

相關軟體和下載

　　因為，我這裡是ubuntu14.04，所以

　　同理，我這裡，也不去一枚地追求新，採用的是5.6.0

 　　這個網上多的是，大家隨便去下載就是了


根據系統下載所相應的版本，下載的檔案如下

cloudera-manager-trusty-cm5.6.0_amd64.tar.gz
CDH-5.6.0-1.cdh5.6.0.p0.45-trusty.parcel
CDH-5.6.0-1.cdh5.6.0.p0.45-tr

相關推薦

Ubuntu14.04下完美安裝cloudermanage多種方式（圖文詳解）（博主推薦）

說在前面的話 　　我的機器是總共4臺，分別為ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4。 　　ClouderaManager官網 https://www.cloudera.com/docume

Ubuntu14.04下編譯安裝或apt-get方式安裝搭建Apache或Httpd服務（圖文詳解）

 　　不多說，直接上乾貨！ 寫在前面的話 　　對於 　　在Ubuntu系統上，編譯安裝Apache它預設路徑是在/usr/local/apache2/htdocs 　　　　　　　　　　或者編譯安裝httpd它預設路徑是在/usr/local/apache/htdocs 　  

ubuntu14.04下vnc安裝、配置和使用

1.更新系統 apt-get update -y apt-get upgrade -y  2. 安裝gnome環境相關，sudo apt-get install ubuntu-desktop gnome-panel gnome-settings-daemon meta

Ubuntu14.04下Ambari安裝搭建部署大資料叢集（圖文分五大步詳解）（博主強烈推薦）

 　　　　不多說，直接上乾貨！ 寫在前面的話 　　（1） 最近一段時間，因擔任我團隊實驗室的大資料環境叢集真實物理機器工作，至此，本人秉持負責、認真和細心的態度，先分別在虛擬機器上模擬搭建ambari（基於CentOS6.5版本）和cloudermanager（基於CentOS6.5或Ub

Ubuntu14.04下Neo4j圖資料庫官網安裝部署步驟（圖文詳解）（博主推薦）

　　不多說，直接上乾貨！ 說在前面的話 　  首先，檢視下你的作業系統的版本。  [email protected]:~# cat /etc/issue Ubuntu 14.04.4 LTS \n \l [email protected]:~#

Linux-Ubuntu14.04下mongodb安裝部署

  mongo 下載：https://www.mongodb.com/download-center/community?jmp=nav 建立目錄，將下載的檔案放在如下位置 [email protected]:/usr/local$ sudo mkdir mongo [emai

RabbitMQ：在Ubuntu14.04下的安裝筆記

安裝 有兩種辦法，一是直接從官網下載最新的deb檔案，但是在你dpkg -i 時，因為缺少erlang的依賴，只能再通過apt-get install -f 安裝erlang，最終也能成功，但是會有一些不舒服的錯誤提示。 建議使用另一個官網上提供的安裝辦

【雲端計算虛擬化】docker在ubuntu14.04下的安裝

關於Docker：網上的介紹太多了，就不再贅述，總之就是很好用。 執行之前確保有管理員許可權。 1，安裝wget： 確保有wget 如果沒有：sudo apt-get install wget 2，安裝docker： 3，驗證docker

ubuntu14.04下docker安裝方法

使用命令 uname -r 確保比版本比3.10高。 更新安裝包 sudo apt-get update 設定成中文環境，具體操作步驟見 點選這裡檢視詳細步驟 依次執行下面的兩條命令： sudo apt-get install apt-trans

Ubuntu14.04下virtualbox安裝win7虛擬機器問題總結以及刪除virtualbox方法

一     在Ubuntu安裝好之後是雙系統，但是兩個系統之間開關機切換很麻煩，於是在Ubuntu之下安裝了virtualbox然後準備安裝win7虛擬機器做一些原圖設計等工作，但是折騰了半天沒有正確安裝，但是最後還是將win7虛擬機器安裝好了，在此總結一下方法和遇到的問題

cmake3.2.2 在Ubuntu14.04下的安裝

########################################################3 1.判斷相關軟體是否安裝 sudo apt-get install build-essential 2.刪除先前版本的cmake(如果有的話) sudo

Ubuntu14.04下編譯安裝vtk

VTK是一個基於面向物件的開源三維繪圖軟體包，安裝過程並不複雜，可由多種方法安裝，如果想要安裝自己想要的版本，編譯安裝是最好的方式，簡單的cmake就可以編譯安裝。此處也簡單說一下非編譯安裝：一、非編譯安裝方法1）sudo pip install vtk 將會安裝最新版vtk

Linux、ubuntu14.04下原始碼安裝node.js、express

最近要使用node.js開發，學習後總結一下。 1、node.js下載 所有版本： 2、安裝nodejs 解壓： sudo tar -zxvf node-v6.9.5.tar.gz -

Ubuntu14.04 下 OpenCV3 安裝

一 按照官網安裝Opencv步驟： 1.需要的包：     GCC 4.4.x 或更高     CMake 2.8.7 或更高     Git     GTK+2.x 或更高，包括頭（libgtk2.0-dev）     pkg-config     Python 2.6

StreamSets學習系列之StreamSets支持多種安裝方式（圖文詳解）

pre 技巧 height targe png 數據分析 語言 微信公眾號 mage 　　不多說，直接上幹貨！ Streamsets的官網 https://streamsets.com/

全網最全的Windows下Anaconda2 / Anaconda3里正確下載安裝OpenCV（離線方式和線上方式）（圖文詳解）

　　不多說，直接上乾貨！   　　說明： 　　　　Anaconda2-5.0.0-Windows-x86_64.exe安裝下來，預設的Python2.7 　　　　Anaconda3-4.2.0-Windows-x86_64.exe安裝下來，預設的Python3.5 　　　

全網最詳細的基於Ubuntu14.04/16.04 + Anaconda2 / Anaconda3 + Python2.7/3.4/3.5/3.6安裝Tensorflow詳細步驟（圖文）（博主推薦）

　　不多說，直接上乾貨！ 前言 　　建議參照最新的tensorflow安裝步驟（Linux，官方網站經常訪問不是很穩定，所以給了一個github的地址）：　　        https://github.com/tensorflow/tensorflow/blob/master/t

全網最全的Windows下Anaconda2 / Anaconda3里正確下載安裝爬蟲框架Scrapy（離線方式和線上方式）（圖文詳解）

　　　　　　不多說，直接上乾貨！ 　　參考部落格 　　　　第一步：首先，提示升級下pip   　　　　第二步：下載安裝wheel  　　　　也可以去網站裡先下載好，離線安裝。也可以如上線上安裝。  　　　　第三

cloudermanger安裝時需要安裝或徹底正確解除安裝再安裝orcal-java7-installer、oracle-java7-set-default（ubuntu14.04版本）（圖文詳解）

歡迎您的加入！ 微信公眾號平臺： 大資料躺過的坑 微信公眾號平臺： 人工智慧躺過的坑 大資料和人工智慧躺過的坑（總群）： 161156071 更多QQ技術分群，詳情請見：http://www.cnblogs.com/zls

Ubuntu16.04下Neo4j圖資料庫官網安裝部署步驟（圖文詳解）（博主推薦）

　不多說，直接上乾貨！ 說在前面的話 　  首先，檢視下你的作業系統的版本。  [email protected]virtual-machine:~# cat /etc/issue Ubuntu 16.04.1 LTS \n \l [email p