準備階段，每個節點安裝jdk，配置環境變數，注意安裝的位置要一致
注意：
1.每臺機器的防火牆關閉
2.每臺機器配置時間自動同步，或者簡單點每臺機器時間保持一致（相差不超過30秒）
yum -y install ntpdate
/usr/sbin/ntpdate -u pool.ntp.org 
               */10 * * * *  /usr/sbin/ntpdate -u pool.ntp.org >/dev/null 2>&1
3.網路互通，配置/etc/hosts,能夠互ping，便於訪問
        4.vi /etc/sysconfig/network，更改每個節點hostname的值


1.修改解壓目錄下的etc/hadoop中的hadoop-env.sh檔案
export JAVA_HOME=/opt/soft/jdk1.7.0_79
export HADOOP_PREFIX=/opt/soft/hadoop-2.5.1
2.修改etc/hadoop下的core-site.xml和hdfs-site.xml mapred-site.xml yarn-site.xml


core-site.xml


<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://node1:9000</value>
</property>
</configuration>

分發到其他節點

scp core-site.xml [email protected]:/opt/hadoop/etc/hadoop

scp core-site.xml [email protected]:/opt/hadoop/etc/hadoop

hdfs-site.xml:


<configuration>
<property>
<name>dfs.namenode.name.dir</name>
<value>/opt/data/dfs</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>/opt/data/data</value>
</property>
<property>
<name>dfs.replication</name>
<value>3</value>
</property>

</configuration>

分發到其他節點

scp hdfs-site.xml [email protected]:/opt/hadoop/etc/hadoop

scp hdfs-site.xml [email protected]:/opt/hadoop/etc/hadoop

mapred-site.xml:


<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>

分發到其他節點

scp mapred-site.xml [email protected]:/opt/hadoop/etc/hadoop

scp mapred-site.xml [email protected]:/opt/hadoop/etc/hadoop

yarn-site.xml:


<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>

分發到其他節點

scp [email protected]:/opt/hadoop/etc/hadoop

scp [email protected]:/opt/hadoop/etc/hadoop

3.配置slaves
node1
node2
node3

分發到其他節點

scp slaves  [email protected]:/opt/hadoop/etc/hadoop

scp slaves  [email protected]:/opt/hadoop/etc/hadoop

4.配置無密碼登陸(每個節點都執行)
ssh-keygen後面一路enter
(每個節點都執行)均在全部回話中執行
ssh-copy-id -i /root/.ssh/id_rsa.pub [email protected]
ssh-copy-id -i /root/.ssh/id_rsa.pub [email protected]
ssh-copy-id -i /root/.ssh/id_rsa.pub [email protected]


5.將配置好的hadoop分發到各個節點
6.format格式化
bin/hdfs namenode -format
7.啟動
sbin/start-all.sh
8.驗證
啟動完成後執行hadoop fs -mkdir /user
再執行hadoop  fs -ls /能看到剛建立的目錄即可