1. 程式人生 > >Hadoop 分散式叢集搭建

Hadoop 分散式叢集搭建

1 修改配置檔案

1.1 hadoop-env.sh

export JAVA_HOME=/usr/apps/jdk1.8.0_181-amd64

1.2 core-site.xml

 <property>
        <name>fs.default.name</name>
        <value>hdfs://node1:8020</value>
 </property>

1.3 hdfs-site.xml

	<property>
        <name>dfs.replication</
name
>
<value>2</value> </property> <property> <name>dfs.namenode.name.dir</name> <value>/home/hadoop/hdp2.6-cdh5.7-data/namenodeData</value> </property> <property> <name>dfs.datanode.data.dir</
name
>
<value>/home/hadoop/hdp2.6-cdh5.7-data/datanodeData</value> </property>

1.4 yarn-site.xml

<property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
    
    <property
>
<name>yarn.resourcemanager.hostname</name> <value>node1</value> </property>

1.5 mapred-site.xml

<property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
</property>

1.6 slaves

node2
node3
node4

2 分發安裝包到 node2,node3,node4

[[email protected] ~]$ scp -r /home/hadoop/apps/hadoop-2.6.0-cdh5.7.0/ node2:/home/hadoop/apps

3 格式化

[[email protected] ~]$ hdfs namenode -format

在這裡插入圖片描述
在這裡插入圖片描述

4 啟動叢集

start-all.sh
瀏覽器訪問 http://node1:50070