Hadoop 分散式叢集搭建
阿新 • • 發佈:2018-11-06
1 修改配置檔案
1.1 hadoop-env.sh
export JAVA_HOME=/usr/apps/jdk1.8.0_181-amd64
1.2 core-site.xml
<property>
<name>fs.default.name</name>
<value>hdfs://node1:8020</value>
</property>
1.3 hdfs-site.xml
<property>
<name>dfs.replication</ name>
<value>2</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>/home/hadoop/hdp2.6-cdh5.7-data/namenodeData</value>
</property>
<property>
<name>dfs.datanode.data.dir</ name>
<value>/home/hadoop/hdp2.6-cdh5.7-data/datanodeData</value>
</property>
1.4 yarn-site.xml
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property >
<name>yarn.resourcemanager.hostname</name>
<value>node1</value>
</property>
1.5 mapred-site.xml
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
1.6 slaves
node2
node3
node4
2 分發安裝包到 node2,node3,node4
[[email protected] ~]$ scp -r /home/hadoop/apps/hadoop-2.6.0-cdh5.7.0/ node2:/home/hadoop/apps
3 格式化
[[email protected] ~]$ hdfs namenode -format
4 啟動叢集
start-all.sh
瀏覽器訪問 http://node1:50070