1. 程式人生 > >在Mac OS上安裝Hadoop1.0.0

在Mac OS上安裝Hadoop1.0.0

1.先安裝javaSE,這裡不詳細說明;
2.去官網下載hadoop,這裡我下的1.0.0版本;
3.設定Hadoop環境變數
我們開啟〜/.profile,在結件處加上如下兩行指令碼(環境變數的值根據你自己的實際情況填寫)

export HADOOP_HOME=/users/apple/hadoop
export PATH=$PATH:$HADOOP_HOME/bin
export HADOOP_HOME_WARN_SUPPRESS=1

4.配置hadoop-env.sh
進入到conf目錄下,找到hadoop-env.sh,開啟編輯進行如下設定(值根據你自己的實際情況填寫)

export JAVA_HOME=/library/Java/Home(去掉註釋)
export HADOOP_HEAPSIZE=2000(去掉註釋)
export HADOOP_OPTS="-Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk"(去掉註釋)

5.配置core-site.xml

<configuration>
  <property>
    <name>hadoop.tmp.dir</name>
    <value
>
/users/billy/hadoop/tmp/hadoop-${user.name}</value> <description>A base for other temporary directories.</description> </property> <property> <name>fs.default.name</name> <value>hdfs://localhost:8020</value> </property> </configuration
>

6.配置hdfs-site.xml

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
</configuration> 

7.配置mapred-site.xml

 <configuration>
    <property>
        <name>mapred.job.tracker</name>
        <value>localhost:8021</value>
    </property>
    <property>
        <name>mapred.tasktracker.map.tasks.maximum</name>
        <value>2</value>
    </property>
    <property>
        <name>mapred.tasktracker.reduce.tasks.maximum</name>
        <value>2</value>
    </property>
</configuration>

8.安裝HDFS
經過以上的配置,就可以進行HDFS的安裝了。
命令如下

$HADOOP_HOME/bin/hadoop namenode -format

9.啟動Hadoop

很簡單,一條命令搞定。

$HADOOP_HOME/bin/start-all.sh

10.簡單除錯

如果想試試看是否已經成功啟動,可以用自帶的例子試驗一下:

hadoop jar $HADOOP_HOME/hadoop-example-1.0.0.jar pi 10 100

成功的話,會有類似結果:

Number of Maps = 10

Samples per Map = 100

Wrote input for Map #0

Wrote input for Map #1

Wrote input for Map #2

Wrote input for Map #3

Wrote input for Map #4

Wrote input for Map #5

Wrote input for Map #6

Wrote input for Map #7

Wrote input for Map #8

Wrote input for Map #9
……