1. 程式人生 > >搭建基於hadoop 2.2.0的分散式叢集啟動時出現 "Unable to load native-hadoop library for your platform" 的解決方案

搭建基於hadoop 2.2.0的分散式叢集啟動時出現 "Unable to load native-hadoop library for your platform" 的解決方案

問題引出:

        搭建基於hadoop 2.2.0的分散式叢集完成後,為了測試hadoop分散式叢集,啟動時執行命令: {HADOOP_HOME}/sbin/start-dfs.sh,經常會看到如下提示:WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable。而且在執行wordcount經典例項的時候application的執行狀態總會是failed,HDFS中的output也沒有任務執行的結果輸出。



解決方案:

       1. 首先要檢查hdfs有沒有載入native lib庫,檢查hdfs的日誌,如果發現其中有:ERROR org.apache.hadoop.io.nativeio.NativeIO: Unable to initialize NativeIO libraries,則說明hdfs的native的lib沒有載入,檢查hadoop-2.2.0目錄下的lib/native下是否存在libhadoop.so-1.0.0,並且用file命令檢查該so是否與作業系統的平臺位數相對應:file  /usr/local/hadoop/hadoop-2.0.0/bin/libhadoop.so-1.0.0

,預設下載的bin包中的so是64位的,如果用在32位的作業系統上,需要重新編譯。可以參見:

http://blog.csdn.net/lalaguozhe/article/details/10580727和http://blog.csdn.net/long1657/article/details/22314647

相關推薦

搭建基於hadoop 2.2.0分散式叢集啟動出現 "Unable to load native-hadoop library for your platform" 的解決方案

問題引出:         搭建基於hadoop 2.2.0的分散式叢集完成後,為了測試hadoop分散式叢集,啟動時執行命令: {HADOOP_HOME}/sbin/start-dfs.sh,經常會看到如下提示:WARN util.NativeCodeLoader: Un

Hadoop 2.7.2啟動WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform...

在/etc/profile檔案中配置如下環境變數 export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native export HADOOP_O

hadoop 2.2 hbase "Unable to load native-hadoop library for your platform" 問題解決

在基於hadoop 2.x的hbase上執行命令,經常會看到如下提示: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-j

hadoop環境搭建過程中遇到Unable to load native-hadoop library for your platform

            hadoop環境搭建完成後,在執行hadoop fs -ls 命令的時候,系統報了一個錯: 17/02/19 07:28:58 WARN util.NativeCode

hadoop WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

for bsp native del code warn you port uil 這個waring 信息是可以忽略的。下面是解決方案 在hadoop-env.sh中添加 export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.p

Hadoop安裝—— WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platf

lib64 AD there 會有 就會 pos body gpo csharp 今天在安裝hadoop完成測試創建用戶目錄失敗在網上找到了原因記錄一下原文地址 http://blog.csdn.net/l1028386804/article/details/5153861

Hadoop--Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [localhost]

The ice ddr bsp uic cep icu pub pat     Unable to load native-hadoop library for your platform... using builtin-java classes where applic

解決討厭的警告 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

問題: 執行任何hadoop命令,都會提示如下WARN。雖然影響不大,但是每次執行一個命令都有這麼個WARN,讓人很不爽,作為一個精緻的男人, 必須要幹掉它。 [[email protected] logs]# hdfs dfs -cat /output/part-r-00000 18/1

Hadoop之—— WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform...

配置完hadoop啟動的時候出現如下警告資訊: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java class

解決 Unable to load native-hadoop library for your platform

啟動Hadoop總是提示報錯資訊: 18/09/19 11:29:08 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-j

zookeeper 叢集啟動 出現 Error contacting service. It is probably not running 的解決辦法

在 zookeeper 叢集配置成功後,啟動時顯示正常啟動個,但是輸入命令檢視狀態時報錯!!! 錯誤資訊:Error contacting service. It is probably not

解決Unable to load native-hadoop library for your platform

安裝hadoop啟動之後總有警告:Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 環境:Red Hat 6.4 64位

異常解決:util.NativeCodeLoader: Unable to load native-hadoop library for your platform

剛裝好Hadoop的時候,每次輸入命令執行都會出現:WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-Java classes w

三、Unable to load native-hadoop library for your platform... using builtin-java classes where appl...

 hadoop安裝完成後,找些教程想看看hdfs命令使用,發現不管用什麼老報下面這個警告: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using

macos解決HadoopUnable to load native-hadoop library

bigdata load flow 1.8 code http -c line 來看   很顯然,native-hadoop library不支持macos,如果是Linux就不會有這個問題。在百度上搜了,要下載在macos上編譯的native hadoop library

uwsgi啟動Django項目unable to load app 0 (mountpoint='') (callable not found or import error) *** no app loaded. going in full dynamic mode ***

site not wsgi div auto mode bsp ini 準備 說起來有點坑 用命令都能正常啟動,但是用配置文件就是不行 提示 unable to load app 0 (mountpoint=‘‘) (callable not found or i

uwsgi啟動Django專案unable to load app 0 (mountpoint='') (callable not found or import error) *** no app loaded. going in full dynamic mode ***

說起來有點坑 用命令都能正常啟動,但是用配置檔案就是不行 提示 unable to load app 0 (mountpoint='') (callable not found or import error) *** no app loaded. going in full dynamic m

Android專案執行出現 Failed to load F:\eclipse\android-sdk-windows\build-tools\28.0.0-preview\lib\dx.jar

執行時出現錯誤: Failed to load F:\eclipse\android-sdk-windows\build-tools\28.0.0-preview\lib\dx.jar                          Unknown error: Unabl

Centos7 實現Hadoop-2.9.1分散式叢集搭建和部署(三臺機器)

一、準備三臺虛擬機器hadoop 192.168.131.128 localhost131 192.168.131.131 localhost134 192.168.131.134(以上是我的三臺虛擬機器的hostname 和 ip)hadoop 是 master 的 hos

Spark 2.0分散式叢集環境搭建

Apache Spark 是一個新興的大資料處理通用引擎,提供了分散式的記憶體抽象。Spark 最大的特點就是快,可比 Hadoop MapReduce 的處理速度快 100 倍。本文沒有使用一臺電腦上構建多個虛擬機器的方法來模擬叢集,而是使用三臺電腦來搭建一個小型分散式叢