1. 程式人生 > >Hadoop報錯 Failed to locate the winutils binary in the hadoop

Hadoop報錯 Failed to locate the winutils binary in the hadoop

                1 發現問題

在虛擬機器中搭建了hadoop叢集,在windows中通過程式碼訪問報錯

15/06/11 15:35:50 ERROR Shell: Failed to locate the winutils binary in the hadoop binary pathjava.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.    at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:356)    at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:371
)    at org.apache.hadoop.util.Shell.<clinit>(Shell.java:364)
2 分析問題開啟原始碼,檢視getQualifiedBinPath方法
public static final String getQualifiedBinPath(String executable)   throws IOException {    // construct hadoop bin path to the specified executable    String fullExeName = HADOOP_HOME_DIR + File.separator + "bin"
      + File.separator + executable;     File exeFile = new File(fullExeName);    if (!exeFile.exists()) {      throw new IOException("Could not locate executable " + fullExeName        + " in the Hadoop binaries.");    }     return exeFile.getCanonicalPath();  } private static String HADOOP_HOME_DIR = checkHadoopHome();private
static String checkHadoopHome()
{     // first check the Dflag hadoop.home.dir with JVM scope    String home = System.getProperty("hadoop.home.dir");     // fall back to the system/user-global env variable    if (home == null) {      home = System.getenv("HADOOP_HOME");    }     ...}
exeFile不存在會報錯,也就是fullExeName不存在。即windows中沒有配置HADOOP_HOME。3 解決問題配置環境變數E:\\Program Files\\hadoop-2.7.0重啟電腦。或者程式碼中設定System.setProperty("hadoop.home.dir", "E:\\Program Files\\hadoop-2.7.0");還有一種可能HADOOP_HOME的bin目錄下根本沒有winutils.exe,下載地址https://github.com/srccodes/hadoop-common-2.2.0-bin

原貼地址:http://www.cnblogs.com/hyl8218/p/5492450.html