1. 程式人生 > >Diagnostics: File file:/tmp/spark-95cbb984-da28-4784-8b99-eb83ad74437f/__spark_libs__1421840316395076250.zip does not exist

Diagnostics: File file:/tmp/spark-95cbb984-da28-4784-8b99-eb83ad74437f/__spark_libs__1421840316395076250.zip does not exist

 搭建spark環境,測試在yarn 上執行spark shell的時候出現的錯誤:Diagnostics: File file:/tmp/spark-95cbb984-da28-4784-8b99-eb83ad74437f/__spark_libs__1421840316395076250.zip does not exist

 

問題原因 是 spark-env.sh 中 HADOOP_CONF_DIR 配置的路徑有問題,導致spark無法正確讀取yarn叢集的配置內容。導致了錯誤。

解決方法:修改成正確的hadoop配置路徑。