1. 程式人生 > >sparksql啟動報錯The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH

sparksql啟動報錯The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH

  要啟動sparksql並訪問到Hive,有兩個步驟:

1、將$HIVE_HOME/conf/hive-site.xml拷貝到$SPARK_HOME/conf下
2、配置MySQL驅動包,將MySQL驅動包放在一個自定義目錄下,在$SPARK_HOME/conf裡面的spark-defaults.conf配置兩個引數
spark.executor.extraClassPath /home/hadoop/jars/mysql-connector-java-5.1.34.jar
spark.driver.extraClassPath /home/hadoop/jars/mysql-connector-java-5.1.34.jar

或者可以將mysql驅動包放到$SPARK_HOME/lib下,但是如果叢集升級需要再次操作這個步驟,所以推薦第一個做法。