針對spark報錯：

java.lang.OutOfMemoryError: Java heap space

解決方式：

    在spark/conf/spark-env.sh中加大SPARK_WORKER_MEMORY值，如下，我加大至6GB

export SPARK_MASTER_IP=192.168.2.139
export SPARK_WORKER_CORES=4
export SPARK_WORKER_INSTANCES=2
export SPARK_MASTER_PORT=7077
export SPARK_WORKER_MEMORY=6g
export MASTER=spark://${SPARK_MASTER_IP}:${SPARK_MASTER_PORT}
 

val conf = new SparkConf().setAppName("sinaApplication").set("spark.executor.memory","6g")

../../bin/spark-submit --class "sinaApp" --master spark://192.168.2.139:7077 --executor-memory 6G target/scala-2.10/sina-project_2.10-1.0.jar