Way to get a Filename in Spark Streaming

編寫工具類

object GetFileNameFromStream extends java.io.Serializable { def getFileName(file: RDD[String]) :String ={ file.toDebugString } }

val source_file = ssc.textFileStream("/user/sap_data/data")

SparkStreming執行時呼叫工具類的獲取檔名方法

source_file.foreachRDD(dataRDD => { val file= GetFileNameFromStream.getFileName(ekpoRDD) }