spark
一天两晒网
这个作者很懒,什么都没留下…
展开
-
spark streaming 整合kafka
1、crateDateStream和createDirectStream区别2.createDirectStream代码原创 2017-08-03 14:36:24 · 353 阅读 · 0 评论 -
Unable to load native-hadoop library spark-cluster模式相关错误
WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicableWARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.原创 2017-09-08 15:43:01 · 270 阅读 · 0 评论 -
spark-jdbc No suitable driver found错误处理
错误如图:代码:object Mysql extends App{ val sparkConf = new SparkConf()//.setAppName("RDDRelation").setMaster("local[1]") val sc=new SparkContext(sparkConf) val sqlContext = new SQL原创 2017-09-08 15:49:17 · 8270 阅读 · 1 评论