Spark篇
IT但丁
知道结局是干掉大魔王,那斩龙的剑总会到手的!
展开
-
spark访问ES,HttpConnectionManager找不到的问题
1、导入es-spark依赖 <!-- elasticsearch-spark-20 --> <dependency> <groupId>org.elasticsearch</groupId> <artifactId>elasticsearch-spark-20_2.11</artifactId> <version>7.7.原创 2021-03-08 11:32:35 · 232 阅读 · 0 评论 -
scala、java读取hdfs文件,获取文件名
import java.io.{BufferedReader, InputStreamReader}import java.net.URIimport org.apache.hadoop.conf.Configurationimport org.apache.hadoop.fs.{FSDataInputStream, FileSystem, Path}import scala.collection.mutable.ArrayBufferobject IpRulesLoaderr8 { var原创 2020-08-19 09:48:01 · 1501 阅读 · 0 评论