解决：Spark以overwrite的方式写ES会造成该索引有一段时间的空窗期问题

卢子墨

已于 2024-02-05 15:28:31 修改

阅读量365

点赞数 3

分类专栏： Spark原理、实战、总结文章标签： spark elasticsearch 大数据

于 2024-01-17 21:34:37 首次发布

本文链接：https://blog.csdn.net/lukabruce/article/details/135660867

版权

Spark原理、实战、总结专栏收录该内容

56 篇文章 4 订阅 ¥39.90 ¥99.00

订阅专栏

超级会员免费看

import com.fasterxml.jackson.databind.ObjectMapper
import org.apache.http.HttpHost
import org.apache.http.auth.{AuthScope, UsernamePasswordCredentials}
import org.apache.http.impl.client.BasicCredentialsProvider
import org.apache.http.impl.nio.client.HttpAsyncClientBuilder
import org.apache.spark.sql.{DataFrame, SparkSession}
import org.elasticsearch.action.admin.indices.alias.IndicesAliasesRequest
import org.elasticsearch.action.admin.indices.alias.get.GetAliasesRequest
import org.elasticsearch.action.admin.indices.delete.DeleteIndexRequest
import org.elasticsearch.client._
import org.elasticsearch.client.indices.GetIndexRequest
import org.elasticsearch.cluster.metadata.AliasMetaData
import org.elasticsearch.index.reindex.ReindexRequest
import org.slf4j.{Logger, LoggerFactory}

import java.time.LocalDateTime
import java.time.format.DateTimeFormatter
import java.util


object EsConnTest_4 {
  val objectMapper: ObjectMapper = new ObjectMapper()
  pr

了解本专栏