【好好学习】SocketException: Connection reset——根因是重复认证

最新推荐文章于 2024-07-27 09:49:32 发布

小肥马

最新推荐文章于 2024-07-27 09:49:32 发布

阅读量7.5k

点赞数

分类专栏： Solr 文章标签： Solr SocketException ConnectionReset

本文链接：https://blog.csdn.net/weixin_42257250/article/details/84305362

版权

博客分析了Spark向Solr写入数据时遇到的SocketException: Connection reset问题，指出异常源于客户端重用鉴权token导致的鉴权失败。建议检查Solr组件日志，关注鉴权设计的安全性和性能，并回顾TCP连接相关知识。

摘要由CSDN通过智能技术生成

一、异常日志

Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 73.0 failed 4 times, most recent failure: Lost task 1.3 in stage 73.0 (TID 533, HQCDDJSPTAPP144204, 3): org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: IOException occured when talking to server at: https://10.180.144.198:21116/solr/fp_exp_appl_detail_shard15_replica2
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:645)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:992)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:881)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:107)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:72)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:86)
	at com.cpic.solr.ImportSolrProcess.writeToSolr(ImportSolrProcess.java:203)
	at com.cpic.solr.ImportSolrProcess.ImportProcess(ImportSolrProcess.java:114)
	at com.cpic.solr.AutoImportData$$anonfun$main$1$$anonfun$apply$mcVI$sp$3.apply(AutoImportData .scala:115)
	at com.cpic.solr.AutoImportData$$anonfun$main$1$$anonfun$apply$mcVI$sp$3.apply(AutoImportData .scala:115)
	at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$30.apply(RDD.scala:954)
	at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$30.apply(RDD.scala:954)
	at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1892)
	at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1892)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:68)
	at org.apache.spark.scheduler.Task.run(Task.scala:90)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:253)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.j