大数据阶段-报错合集
报错
x我有辣条跟我走。
当你的才华还撑不起你的野心时,就应该静下心来学习。
展开
-
flume连接hive时报错:
写入文件时报错:2020-07-16 16:46:02,405 (agent-shutdown-hook) [WARN - org.apache.flume.sink.hdfs.BucketWriter.doClose(BucketWriter.java:462)] failed to rename() file (hdfs://node7-3:8020/flume/2020-07-16//event.1594889152796.txt.tmp). Exception follows.java.net.原创 2020-07-16 19:35:54 · 330 阅读 · 0 评论 -
java.lang.Integer无法强制转换为java.lang.Long文件
java.lang.Integer无法强制转换为java.lang.Long文件ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 1)java.lang.ClassCastException: java.lang.Integer cannot be cast to java.lang.LongERROR TaskSetManager: Task 0 in stage 1.0 failed 1 times; aborting job改原创 2020-08-26 18:01:34 · 2063 阅读 · 2 评论 -
HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.S
只能进去不能输命令,一输就报错HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient初始化很多遍后,重装。重装又报错,初始化报错:[root@node7-4 apache-hive]# bin/schematool -dbType mysql -initSchemaSLF4J: Class.原创 2020-08-27 14:09:33 · 1013 阅读 · 0 评论 -
hive中清空表出错:
清空表:truncate table a_demo_king;原创 2020-07-21 13:19:45 · 273 阅读 · 0 评论 -
flume和hive链接报错:
2020-07-16 19:55:38,039 (conf-file-poller-0) [ERROR - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:150)] Failed to start agent because dependencies were not found .原创 2020-07-16 20:29:22 · 358 阅读 · 0 评论 -
git中配置ssh报错:fatal: not a git repository (or any of the parent directories): .git
错误1fatal: not a git repository (or any of the parent directories): .git解决方法如下:$ git initInitialized empty Git repository in C:/Users/沫小新/Desktop/.git/错误2:$ git push -u orgion mastererror: src refspec master does not match any.err.原创 2020-08-31 15:42:13 · 646 阅读 · 0 评论 -
mongodb连接报错:Exception in thread “main“ java.lang.RuntimeException: Timed out after 30000
Exception in thread "main" java.lang.RuntimeException: com.mongodb.MongoTimeoutException: Timed out after 30000 ms while waiting for a server that matches com.mongodb.client.internal.MongoClientDelegate$1@794c9b43. Client view of cluster state is {type.原创 2020-09-16 21:26:47 · 2008 阅读 · 0 评论 -
mongodb报错:Exception in thread “main“ com.mongodb.MongoTimeoutException: Timed out after 30000 ms whi
Exception in thread "main" com.mongodb.MongoTimeoutException: Timed out after 30000 ms while waiting for a server that matches WritableServerSelector. Client view of cluster state is {type=UNKNOWN, servers=[{address=hadoop02:12345, type=UNKNOWN, state=.原创 2020-09-14 18:10:40 · 3384 阅读 · 0 评论 -
Dubbo Provider报错:Exception in thread “main“ com.alibaba.dubbo.rpc.RpcException: Fail to start server
报错日志:Exception in thread "main" com.alibaba.dubbo.rpc.RpcException: Fail to start server(url: dubbo://192.168.1.13:20880/com.searchservice22.test.service.HelloT?anyhost=true&application=dubboservicetest&bind.ip=192.168.1.13&bind.port=208.原创 2020-09-16 19:19:32 · 645 阅读 · 0 评论 -
The VM session was closed before any attempt to power it on.
今天起Vtrolbox突然就报了这个错:The VM session was closed before any attempt to power it on.本来以为就一台虚拟机有问题,最后尝试发现都有问题,怀疑是软件的问题或者是软件外部设置问题。原创 2020-09-05 10:29:06 · 3870 阅读 · 0 评论 -
ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 1) java.sql.BatchUpdateException: Duplicate
20/08/26 15:29:37 ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 1)java.sql.BatchUpdateException: Duplicate entry '269' for key 'PRIMARY' com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Duplicate entry '269' for key .原创 2020-08-26 15:59:12 · 7220 阅读 · 0 评论 -
SparkStream中updateStateByKey报错:
错误1:ERROR StreamingContext: Error starting the context, marking it as stopped requirement failed: No output operations registered, so nothing to execute意思是:StreamingContext错误:启动上下文时出错,将其标记为已停止的需求失败:没有注册输出操作,因此没有要执行的内容报错原因是:检查点的时间至少是10s以上,一般设置时间是ba.原创 2020-08-24 11:52:50 · 1383 阅读 · 0 评论 -
spark中读取txt文本时出现乱码
spark中读取txt文本时出现乱码:我的属于第二种文件有问题。(user03,CompactBuffer((7,(����,user03))))(user11,CompactBuffer((6,(�Ļ�,user11))))(user06,CompactBuffer((4,(����,user06))))(user10,CompactBuffer((16,(�Ļ�,user10)), (6,(����,user10))))(user02,CompactBuffer((2,(����,us.原创 2020-08-23 20:08:16 · 671 阅读 · 0 评论 -
hive连接flume的报错信息2:INFO - org.apache.hadoop.hdfs.protocol.datatransfer.sasl.SaslDataTransferClient.ch
2020-07-16 20:52:53,838 (Thread-18) [INFO - org.apache.hadoop.hdfs.protocol.datatransfer.sasl.SaslDataTransferClient.checkTrustAndSend(SaslDataTransferClient.java:239)] SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false20...原创 2020-07-16 21:27:02 · 921 阅读 · 0 评论 -
Spark报错:Error:scalac: Scala compiler JARs not found (module ‘Spark_two‘): C:\Users\沫小新\.m2\repo
Spark报错:找不到scala-compiler-2.11.8.jar的包Error:scalac: Scala compiler JARs not found (module 'Spark_two'): C:\Users\沫小新\.m2\repository\org\scala-lang\scala-compiler\2.11.8\scala-compiler-2.11.8.jar从D:\BigDataSoftware\spark\spark-2.2.1-bin-hadoop2.7\ja.原创 2020-08-20 18:49:36 · 1402 阅读 · 0 评论 -
spark中报错:com.fasterxml.jackson.databind.JsonMappingException: Incompatible Jackson version: 2.9.10-1
spark中报错:com.fasterxml.jackson.databind.JsonMappingException: Incompatible Jackson version: 2.9.10-1JsonMappingException不兼容的Jackson版本:2.9.10-1出现这个错误是版本不兼容,可能你之前下了高版本或者低版本的jackson,我报这个错应该是找到这个包删了再下的但是找起来太麻烦了,所以就重新在idea上导入了pom.xml文件<?xml version原创 2020-08-20 18:55:23 · 2107 阅读 · 0 评论 -
报错:Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(mes
解决:1.在hbase中创建namespace2.hive要起:node7-2,3客户端,4服务器端,都起原创 2020-07-15 09:47:03 · 1047 阅读 · 0 评论 -
idea中HADOOP运行错误:
这是我的错误,参照以下两个链接配置:1.https://blog.csdn.net/weixin_41122339/article/details/81141913https://www.cnblogs.com/zimo-jing/p/8796685.html2.如果还没好,可能你的windows里的hadoop没有配好,我的电脑-属性-...原创 2020-01-07 15:57:49 · 577 阅读 · 0 评论 -
用sqoop把hdfs传到mysql报错:ERROR mapreduce.ExportJobBase: Export job failed! 2020-07-21 20:38:06,879 ERROR
用sqoop把hdfs传到mysql报错2020-07-21 20:37:36,781 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1595291661620_00092020-07-21 20:37:36,781 INFO mapreduce.JobSubmitter: Executing with tokens: []2020-07-21 20:37:37,301 INFO conf.Configuration: re.原创 2020-07-21 20:55:39 · 1768 阅读 · 7 评论 -
配置免密登录报错:ssh: Could not resolve hostname note1: Name or service not known
这两天配置免密出现这个错误:[root@note4 .ssh]# ssh note1ssh: Could not resolve hostname note1: Name or service not known1.设置主机名对不对查看:hostnamectl修改:hostnamectl set-hostname 主机名 --static2.修改[root@note4 .ssh...原创 2020-03-19 14:22:18 · 19193 阅读 · 0 评论