![](https://img-blog.csdnimg.cn/20201014180756922.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
error__problem
露落梨花
联系加Q群:1009837046
展开
-
Unrecognized option: --add-exportsError: Could not create the Java Virtual Machine.Error: A fatal
mvn 执行失败原创 2023-01-12 17:01:28 · 2050 阅读 · 1 评论 -
idea maven unable to find valid certification path to requested target...
idea 在添加maven依赖后,下载不下来,报错如上原创 2022-11-16 17:31:40 · 1191 阅读 · 0 评论 -
No compiler is provided in this environment
error原创 2022-11-01 18:44:39 · 95 阅读 · 0 评论 -
flink-connector-starrocks 问题记录
问题一:ClassNotFoundException: org.apache.flink.calcite.shaded.com.google.common.base.PreconditionsCaused by: java.lang.ClassNotFoundException: org.apache.flink.calcite.shaded.com.google.common.base.Preconditions at java.net.URLClassLoader.findClass(URLCl原创 2022-03-31 20:02:10 · 3821 阅读 · 1 评论 -
flink cdc 的 问题
问题一2022-03-21 11:44:29,859 INFO io.debezium.jdbc.JdbcConnection [] - Connection gracefully closed2022-03-21 11:44:29,859 INFO io.debezium.connector.mysql.MySqlConnectorTask [] - Connector task finished all .原创 2022-03-22 15:17:28 · 3778 阅读 · 4 评论 -
spark-streaming kafka Blacklisting behavior can be configured via spark.blacklist.*.
[2022-03-08 15:23:14.742]Container exited with a non-zero exit code 50. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/sr.原创 2022-03-08 16:45:38 · 4219 阅读 · 1 评论 -
Sdk_Java.so: ELF file‘s phentsize not the expected size
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'messageService' defined in file [/app/classes/com/ck/data/service/MessageService.class]: Bean instantiation via constructor failed; nested exception is .原创 2022-01-19 11:22:30 · 1027 阅读 · 5 评论 -
java.lang.NoClassDefFoundError: com/esotericsoftware/kryo/serializers/ClosureSerializer$Closure
2022-01-19 11:16:54,888 ERROR TorrentBroadcast - Store broadcast broadcast_0 fail, remove all pieces of the broadcastException in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task serialization failed: java.lang.NoClas.原创 2022-01-19 11:19:24 · 2975 阅读 · 2 评论 -
Permission denied: user=root, access=EXECUTE, inode=“/flink“:flink:hadoop:drwxrwx---
2021-12-31 16:17:32,174 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting YarnJobClusterEntrypoint down with application status FAILED. Diagnostics org.apache.hadoop.security.AccessControlException: Permission denied: user=r.原创 2022-01-06 10:26:19 · 1426 阅读 · 1 评论 -
A master URL must be set in your configuration
org.apache.spark.SparkException: A master URL must be set in your configuration at org.apache.spark.SparkContext.<init>(SparkContext.scala:376) at com.ck.data.batch.customer.CustomerDateCountJob$.main(CustomerDateCountJob.scala:26) at com.ck.data.原创 2021-12-30 16:32:43 · 1494 阅读 · 0 评论 -
FlinkCDC 连接 MySQL 问题记录
目录前提1、User does not have the 'LOCK TABLES' privilege required to obtain a consistent snapshot by preventing concurrent writes to tables.2、Access denied; you need (at least one of) the SUPER, REPLICATION CLIENT privilege(s) for this operation Error原创 2021-12-20 14:49:20 · 5765 阅读 · 0 评论 -
code:405 Request method ‘GET‘ not supported
问题使用postman发送post请求时,出现了get请求不支持。在本地idea里面测试没有这个问题,线上有一层 nginx代理,就出现了这个问题。网上百度了很多,说什么将post请求改成get请求之类的,但是我感觉不是问题的关键。最后一步一步的核对,一点一点的匹配发现是http请求和https请求的问题。本地访问直接使用的IP:PORT,这种方式默认的就是http请求。而线上环境有使用代理转发,实际使用的是https请求。当直接使用http请求时就会报get不支持。。。解决对于原创 2021-03-03 10:04:03 · 2962 阅读 · 0 评论 -
java.lang.AbstractMethodError: com.zaxxer.hikari.metrics.micrometer.MicrometerMetricsTrackerFactory.
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.boot.actuate.autoconfigure.metrics.jdbc.DataSourcePoolMetricsAutoConfiguration$HikariDataSourceMetricsConfiguration': Injection of autowired depend.原创 2020-10-19 09:56:21 · 4564 阅读 · 1 评论 -
单机版hbase,隔一段时间Hmaster就自己挂了
2020-07-16 18:42:33,007 WARN [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Client session timed out, have not heard from server in 2295689ms for sessionid 0x17356788d1b00002020-07-16 18:42:33,009 INFO [JvmPauseMonitor] util.JvmPauseMonitor: D.原创 2020-07-17 14:16:43 · 830 阅读 · 0 评论 -
scala.util.matching.Regex V
一、出现问题Scala的版本与spark的版本的不匹配的时候会出现。maven依赖的Scala;电脑环境变量的Scala;IDEA的全局sdk的Scala。都没有问题时还是会出现Exception in thread "main" java.lang.NoSuchMethodError: scala.util.matching.Regex.<init>(Ljava/lang/可以在maven的pom里面配置以下:<repositories> <reposito...原创 2020-06-19 01:22:28 · 2972 阅读 · 0 评论 -
canal问题汇集,高可用,kerberos,tsdb,metric监控,admin等等
1、2、3、Could not find a 'KafkaClient' entry in the JAAS configuration. System property 'java.security.auth.login.config' is/jaas.conf4、CanalParseException: parse row data failed. column size is n...原创 2020-01-15 10:33:58 · 478 阅读 · 0 评论 -
CanalParseException: parse row data failed。CanalParseException: column size is not match for table:
com.alibaba.otter.canal.parse.exception.CanalParseException: com.alibaba.otter.canal.parse.exception.CanalParseException: com.alibaba.otter.canal.parse.exception.CanalParseException: parse row data f...原创 2020-01-10 18:23:01 · 5361 阅读 · 0 评论 -
ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path java.io.IOException
19/01/06 15:28:13 ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary pathjava.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries. at...原创 2019-01-06 16:35:05 · 1612 阅读 · 0 评论 -
org.apache.hadoop.security.AccessControlException: Permission denied: user=A
Windows系统连接Linux的Hadoop文件系统,对于没有权限的问题解决办法:有两种1、在程序的main方法里面,最上面一行加入System.setProperty("HADOOP_USER_NAME","user");2、在文件系统FileSystem创建对象是,表明userFileSystem fileSystem = FileSystem.get(URI.cre...原创 2019-01-07 22:19:38 · 4181 阅读 · 5 评论 -
Java的异常
Java Exception:1、Error2、Runtime Exception 运行时异常3、Exception4、throw 用户自定义异常异常类分两大类型:Error类代表了编译和系统的错误,不允许捕获;Exception类代表了标准Java库方法所激发的异常。Exception类还包含运行异常类Runtime_Exception和非运行异常类Non_RuntimeExc...转载 2019-03-14 22:15:16 · 710 阅读 · 0 评论 -
Exception in thread "main" java.net.ConnectException: Call From DESKTOP-API5IFV/192.168.5.1 to hadoo
Exception in thread "main" java.net.ConnectException: Call From DESKTOP-API5IFV/192.168.5.1 to hadoop:8020 failed on connection exception: java.net.ConnectException: Connection refused: no further inf...原创 2019-03-22 17:39:37 · 8875 阅读 · 4 评论 -
KafkaConsumer is not safe for multi-threaded access
1、关于structed streaming 读取kafka的问题:数据流从kafka过来,根据条件的不同,会被拆分成好几个流式dataFrame,这些流式的DF会进行各种join操作,在这个过程中会随机的触发KafkaConsumer is not safe for multi-threaded access,kafka多线程消费的问题,本程序就只有一个线程,怎么会有多线程消费的问题。在网上...原创 2019-04-12 16:35:22 · 5336 阅读 · 1 评论 -
catalyst.analysis.UnresolvedException: Invalid call to dataType on unresolved object, tree: 'timesta
org.apache.spark.sql.catalyst.analysis.UnresolvedException: Invalid call to dataType on unresolved object, tree: 'timestamp不知道什么问题,只是这一句报错就都没有找到问题的根源,可能的原因分析了一下: val result = df.withColumn("times...原创 2019-04-12 16:46:44 · 11406 阅读 · 1 评论 -
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/CanUnbuffer
使用java的api链接HDFS时出现的问题Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/CanUnbuffer at java.base/java.lang.ClassLoader.defineClass1(Native Method) at java.base/java....原创 2018-09-26 14:37:23 · 6483 阅读 · 1 评论 -
canal高可用的数据重复消费问题,自动切换时消费端数据重复消费,canal高可用的搭建,运用以及问题,以及元数据保存问题,保存zookeeper清除
一、问题描述搭建的canal是高可用模式,在IDEA里面进行消费的,但是在服务端进行切换时,出现了数据重复被消费的问题。salve1:11111开启服务时,往数据库里面插入了一条数据,然后又删除了这条数据,这是Mysql的bin-log会产生两条日志,客户端也获取到了这个两条数据。当我把salve1的服务stop.sh关掉之后,salve2:11111开启了服务,但是在客户端又重新获取到了这两...原创 2019-05-23 11:05:53 · 5704 阅读 · 1 评论 -
java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
[2019-05-30 14:38:58,089] ERROR Exiting Kafka due to fatal exception (kafka.Kafka$)java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object; at kafka.cluster...原创 2019-05-30 15:05:36 · 3545 阅读 · 0 评论 -
com.alibaba.otter.canal.parse.exception.CanalParseException: command : 'show master status' has an e
com.alibaba.otter.canal.parse.exception.CanalParseException: command : 'show master status' has an error!Caused by: java.io.IOException: ErrorPacket [errorNumber=1227, fieldCount=-1, message=Access d...原创 2019-05-30 17:45:00 · 9349 阅读 · 0 评论 -
org.apache.flink.client.program.ProgramInvocationException: Could not retrieve the execution result
org.apache.flink.client.program.ProgramInvocationException: Could not retrieve the execution result. at org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java...原创 2019-07-05 12:40:09 · 12994 阅读 · 2 评论 -
Permission denied: user=*****, access=WRITE, inode="/user":hdfs:supergroup:drwxr-xr-x
一、问题描述在执行flink on yarn 时出现的问题,其实在出现问题之前,程序已经在测试环境运行了一个月没有问题,环境变了,又重新部署启动之后就出现了问题。启动命令如下:flink run -m yarn-cluster \-p 4 -yjm 1024m -ytm 4096m \-ynm demo -c com.sink.flink.Demo \${libs_abs_path...原创 2019-08-15 10:30:56 · 1942 阅读 · 2 评论 -
Cannot create directory /user/hive. Name node is in safe mode.The reported blocks 1 needs additiona
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot create directory /user/hive. Name node is in safe mode.The reported blocks 1 needs additional 4...原创 2019-01-10 22:50:38 · 1979 阅读 · 0 评论