![](https://img-blog.csdnimg.cn/202004281457278.png?x-oss-process=image/resize,m_fixed,h_224,w_224)
Error 合集
Error
Michealkz
这个作者很懒,什么都没留下…
展开
-
PSQLException: ERROR: permission denied: no privilege to create a readable gpfdist(s) external table
Spark 使用GSC 连接Gp 写入数据时候报错:PSQLException: ERROR: permission denied: no privilege to create a readable gpfdist(s) external table错误原因:当前用户没有权限创建外部表完整错误如下:21/07/01 10:04:24 WARN scheduler.TaskSetManager: Lost task 0.0 in stage 7.0 (TID 8, hddatanode01, ex原创 2021-07-01 10:29:28 · 2210 阅读 · 0 评论 -
CDH 集群Impala-Shell 获取不到数据及相关问题
错误描述:在CDH 界面安装Impala 服务之后,进入到服务器的Impala-shell中运行查询语句获取不到数据控制台运行查询打印信息如下:[hddatanode02:21000] test> select * from test.ods_cdp_data_explore;Query: select * from test.ods_cdp_data_exploreQuery submitted at: 2021-05-11 12:37:59 (Coordinator: http://hdd原创 2021-05-11 13:13:54 · 1034 阅读 · 2 评论 -
java.lang.OutOfMemoryError: GC overhead limit exceeded
背景描述: 运行Flink任务报错TaskManager报错信息java.lang.OutOfMemoryError: GC overhead limit exceeded at sun.reflect.GeneratedConstructorAccessor10.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorI原创 2020-10-21 16:02:17 · 4024 阅读 · 0 评论 -
Flink 报错 No TaskExecutor registered under container_xx
运行Flink程序报错,具体信息如下:org.apache.flink.runtime.resourcemanager.exceptions.UnknownTaskExecutorException: No TaskExecutor registered under container_1603071676168_0204_01_000002. at org.apache.flink.runtime.resourcemanager.ResourceManager.requestTaskManagerIn原创 2020-10-19 17:30:27 · 5322 阅读 · 1 评论 -
org.apache.flink.util.FlinkException: The assigned slot container_16xxx was removed
Flink 消费kafka长时间为消费,lag信息并没有变换,查看TaskManager的日志得到如下信息:org.apache.flink.util.FlinkException: The assigned slot container_1603071676168_0084_01_000009_0 was removed. at org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager.removeSlot(SlotManager原创 2020-10-19 16:36:28 · 1475 阅读 · 0 评论 -
Caused by: org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Hadoop is not in the class
Flink 提交任务访问HDFS报错UnsupportedFileSystemSchemeException 错误信息如下:Could not find a file system implementation for scheme ‘hdfs’. The scheme is not directly supported by Flink and no Hadoop file system to support this scheme could be loaded.org.apache.fli原创 2020-10-18 22:52:02 · 1921 阅读 · 0 评论 -
Yarn 报错 Error in handling event type NODE_UPDATE to the Event Dispatcher
报错完整信息如下:2020-10-14 15:31:00,068 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_1602660632708_0001_01_000055 of capacity <memory:1024, vCores:1> on host hddatanode02:8041, whi原创 2020-10-15 11:44:15 · 1134 阅读 · 2 评论 -
python 中文乱码 \u5b66\u90a6\u5ba2\u6237
python 中中文乱码问题解决:\u5b66\u90a6\u5ba2\u6237设置codecs 打开文件的格式import codecswith codecs.open(file, 'a',encoding='utf8') as f: f.write(result)对于Linux的ASCII乱码问题:result = data.encode('ascii').decode('unicode_escape')f.write(result)import iowith .原创 2020-09-24 10:26:50 · 7182 阅读 · 0 评论 -
Python TypeError: expected a character buffer object
Python 写入文件报错:python TypeError: expected a character buffer object背景:用python将数据写入到文件的时候报错:python TypeError: expected a character buffer object原因:写入文件需要使用字符串,而自身写入的时候还穿插着其他的类型解决:将写入的内容用str() 转换成为字符串即可...原创 2020-09-23 18:59:44 · 5956 阅读 · 0 评论 -
Native memory allocation (mmap) failed to map 703594496 bytes for committing reserved memory
Linux 执行命令报错:Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000003d3c00000, 703594496, 0) failed; error='Cannot allocate memory' (errno=12)## There is insufficient memory for the Java Runtime Environment to continue.# Native mem原创 2020-09-21 10:42:50 · 1080 阅读 · 0 评论 -
docker启动tomcat容器访问端口显示404
转载自:https://blog.csdn.net/qq_45589050/article/details/104559125如果已经关闭防火墙,还出现404问题,那么就确定是tomcat的webapps文件夹下没有东西启动Tomcat容器docker run -d -p 8888:8080 tomcat查看已经启动的容器docker ps使用8888端口访问Tomcat失败先查看防火墙状况service firewalld status如果防火墙没关闭,先关闭防火墙#转载 2020-08-09 17:03:01 · 985 阅读 · 0 评论 -
java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object;
运行Flink程序报错:java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object; at com.ruozedata.bigdata.SocketWCApp$.$anonfun$main$1(SocketWCApp.scala:33) at com.ruozedata.bigdata.SocketWCApp$.$anonfun$main$1$adapted(SocketWC原创 2020-05-09 19:56:35 · 5052 阅读 · 0 评论 -
java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
kafka连接SparkStreaming报错:java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access解决:在代码中开启checkpoint机制即可// 5.开启checkpoint机制ssc.checkpoint("hdfs://bigdata01:9...原创 2020-05-06 14:45:40 · 931 阅读 · 0 评论 -
om.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer$.handledType()Ljava/lang/Class;
SparkSQL连接Hive报错:om.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer$.handledType()Ljava/lang/Class;原因这是由于jackson相关包的冲突导致,或者缺少相关的包导致的,在使用spark-sql 连接hive的时候需要假如以下的依赖,将对应的Spark版本和Scala版本换...原创 2020-05-03 16:53:18 · 407 阅读 · 0 评论 -
Error:(17, 34) could not find implicit value for evidence parameter of type org.apache.flink.api.com
IDEA运行Flink程序报错Error:(17, 34) could not find implicit value for evidence parameter of type org.apache.flink.api.common.typeinfo.TypeInformation[Int]原因是没有导入隐式转换,导入隐式转换即可。import org.apache.flink.api...原创 2019-11-09 14:32:46 · 566 阅读 · 3 评论 -
java.sql.SQLRecoverableException: IO 错误: The Network Adapter could not establish the connection
JDBC连接:Oracle 的时候报错这里出现问题的原因是JDBC连接字符串中ip地址填写错误,将ip地址填写正确即可原创 2019-09-11 15:02:44 · 51507 阅读 · 1 评论 -
java.sql.SQLException: 指定了无效的 Oracle URL
使用JDBC连接Oracle时候报错:java.sql.SQLException: 指定了无效的 Oracle URL这里出现问题的原因是jdbc连接字符串错误正确的jdbc连接字符串应该是:jdbc:oracle:thin:@ip地址:端口号:服务名注意:1.thin后面的冒号要写2.@也要加上3.端口号和服务名也都要加上...原创 2019-09-11 14:58:27 · 1754 阅读 · 0 评论 -
java.lang.NoSuchMethodError: scala.Predef$.refArrayOps Lscala/collection/mutable/ArrayOps
在idea中配置运行spark程序报错:scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps;Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Obje...原创 2019-08-28 13:42:31 · 10070 阅读 · 0 评论 -
ERROR:无法加载主类
运行yarn install报错 无法加载主类:原因:配置的hadoop的windows环境,电脑上面有装了前端的yarn,导致yarn不能使用。运行yarn命令也安装不了依赖,只是提示yarn命名的用法,运行yarn --version不起作用解决:删除hadoop windows的环境变量,yarn命令即可正常使用。java中的can not create virtual menchi...原创 2019-08-12 18:02:59 · 1586 阅读 · 0 评论 -
can't create transaction lock on /var/lib/rpm/.rpm.lock (Permission denied)
linux报错:error: can’t create transaction lock on /var/lib/rpm/.rpm.lock (Permission denied)场景:用非root用户删除linux自带的openjdk时候报错错误描述:没有权限创建事务锁错误原因:使用非root用户操作卸载linux自带jdk解决: 切换root用户执行卸载linux自带jdk...原创 2019-08-12 15:56:22 · 10363 阅读 · 0 评论 -
error setting certificate verify locations
运行npm时候报错,git的错误:npm ERR! Error while executing:npm ERR! D:\git\Git\cmd\git.EXE ls-remote -h -t https://github.com/nhn/raphael.gitnpm ERR!npm ERR! fatal: unable to access 'https://github.com/nhn/r...原创 2019-07-25 17:17:25 · 1954 阅读 · 0 评论