![](https://img-blog.csdnimg.cn/20201014180756757.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
大数据开发平台搭建踩坑记录
文章平均质量分 50
小雏菊的成长
大数据开发,搬砖人
展开
-
cdh没有正常停止重启后agent链接不上server处理
cdh没有正常停止重启后agent链接不上server处理原创 2023-10-17 11:57:26 · 488 阅读 · 0 评论 -
[INTERNAL_ERROR]the number of addresses could only be equal to 1, failed to get ip from host: node1,
(10.10.1.7)[INTERNAL_ERROR]the number of addresses could only be equal to 1, failed to get ip from host: node1, addresses:10.10.1.7,10.10.1.7原创 2023-07-31 10:43:08 · 139 阅读 · 0 评论 -
CDH-6.3.2从零到一的详细安装教程&hive on Spark性能测试教程
CDH-6.3.2详细安装教程,从零到一的详细教程,包括mysql、Java、CM、hive、Spark、Hadoop、zookeeper、kafka、Hue、flume、oozie的安装教程原创 2023-07-18 09:25:34 · 2948 阅读 · 0 评论 -
解决CDH-6.3.2 hive on spark 运行报错: Error while processing statement: FAILED: Execution Error, return co
Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. Job hasn't been submitted after 61s. Aborting it. Possible reasons include network issues, errors in remote driver or the cluster原创 2023-06-16 16:09:23 · 770 阅读 · 0 评论 -
supervisor> restart bili:create_bili_index bili:create_bili_index: ERROR (not running) bili:create_b
supervisor 报错:supervisor> restart bili:create_bili_indexbili:create_bili_index: stoppedbili:create_bili_index: ERROR (spawn error)supervisor> restart bili:create_bili_indexbili:create_bili_index: ERROR (not running)bili:create_bili_index: ERROR (spaw原创 2022-08-31 19:43:03 · 226 阅读 · 0 评论 -
新下载git安装,没有设置本地用户名和邮箱号,导致Idea通过taken 连接GitHub时,出现Invalid authentication data. Connection reset错误解决办法
新下载git安装,没有设置本地用户名和邮箱号,导致Idea通过taken 连接GitHub时,出现Invalid authentication data. Connection reset错误解决办法原创 2022-06-12 23:41:32 · 228 阅读 · 0 评论 -
记录一下Zookeeper挂掉了怎么处理
Zookeeper挂掉怎么解决原创 2022-05-27 15:15:59 · 2095 阅读 · 0 评论 -
解决报错:java: You aren‘t using a compiler supported by lombok, so lombok will not work and has been dis
解决idea 的因为lombok的报错:java: You aren't using a compiler supported by lombok, so lombok will not work and has been disabled. Your processor is: com.sun.proxy.$Proxy27 Lombok supports: OpenJDK javac, ECJ原创 2022-03-16 21:45:53 · 24429 阅读 · 17 评论 -
Cannot create directory /tmp/hive. Name node is in safe mode. The reported blocks 451 needs addition
Caused by: org.apache.hadoop.ipc.RemoteException: Cannot create directory /tmp/hive/lqs/eb088783-3bce-4d6d-9f90-62faf733a1c0. Name node is in safe mode.The reported blocks 451 needs additional 2 blocks to reach the threshold 0.9990 of total blocks 454.Th原创 2022-03-01 15:05:12 · 714 阅读 · 0 评论 -
Could not find a file system implementation for scheme ‘hdfs‘. The scheme is not directly supported
启动flink高可用包如下错误:Could not create FileSystem for highly available storage path(hdfs://hadoop102:8020/flink/standalone/ha/cluster_lqs)Could not find a file system implementation for scheme 'hdfs'. The scheme is not directly supported by Flink and no Hadoop原创 2022-01-05 02:00:00 · 3280 阅读 · 0 评论 -
Phoenix API Exception in thread “main“ java.lang.NoClassDefFoundError: org/apache/http/config/Lookup
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/http/config/LookupCaused by: java.lang.ClassNotFoundException: org.apache.http.config.LookupException in thread "main" java.lang.NoClassDefFoundError: com/google/protobuf/GeneratedMes原创 2021-12-31 12:00:00 · 1013 阅读 · 0 评论 -
ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) kafka.c
[2021-12-28 23:35:02,165] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)kafka.common.InconsistentClusterIdException: The Cluster ID eq9F2UfWTVqmKCEial0hrw doesn’t match stored clusterId Some(43bjl8_0Qoe6Pw3psZ原创 2021-12-29 11:50:22 · 12434 阅读 · 0 评论 -
hive启动服务突然报错:The dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx------
java.lang.RuntimeException: Error applying authorization policy on hive configuration: The dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx------ at org.apache.hive.service.cli.CLIService.init(CLIService.java:118) ~[hive-service-3.1原创 2021-12-22 10:14:06 · 1243 阅读 · 0 评论 -
DataGrip [08S01] Communications link failure The last packet successfully received from the server
[08S01] Communications link failure The last packet successfully received from the server was 193 milliseconds ago. The last packet sent successfully to the server was 172 milliseconds ago.No appropriate protocol (protocol is disabled or cipher suites原创 2021-12-20 15:25:26 · 7066 阅读 · 20 评论 -
Connecting to jdbc:hive2://bdc112:10000 21/12/19 21:05:23 [main]: WARN jdbc.HiveConnection: Failed t
Connecting to jdbc:hive2://bdc112:1000021/12/19 21:05:23 [main]: WARN jdbc.HiveConnection: Failed to connect to bdc112:10000Could not open connection to the HS2 server. Please check the server URI and if the URI is correct, then ask the administrator to原创 2021-12-19 21:14:52 · 1844 阅读 · 0 评论 -
java.sql.SQLException: Failed to start database ‘metastore_db‘ with class loader sun.misc.Launcher$A
详细报错信息如下:2021-12-19T19:20:16,310 ERROR [cbeeba86-79bb-4066-8f66-3997efd02277 main] pool.HikariPool: HikariPool-1 - Exception during pool initialization.java.sql.SQLException: Failed to start database 'metastore_db' with class loader sun.misc.Launcher$App原创 2021-12-19 19:30:32 · 2957 阅读 · 0 评论 -
hive第一次启动报报错: Call From bdc112/192.168.10.112 to bdc112:8020 failed on connection exception: java.ne
Exception in thread "main" java.lang.RuntimeException: java.net.ConnectException: Call From bdc112/192.168.1rg/hadoop/ConnectionRefused at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:651) at org.apache.hadoop.hive.ql.session.Se原创 2021-12-19 19:23:08 · 1008 阅读 · 0 评论 -
log4j:WARN No appenders could be found for logger log4j:WARN Please initialize the log4j system prop
Maven log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).log4j:WARN Please initialize the log4j system properly.log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.原创 2021-12-14 20:24:35 · 1127 阅读 · 1 评论 -
Maven Scanning for projects... < org.example:MapReduceDemo > Building MapReduceDemo 1.0-SNAPSHOT BUI
解决Maven打包时不报错,也不报异常,显示打包成功,但是没有打包出来的。包含build标签内容!异常信息如下:```info[INFO] Scanning for projects...[INFO] [INFO] ---------------------< org.example:MapReduceDemo >----------------------[INFO] Building MapReduceDemo 1.0-SNAPSHOT[INFO] --------------------原创 2021-12-14 18:49:24 · 4414 阅读 · 0 评论 -
已加载插件:fastestmirror Loading mirror speeds from cached hostfile There are no enabled repos. Run “yum
详细报错信息已加载插件:fastestmirrorLoading mirror speeds from cached hostfileThere are no enabled repos. Run "yum repolist all" to see the repos you have. To enable Red Hat Subscription Management repositories: subscription-manager repos --enable <repo&原创 2021-12-05 18:34:30 · 13430 阅读 · 0 评论 -
/kylin/bin/set-java-home.sh: 第 32 行:[: : 期待整数表达式 kylin/bin/find-hadoop-conf-dir.sh:行33: hbase: 未找到命令
/home/lqs/module/kylin/bin/set-java-home.sh: 第 32 行:[: : 期待整数表达式Retrieving hadoop conf dir.../home/lqs/module/kylin/bin/find-hadoop-conf-dir.sh:行33: hbase: 未找到命令KYLIN_HOME is set to /home/lqs/module/kylinPlease make sure the user has the privilege to r原创 2021-12-03 10:44:06 · 2040 阅读 · 0 评论 -
KYLIN_HOME is set to /home/lqs/module/kylin
最近电脑老卡,一直想换系统,正好今天给我一个机会,于是果断开始,开始后安装破解Markdownpad2,之后出现的错误.以及错误解决.安装提供软件展示:安装Markdownpad2首先是软件的下载地址: [http://markdownpad.com/download.html “下载地址”)我们有一个替换的软件,还有一个是秘钥.第一步安转直接下载官方的mardownpad软件,之后安装完成后打开会出现输入秘钥,此时输入我们的邮箱和秘钥就可以激活了!如果输入我们的秘钥出现错误,不是秘钥不能用原创 2021-12-03 10:41:34 · 637 阅读 · 0 评论 -
Complete output( 12 lines) : /bin/sh: mysql_config:未找到命令/bin/sh: mariadb_config:未找到命令/bin/sh: mysql_
解决Linux下安装 superset平台的mysql驱动安装时的报错using cached mysqlclient-i.4.3.tar.gz (86 kB)reparing metadata (setup.py) ... errorERROR:Command errored out with exit status l:command:/home/lqs/Niniconda3/envs/superset/bin/python -c 'import io,os,sys,setuptools,toke原创 2021-12-02 15:39:42 · 3290 阅读 · 0 评论 -
Could not open client transport with JDBC Uri: jdbc:hive2://hadoop102:10000: Failed to open new ses
解决远程连接hive报错:jdbc:hive2://hadoop102:10000: Failed to open new session: java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException (org.apache.hadoop.security.authorize.AuthorizationException):The specified database user/password combination is rej原创 2021-12-01 16:23:35 · 4510 阅读 · 18 评论 -
Cannot connect to discovery server for announce: Announcement failed for http://hadoop102:8881
linux下启动Presto报错:Cannot connect to discovery server for announce: Announcement failed for http://hadoop102:8881在虚拟机hadoop103启动时报错[lqs@hadoop103 presto]$ bin/launcher run报错内容如下:hadoop103:349662021-12-01T12:59:12.646+0800 ERROR Discovery-0 io.airlift.di原创 2021-12-01 13:21:28 · 3181 阅读 · 0 评论 -
解决DataGrip 2021.3.1连接我自己在虚拟机里面的linux mysql时报错
Communications link failureThe last packet successfully received from the server was 192 milliseconds ago. The last packet sent successfully to the server was 173 milliseconds ago.No appropriate protocol (protocol is disabled or cipher suites are inap原创 2021-11-29 13:22:30 · 2355 阅读 · 10 评论