大数据
文章平均质量分 70
大数据组件相关
day-day-up2
云计算领域-优质博主
展开
-
IOException: Could not get block locations......Aborting...block==null
IOException: Could not get block locations......Aborting...block==null原创 2024-04-27 20:11:33 · 341 阅读 · 4 评论 -
Uncaught exception while reverting partial writes to file /opt/newdisk6/yarn....ClosedByInterruptExc
Uncaught exception while reverting partial writes to file /opt/newdisk6/yarn/nm/usercache/ ....java.nio.channels.ClosedByInterruptException原创 2024-04-21 11:29:36 · 941 阅读 · 0 评论 -
flume sink端是kafka的 数据重复现象如何处理
flume数据重复问题可以从flume日志是否异常,kafka生产者幂等性,flume source,以及最终的etl业务清洗等各方面入手。原创 2023-08-25 23:39:15 · 383 阅读 · 0 评论 -
message:A managed table‘s location should be located within managed warehouse root directory
An external table's location should not be located outside the location specified on its database, A managed table's location should be located within managed warehouse root direc原创 2023-08-19 12:40:36 · 97 阅读 · 0 评论 -
惊!-hive on spark(hive任务)任务慢---竟然有这些原因!
hive性能慢的排查过程,hive on spark 任务慢原创 2023-08-06 15:06:52 · 1321 阅读 · 1 评论 -
Caused by: java.io.FileNotFoundException:******creds.localjceks (Permission denied)
Caused by: java.io.FileNotFoundException: /var/run/cloudera-scm-agent/process/1879-yarn-NODEMANAGER/creds.localjceks (Permission denied)原创 2023-02-26 22:19:38 · 710 阅读 · 1 评论 -
ERROR: Invalid HADOOP_MAPRED_HOME
ERROR: Invalid HADOOP_MAPRED_HOME原创 2023-02-11 10:23:10 · 1486 阅读 · 0 评论 -
docker部署Clickhouse集群遇到的坑--第二部
项目场景:容器部署Clickhouse分布式集群必须将数据目录挂载出来,但是网上有些文章并不适合生产:例如:https://blog.csdn.net/yangshenggu/article/details/122730803 像这篇文章挂载的数据目录就有可能会有的sql执行不了参考文章问题描述在参考上面的方式docker部署clickhouse分布式集群时,就出现了以下问题。能create 库.表,却不能删除表例如:在执行drop table default.test命令时报错:std:原创 2022-03-10 18:22:26 · 4136 阅读 · 0 评论 -
docker部署Clickhouse集群遇到的坑--第一部
项目场景:在使用docker部署Clickhouse集群时,遇到的各种坑问题一``执行select * from system.clusters;查看集群信息,没有显示出集群信息,说明分布式集群搭建失败,如以下图1:┌─cluster───────────────────────────┬─shard_num─┬─replica_num─┬─host_name─┬─port─┬─user────┐ default │1 │ test_cluster_two_shards │原创 2022-03-10 17:21:50 · 3043 阅读 · 0 评论 -
Clickhouse
Application: filesystem error: in rename: Invalid cross-device link原创 2021-12-16 20:02:08 · 2053 阅读 · 3 评论