BUG
黑色的小德牧
小菜鸟一枚。
展开
-
打包时,scala 类不会编译并打包进去
打包时,scala 类不会编译并打包进去1.导入依赖 <build> <plugins> <plugin> <groupId>net.alchim31.maven</groupId> <artifactId>scala-maven-plugin</artifactId> <v原创 2021-05-02 08:35:34 · 236 阅读 · 0 评论 -
spark的yarn模式,运行程序找不到lzo
spark的yarn模式,运行程序找不到lzo找不到lzo解决:配置spark-defaults.conf,添加如下spark.jars= /opt/module/hadoop-2.7.2/share/hadoop/common/hadoop-lzo-xxxx.jar把你lzo的jar包配置到spark里原创 2021-04-29 19:34:44 · 208 阅读 · 0 评论 -
spark的yarn模式,报错Unknown container
spark的yarn模式,executors的stdout里报错Unknown container报错java.lang.Exception: Unknown container.Container either has not started or has already completed or doesn't belong tothis node at all.解决: 配置yarn-site.xml<property> <name>yarn.log.原创 2021-04-29 19:15:01 · 673 阅读 · 0 评论 -
电商数据仓库(十)
基于Apache的电商数据仓库(十)欢迎第22章 即席查询:Kylin22.1 Kylin简介22.2 Kylin核心概念22.2.1 OLAP22.2.2 OLAP Cube22.2.3 dimension and measure22.3 Kylin安装22.3.1 依赖环境22.3.2 搭建22.3.2.1 Hbase安装22.3.2.2 Kylin安装22.4 Kylin使用22.4.1 创建工程22.4.2 获取数据源22.4.3 创建model22.4.4 构建cube22.4.5 在cube构建原创 2021-04-23 10:44:28 · 220 阅读 · 0 评论 -
运行Tez时检查到用过多内存而被杀死进程问题
一 报错Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown这种问题是从机上运行的Container试图使用过多的内存,而被NodeManager kill掉了二 解决方法修改yarn-site.xml<property><name>yarn.nodemanager.vmem-check-enabled</name><value>原创 2021-02-08 21:21:32 · 326 阅读 · 0 评论 -
CentOS6:yum报错(YumRepo Error,Cannot retrieve XXX: base)
一、报错YumRepo Error: All mirror URLs are not using ftp......Cannot retrieve repository metadata (repomd.xml) for repository: base二、修改/etc/yum.repos.d/CentOS-Base.repo# CentOS-Base.repo## The mirror system uses the connecting IP address of the client a原创 2021-02-01 00:09:52 · 316 阅读 · 0 评论 -
hive:impossible to write to binary log since BINLOG_FORMAT = STATEMENT
一、报错java.sql.SQLException: Cannot execute statement: impossible to write to binary log since BINLOG_FORMAT = STATEMENT and at least one table uses a storage engine limited to row-based logging. InnoDB is limited to row-logging when transaction isolation原创 2020-12-02 20:22:24 · 173 阅读 · 0 评论 -
BUG:error in shuffle in localfetcher Caused: java.io.FileNotFoundException
一、机器eclipse二、报错java.lang.Exception: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in localfetcher#1Caused by: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in localfetcher#1Caused by: j原创 2020-11-04 19:37:44 · 392 阅读 · 0 评论