接上篇:Kylin实践(一)--Hadoop环境搭建
https://blog.csdn.net/isscici06/article/details/80624797
-----------------------------------------------------------------------------------------------------------------------------------------------------------
集群搭建好后,各项服务都正常启动,看似没问题,但在cube构建过程中,还是出现了不少问题,以下详细记录一下:
1、用stop-all.sh关闭hadoop,再用start-all.sh打开hadoop的方式重启hadoop,重启后,启动kylin报如下错误:
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
经排查,是因为hadoop关闭后,会将HBASE也关掉,启动后,应该用jps查看一下,是否有HMaster和HRegionServer进程,没有的话就应该重新将HBASE启起来,直接 执行./start-hbase.sh启动hbase就行。
2.启动kylin后,无法构建cube,在step 1就报错,而且有时有报错信息,有时连报错信息都没有,只能看kylin的日志,错误如下:
Number of reduce tasks is set to 0 since there's no reduce operator
java.io.IOException: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=1536, maxMemory=1024
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerUtils.validateResourceRequest(SchedulerUtils.java:272)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerUtils.normalizeAndValidateRequest(SchedulerUtils.java:228)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerUtils.normalizeAndValidateRequest(SchedulerUtils.java:236)
at org.apache.hadoop.yarn.server.resourcemanager.RMAppManager.validateAn