环境是全部配置好的,配置链接:https://blog.csdn.net/qq_38929220/article/details/95481002
-
启动kylin时遇到报错:
[root@hadoop ~]# /hadoop/kylin/bin/kylin.sh start
Retrieving hadoop conf dir...
KYLIN_HOME is set to /hadoop/kylin
Retrieving hive dependency...
Something wrong with Hive CLI or Beeline, please execute Hive CLI or Beeline CLI in terminal to find the root cause.
修改
find-hive-dependency.sh
,删掉hive_env=hive ${hive_conf_properties} -e set 2>&1 | grep 'env:CLASSPATH'
,加入下面几行后,kylin就能成功启动了。
hive -e set >/tmp/hive_env.txt 2>&1
hive_env=`grep 'env:CLASSPATH' /tmp/hive_env.txt`
hive_env=`echo ${hive_env#*env:CLASSPATH}`
hive_env="env:CLASSPATH"${hive_env}
-
cube创建时意外关闭kylin,重启jobhistoryserver
Couldn't find hive executable jar. Please check if hive executable jar exists in HIVE_LIB folder.
-
尝试启动hive发现:
hive查询异常:Cannot create directory /tmp/hive-root/。。。Name node is in safe mode.
关闭安全模式:
hdfs dfsadmin -safemode leave
之后kylin可以正常启动
sqoop执行语句
列出mysql中所有数据库
sqoop list-databases --connect jdbc:mysql://hostname:3306?useSSL=false --username fmmanager -P
列出数据库中的表
sqoop list-tables --connect jdbc: mysql://hostname:3306/database?useSSL=false database username fmmanager -P
导出数据库中的所有表:
sqoop import-all-tables “-Dorg.apache.sqoop.splitter.allow_text_splitter=true” --connect jdbc:mysql://hostname:3306/database?useSSL=false --username fmmanager -P
导出数据库所有表到hive,除了某个:
sqoop import-all-tables “-Do