BIEE 12C 连接 HIVE Spark 做数据源

最新推荐文章于 2021-08-04 13:33:19 发布

吃鱼的羊

最新推荐文章于 2021-08-04 13:33:19 发布

阅读量1.4k

点赞数

分类专栏： BIEE12C

BIEE12C 专栏收录该内容

19 篇文章 0 订阅

订阅专栏

尝试了好多次终于BIEE连通了HIVE和Spark

HIVE &Spark 配置:

1、在客户机AdminTool配置好Hive ODBC（Oracle DataDirect）；

2、AdminTool导入的时候会发生异常，HIVE我这里是通过手动添加表和字段的，Spark没问题；

3、上传RPD；

4、修改linux配置，主要是两个地方，一个是obis.properties，另一个是odbc.ini配置

在/user_projects/domains/bi/config/fmwconfig/bienv目录下

obis.properties配置：

LD_LIBRARY_PATH=/usr/lib64,

$ORACLE_HOME/bi/common/ODBC/Merant/8.0.1/lib,

$ORACLE_HOME/bi/common/ODBC/Merant/7.1.5/lib,

$ORACLE_HOME/bi/bifoundation/server/bin,

$ORACLE_HOME/bi/bifoundation/web/bin,

$ORACLE_HOME/bi/clients/Essbase/EssbaseRTC/bin,

$ORACLE_HOME/bi/common/ODBC,

$ORACLE_INSTANCE,

$ORACLE_HOME/lib

HADOOP_DLL=$ORACLE_HOME/bi/common/ODBC/Merant/7.1.5/lib/ARhive27.so

odbc.ini 配置

[Spark]

Driver=$ORACLE_HOME/bi/common/ODBC/Merant/8.0.1/lib/ARspark28.so
Description=Oracle 8.0 Apache Spark Wire Protocol
ArraySize=16384
Database=YourDB
DefaultLongDataBuffLen=1024
EnableDescribeParam=0
HostName=YourIPAddress
LoginTimeout=30
MaxVarcharSize=2000
PortNumber=YourPort
RemoveColumnQualifiers=0
StringDescribeType=12
TransactionMode=0
UseCurrentSchema=0

[Hive]

Driver=$ORACLE_HOME/bi/common/ODBC/Merant/7.1.5/lib/ARhive27.so
Description=Oracle 7.1 Apache Hive Wire Protocol
ArraySize=16384
Database=default
DefaultLongDataBuffLen=1024
EnableDescribeParam=0
HostName=YourIPAddress
LoginTimeout=30
MaxVarcharSize=2000
PortNumber=YourPort
RemoveColumnQualifiers=0
StringDescribeType=12
TransactionMode=0

完成后需要重启OBIS

obis.properties

LD_LIBRARY_PATH=/app/BIEE12C/bi/common/ODBC/Merant/8.0.1/lib:/app/BIEE12C/bi/common/ODBC/Merant/7.1.5/lib:$LD_LIBRARY_PATH
PATH=/app/BIEE12C/bi/common/ODBC/Merant/8.0.1/lib:/app/BIEE12C/bi/common/ODBC/Merant/7.1.5/lib:$PATH
HADOOP_DLL=/app/BIEE12C/bi/common/ODBC/Merant/7.1.5/lib/ARhive27.so

odbc.ini

[impala_new]
Driver=/app/BIEE12C/bi/common/ODBC/Merant/7.1.5/lib/ARimpala27.so
Description=Oracle 7.1 Cloudera Impala Wire Protocol
ArraySize=16384
Database=edw
DefaultLongDataBuffLen=1024
DefaultOrderByLimit=-1
EnableDescribeParam=0
HostName=datanode001
LoginTimeout=30
MaxVarcharSize=2000
PortNumber=21050
RemoveColumnQualifiers=0
StringDescribeType=12
TransactionMode=0
UseCurrentSchema=0
WireProtocolVersion=2

[Spark BIEE]
Driver=/app/BIEE12C/bi/common/ODBC/Merant/8.0.1/lib/ARspark28.so
Description=Oracle 8.0 Apache Spark Wire Protocol
ArraySize=16384
Database=e_app
DefaultLongDataBuffLen=1024
EnableDescribeParam=0
HostName=spark-01
LoginTimeout=30
MaxVarcharSize=2000
PortNumber=10005
RemoveColumnQualifiers=0
StringDescribeType=12
TransactionMode=0
UseCurrentSchema=0