[nQSError: 76015] The active Oracle BI Scheduler instance in the cluster could not be determined.

问题：

最近遇到一个很奇葩的问题，opmn启动服务时，好慢，每次都卡在BI Scheduler服务那，最终BI Scheduler老启动失败。

查看日志文件信息：

1) /home/BIEE_HOME/instances/instance1/diagnostics/logs/OracleBISchedulerComponent/

coreapplication_obisch1/nqscheduler.log 此日志文件中每次日志信息到以下地方就没有内容了，而且又没看到错误信息：

[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\NumGlobalRetries not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\MinGlobalSleepSecs not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\MaxGlobalSleepSecs not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\NumRequestRetries not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\MinRequestSleepSecs not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\MaxRequestSleepSecs not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\NumDeliveryRetries not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\MinDeliverySleepSecs not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\MaxDeliverySleepSecs not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\Debug not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\KeepErrorLogFiles not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\LogMailContent not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\MaxRowsTimesColumns not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\Generate7BitPlainText not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value iBots\ForceUTF8 not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value Workflow\Server not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value Workflow\System not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value Workflow\Service not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value Mail\SmtpCaCertificateFile not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value Mail\SmtpCaCertificateDirectory not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860]  [67004] Configuration value Mail\SmtpCipherList not set.
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 62608860] Verifying Scheduler's backend database configuration [[


]]
[2015-03-10T22:29:00.000+08:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 0054EzskBq3Fw000jzwkno0003aq000000] [tid: 6f3c9940]  [16020] Metadata Database Type: Oracle 11g [[
Data Source Name: (DESCRIPTION =(ADDRESS_LIST =(ADDRESS = (PROTOCOL = TCP)(HOST = 10.50.28.104)(PORT = 1521)))(CONNECT_DATA =(SERVICE_NAME = ora1)))
Data Source Type: Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64b
]]

2) /home/BIEE_HOME/instances/instance1/diagnostics/logs/OracleBISchedulerComponent/coreapplication_obisch1

/console~coreapplication_obisch1~1.log 此日志文件中也没有错误信息，只有一行启动服务的日志信息：

--------
15/03/10 22:28:59 Start process

3） home/BIEE_HOME/instances/instance1/diagnostics/logs/OPMN/opmn/opmn.log 此日志文件中的错误信息如下：

[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Process Ping Failed: coreapplication_obisch1~OracleBISchedulerComponent~coreapplication_obisch1~1 (1253245621:14774) [No addresses matched the properties for the request]
[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Process Ping Failed: coreapplication_obisch1~OracleBISchedulerComponent~coreapplication_obisch1~1 (1253245621:14774)
[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Ping failed in Ready callback for proc:1253245621
[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Process Ping Failed: coreapplication_obis1~OracleBIServerComponent~coreapplication_obis1~1 (1253245618:14772) [No addresses matched the properties for the request]
[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Process Ping Failed: coreapplication_obis1~OracleBIServerComponent~coreapplication_obis1~1 (1253245618:14772)
[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Ping failed in Ready callback for proc:1253245618
[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Process Ping Failed: coreapplication_obips1~OracleBIPresentationServicesComponent~coreapplication_obips1~1 (1253245619:14773) [No addresses matched the properties for the request]
[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Process Ping Failed: coreapplication_obips1~OracleBIPresentationServicesComponent~coreapplication_obips1~1 (1253245619:14773)
[2015-03-10T22:29:00+08:00] [opmn] [ERROR:1] [] [libopmncustom] Ping failed in Ready callback for proc:1253245619
[2015-03-10T22:29:00+08:00] [opmn] [NOTIFICATION:1] [665] [pm-process] Process Alive: coreapplication_obiccs1~OracleBIClusterControllerComponent~BIClusterController~1 (1253245622:14775)
[2015-03-10T22:29:00+08:00] [opmn] [NOTIFICATION:1] [665] [pm-process] Process Alive: coreapplication_obijh1~OracleBIJavaHostComponent~coreapplication_obijh1~1 (1253245620:14771)
[2015-03-10T22:29:02+08:00] [opmn] [ERROR:1] [] [libopmncustom] Process Ping Failed: coreapplication_obips1~OracleBIPresentationServicesComponent~coreapplication_obips1~1 (1253245619:14773) [No addresses matched the properties for the request]

启动好多次BI Scheduler还是失败，通过EM单独启动还是不行。最后在命令行中单独启动BI Scheduler，居然成功了。

进入目录home/BIEE_HOME/instances/instance1/bin，执行以下命令：./opmnctl startproc ias-component=coreapplication_obisch1

BI Scheduler虽然启动成功，可analytics建代理时还是报以下错误：

出现以下错误:Oracle BI Scheduler 错误: [nQSError: 76015] The active Oracle BI Scheduler instance in the cluster could not be determined.

解决方法：

进入目录：/home/BIEE_HOME/Oracle_BI1/network/admin

在此目录新建文件sqlnet.ora(注意文件名是小写的哦！)

在此文件内添加以下两行内容：

DISABLE_OOB=ON
BREAK_POLL_SKIP=10000

最终服务启动很快，同时也启动成功了。

原论坛详解：

APPLIES TO:

Business Intelligence Suite Enterprise Edition - Version 11.1.1.7.1 and later
Oracle Exalytics Software - Version 1.0.0.0.0 to 1.0.0.5.0 [Release 1.0]
Information in this document applies to any platform.

SYMPTOMS

Saving or running an agent in Oracle Business Intelligence Enterprise Edition (OBIEE) 11.1.1.7.x fails with error:

Oracle BI Scheduler error: 
[nQSError:76015] "The active oracle BI Scheduler instance in the cluster cannot be determined"

This issue is observed in a non-clustered BI Server instance installed on an Exalytics system. It may also be observed on OBIEE instances on installed on other (non-Exalytics) servers.

If the BI Scheduler component is started individually, (via OPMNCTL command), and before starting the BI Server process, it starts without error.

Steps to Reproduce Error
-----------------------------
1. Login into OBIEE Presentation Server/BI Answers.
2. Click on New agent.
3. Select the analysis to be delivered
4. Click on Save.
5. The agent does not get saved and the above error occurs.

CAUSE

When the BIScheduler starts up, (or is initialized), a query is run in the background to the Scheduler database tables.  These tables reside in the XXX_BIPLATFORM schema created by the Fusion Middleware Repository Creation Utility (RCU).
In this case, OBIEE Development analysis of the process dumps and stack trace found that when the BI Scheduler process failed to start, the SQL query execution got struck at OCIStmtExecute method.  For example:

Stack:
 -------
 #0  0x00000038d0e0d91b in read () from /lib64/libpthread.so.0
 #1  0x00007fd3df75b2c2 in snttread () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #2  0x00007fd3df75b07d in nttfprd () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #3  0x00007fd3df7505be in nsbasic_brc () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #4  0x00007fd3df753421 in nsbrecv () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #5  0x00007fd3df742191 in nioqrc () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #6  0x00007fd3df77a37a in ttcdrv () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #7  0x00007fd3df748da1 in nioqwa () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #8  0x00007fd3df72c4a3 in upirtrc () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #9  0x00007fd3df739976 in kpurcsc () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #10 0x00007fd3df731a4b in kpuexec () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #11 0x00007fd3df72cf7f in OCIStmtExecute () from
 /u01/app/oracle/product/fmw/Oracle_BI1/lib/libclntsh.so.11.1
 #12 0x00007fd3e403c5b5 in DbGatewayOci8::ExecuteQuery() () from
 /u01/app/oracle/product/fmw/Oracle_BI1/bifoundation/server/bin/libnqsdbgateway
 oci10g64.so

  

The above code analysis confirms that OCI layer is seeing break messages which cause the OCIStmtExecute method to wait on read.

SOLUTION

To resolve this issue,  set the following parameters in the sqlnet.ora file located in <Middleware_Home>/Oracle_BI1/network/admin on the machine where Oracle BI server is installed.

DISABLE_OOB=ON
BREAK_POLL_SKIP=10000

NOTE: If sqlnet.ora file does not exist in the above mentioned directory,  then create one using sample provided in the same directory under samples sub-directory (<Middleware_home>Oracle_BI1/network/admin/samples).

After modifying the sqlnet.ora file, the BI Services must be restarted (opmnctl stopall /startall).