VMware vCenter 连接数据库的故障与密码修改

在生产环境中如果使用Oracle 11g 作为VMware vCenter数据存放的数据库,就一定要主要Oracle 11g的安全特性,如果不再一开始的时候修改Oracle对于用户密码过期的限制,就可能造成vCenter所用的oracle数据库密码在使用 180 天后,就会被突然锁定,造成vCenter无法启动和访问。       今天在生产系统中遇到一个因数据库密码过期而导致的vCenter
摘要由CSDN通过智能技术生成
       在生产环境中如果使用Oracle 11g 作为VMware vCenter数据存放的数据库,就一定要主要Oracle 11g的安全特性,如果不再一开始的时候修改Oracle对于用户密码过期的限制,就可能造成vCenter所用的oracle数据库密码在使用 180 天后,就会被突然锁定,造成vCenter无法启动和访问。
       今天在生产系统中遇到一个因数据库密码过期而导致的vCenter无法启动的问题,根据网上的类似案例,进行了实际处理,并记录了vCenter的密码修改方式,以作为类似问题的记录。
      通过这个案例,也说明以后在使用Oracle 11g数据库的时候,必须修改默认口令文件中的密码失效时间,错误登录锁定次数等参数,以避免一些不必要的问题。

      一、类似现象
       今天在系统中遇到一个和这个帖子现象类似的问题:

现象:VCenter5.1 服务无法启动

到log查看VPXD文件

2013-11-19T10:36:57.937+08:00 [04672 error 'vpxdvpxdMain'] [Vpxd::ServerApp::Init] Init failed: Unexpected exception
--> Backtrace:
--> backtrace[00] rip 0000000180100c98
--> backtrace[01] rip 0000000180101fae
--> backtrace[02] rip 000000018008aeab
--> backtrace[03] rip 0000000000584971
--> backtrace[04] rip 0000000000521298
--> backtrace[05] rip 00000000005216c9
--> backtrace[06] rip 0000000000490fae
--> backtrace[07] rip 000000014112bfb8
--> backtrace[08] rip 0000000140020078
--> backtrace[09] rip 000000014002016a
--> backtrace[10] rip 0000000140020279
--> backtrace[11] rip 0000000140020609
--> backtrace[12] rip 0000000140362903
--> backtrace[13] rip 0000000140b0e4b9
--> backtrace[14] rip 0000000140b0835c
--> backtrace[15] rip 0000000140d28a3b
--> backtrace[16] rip 000007ff7fed4dc6
--> backtrace[17] rip 0000000078d3b70a
--> backtrace[18] rip 0000000000000000
-->
2013-11-19T10:36:57.937+08:00 [04672 warning 'VpxProfiler'] ServerApp::Init [TotalTime] took 4250 ms
2013-11-19T10:36:57.937+08:00 [04672 error 'Default'] Failed to intialize VMware VirtualCenter. Shutting down...
2013-11-19T10:36:57.937+08:00 [04672 info 'vpxdvpxdSupportManager'] Wrote uptime information
2013-11-19T10:37:05.687+08:00 [01572 warning 'VpxProfiler' opID=SWI-22545730] VpxUtil_InvokeWithOpId [TotalTime] took 12000 ms
2013-11-19T10:37:17.687+08:00 [04636 warning 'VpxProfiler' opID=SWI-b8822e55] VpxUtil_InvokeWithOpId [TotalTime] took 12000 ms
2013-11-19T10:37:29.687+08:00 [04904 warning 'VpxProfiler' opID=SWI-73e8350a] VpxUtil_InvokeWithOpId [TotalTime] took 12000 ms
2013-11-19T10:37:41.687+08:00 [04464 warning 'VpxProfiler' opID=SWI-83953f27] VpxUtil_InvokeWithOpId [TotalTime] took 12000 ms
2013-11-19T10:37:53.687+08:00 [01572 warning 'VpxProfiler' opID=SWI-8441138f] VpxUtil_InvokeWithOpId [TotalTime] took 12000 ms
2013-11-19T10:37:54.187+08:00 [04672 info 'Default'] Forcing shutdown of VMware VirtualCenter now

查看SSO log文件:

Caused by: java.sql.SQLException: ORA-28001: the password has expired

 at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:439)
 at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:388)
 at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:381)
 at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:564)
 at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthenticate.java:431)

分析:

原因是账户密码已过期,数据库采用的是oracle 11g,新增加了账户安全性,密码有效期为180天,之前的oracle 9i/10g都没有这个问题,VCenter安装时vc数据库用户vpxadmin,另外SSO的数据库用户RSA_DBA和RSA_USER,总共三个账号。

查看数据库账户配置:

$sqlplus / as sysdba

select * from dba_profiles WHERE dba_profiles.profile='DEFAULT';

 

1、查看用户的proifle是哪个,一般是default:

sql>SELECT username,PROFILE FROM dba_users;

2、查看指定概要文件(如default)的密码有效期设置:

sql>SELECT * FROM dba_profiles s WHERE s.profile='DEFAULT' AND resource_name='PASSWORD_LIFE_TIME';

3、可以将密码有效期由默认的180天修改成“无限制”:

sql>ALTER PROFILE DEFAULT LIMIT PASSWORD_LIFE_TIME UNLIMITED;

4、解除账户锁定:

sql> alter user vpxadmin  account  unlock;

修改完成后虽然是立即生效,但是VC不一定能启动,我的是这样,可能跟VC的某些服务有关,重启系统就好了。


        二、生产环境问题处理
       生产环境中一台测试系统的vCenter突然服务断开,在vCenter的日志目录:
C:\ProgramData\VMware\VMware VirtualCenter\Logs\
      查看目前日志文件中的 vpxd-47.log 
      结合生产环境中的vCenter服务启动报错,基本可以断定是vCenter所用的oracle数据库用户密码失效导致的原因:
2014-12-18T17:40:02.669+08:00 [05784 info 'commonvpxLro' opID=HB-host-9@650533-a7f49c6] [VpxLRO] -- BEGIN task-internal-195746 -- host-9 -- VpxdInvtHostSyncHostLRO.Synchronize -- 
2014-12-18T17:40:02.670+08:00 [05784 info 'vpxdvpxdInvtHostCnx' opID=HB-host-9@650533-a7f49c6] [VpxdHostSync] Synchronizing host: host-9 (172.32.1.210, 172.32.1.210)
2014-12-18T17:40:02.674+08:00 [05784 info 'vpxdvpxdVmomi' opID=HB-host-9@650533-a7f49c6] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vpxapi.VpxaService.retrieveChanges)
2014-12-18T17:40:02.676+08:00 [05784 info 'vpxdvpxdVmomi' opID=HB-host-9@650533-a7f49c6] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.createFilter)
2014-12-18T17:40:02.684+08:00 [05944 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:02.735+08:00 [05944 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:02.738+08:00 [05944 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:02.741+08:00 [05784 info 'vpxdvpxdVmomi' opID=HB-host-9@650533-a7f49c6] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.Filter.destroy)
2014-12-18T17:40:02.744+08:00 [05784 info 'vpxdvpxdVmomi' opID=HB-host-9@650533-a7f49c6] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.cancelWaitForUpdates)
2014-12-18T17:40:03.744+08:00 [05784 info 'vpxdvpxdInvtHostCnx' opID=HB-host-9@650533-a7f49c6] [VpxdHostSync] Retrieved host update to 650533 for host-9
2014-12-18T17:40:03.774+08:00 [05784 info 'vpxdvpxdInvtHostDb' opID=HB-host-9@650533-a7f49c6] [VpxdInvtHost::SaveFieldsToDb] IPMI info of host 172.32.1.210 is not set
2014-12-18T17:40:03.782+08:00 [05784 info 'vpxdvpxdInvtHostCnx' opID=HB-host-9@650533-a7f49c6] [VpxdHostSync] Completed host synchronization for host-9
2014-12-18T17:40:03.783+08:00 [05784 info 'commonvpxLro' opID=HB-host-9@650533-a7f49c6] [VpxLRO] -- FINISH task-internal-195746 -- host-9 -- VpxdInvtHostSyncHostLRO.Synchronize -- 
2014-12-18T17:40:03.935+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:40:03.935+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:40:03.935+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.206, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:40:03.935+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:40:05.012+08:00 [02976 info 'vpxdvpxdVmomi' opID=SWI-1ee9b90a] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.206, vpxapi.VpxaService.querySummaryStatistics)
2014-12-18T17:40:05.012+08:00 [02976 info 'drmLogger' opID=SWI-1ee9b90a] [VpxDrmStatsManager::GetMetricsToCollect] No datastores requiring stats collection on host vim.HostSystem:host-1617, early return
2014-12-18T17:40:05.013+08:00 [05924 info 'vpxdvpxdVmomi' opID=SWI-60606a88] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vpxapi.VpxaService.querySummaryStatistics)
2014-12-18T17:40:05.013+08:00 [05924 info 'drmLogger' opID=SWI-60606a88] [VpxDrmStatsManager::GetMetricsToCollect] No datastores requiring stats collection on host vim.HostSystem:host-2001, early return
2014-12-18T17:40:05.014+08:00 [03648 info 'vpxdvpxdVmomi' opID=SWI-2d4474ec] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vpxapi.VpxaService.querySummaryStatistics)
2014-12-18T17:40:05.014+08:00 [03648 info 'drmLogger' opID=SWI-2d4474ec] [VpxDrmStatsManager::GetMetricsToCollect] No datastores requiring stats collection on host vim.HostSystem:host-45, early return
2014-12-18T17:40:05.015+08:00 [01444 info 'vpxdvpxdVmomi' opID=SWI-232bdc15] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vpxapi.VpxaService.querySummaryStatistics)
2014-12-18T17:40:05.015+08:00 [01444 info 'drmLogger' opID=SWI-232bdc15] [VpxDrmStatsManager::GetMetricsToCollect] No datastores requiring stats collection on host vim.HostSystem:host-9, early return
2014-12-18T17:40:05.091+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:05.143+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:05.175+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:05.184+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:05.579+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:15.092+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:40:15.128+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:15.144+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:40:15.176+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:40:15.178+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:15.185+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:40:15.212+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:15.224+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:15.580+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:40:15.618+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:21.000+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:25.171+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:25.212+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:25.251+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:25.262+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:25.657+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:31.001+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:40:31.035+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:35.206+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:35.245+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:35.285+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:35.303+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:35.696+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:41.066+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:45.243+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:45.279+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:45.318+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:45.340+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:45.730+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:51.101+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:52.674+08:00 [02804 info 'commonvpxLro' opID=HB-host-9@650536-24f55e4d] [VpxLRO] -- BEGIN task-internal-195747 -- host-9 -- VpxdInvtHostSyncHostLRO.Synchronize -- 
2014-12-18T17:40:52.675+08:00 [02804 info 'vpxdvpxdInvtHostCnx' opID=HB-host-9@650536-24f55e4d] [VpxdHostSync] Synchronizing host: host-9 (172.32.1.210, 172.32.1.210)
2014-12-18T17:40:52.683+08:00 [02804 info 'vpxdvpxdVmomi' opID=HB-host-9@650536-24f55e4d] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vpxapi.VpxaService.retrieveChanges)
2014-12-18T17:40:52.685+08:00 [02804 info 'vpxdvpxdVmomi' opID=HB-host-9@650536-24f55e4d] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.createFilter)
2014-12-18T17:40:52.693+08:00 [03772 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:52.742+08:00 [03772 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:52.749+08:00 [03772 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:52.753+08:00 [02804 info 'vpxdvpxdVmomi' opID=HB-host-9@650536-24f55e4d] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.Filter.destroy)
2014-12-18T17:40:52.755+08:00 [02804 info 'vpxdvpxdVmomi' opID=HB-host-9@650536-24f55e4d] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vmodl.query.PropertyCollector.cancelWaitForUpdates)
2014-12-18T17:40:53.756+08:00 [02804 info 'vpxdvpxdInvtHostCnx' opID=HB-host-9@650536-24f55e4d] [VpxdHostSync] Retrieved host update to 650536 for host-9
2014-12-18T17:40:53.792+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:55.271+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:55.317+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:55.352+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:55.380+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:55.769+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:40:58.020+08:00 [05776 info 'commonvpxLro' opID=HB-host-45@368570-6210bf4f] [VpxLRO] -- BEGIN task-internal-195748 -- host-45 -- VpxdInvtHostSyncHostLRO.Synchronize -- 
2014-12-18T17:40:58.021+08:00 [05776 info 'vpxdvpxdInvtHostCnx' opID=HB-host-45@368570-6210bf4f] [VpxdHostSync] Synchronizing host: host-45 (172.32.1.205, 172.32.1.205)
2014-12-18T17:40:58.031+08:00 [05776 info 'vpxdvpxdVmomi' opID=HB-host-45@368570-6210bf4f] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vpxapi.VpxaService.retrieveChanges)
2014-12-18T17:40:58.040+08:00 [05776 info 'vpxdvpxdVmomi' opID=HB-host-45@368570-6210bf4f] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vmodl.query.PropertyCollector.createFilter)
2014-12-18T17:40:58.073+08:00 [05236 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:58.247+08:00 [05236 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:58.255+08:00 [05236 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:58.265+08:00 [05236 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:40:58.272+08:00 [05776 info 'vpxdvpxdVmomi' opID=HB-host-45@368570-6210bf4f] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vmodl.query.PropertyCollector.Filter.destroy)
2014-12-18T17:40:58.277+08:00 [05776 info 'vpxdvpxdVmomi' opID=HB-host-45@368570-6210bf4f] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vmodl.query.PropertyCollector.cancelWaitForUpdates)
2014-12-18T17:40:59.277+08:00 [05776 info 'vpxdvpxdInvtHostCnx' opID=HB-host-45@368570-6210bf4f] [VpxdHostSync] Retrieved host update to 368570 for host-45
2014-12-18T17:40:59.460+08:00 [05936 warning 'Proxy Req 89294'] The client closed the stream with a request not fully forwarded.
2014-12-18T17:41:01.140+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:03.792+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:41:03.825+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:03.935+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:41:03.935+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.206, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:41:03.935+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:41:03.935+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:41:05.301+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:05.351+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:05.386+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:05.414+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:05.820+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:11.174+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:13.859+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:15.333+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:15.385+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:15.419+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:15.447+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:15.860+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:19.516+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:21.208+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:23.899+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:25.373+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:25.419+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:25.454+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:25.578+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:25.899+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:29.517+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:41:29.562+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:31.247+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:33.933+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:35.407+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:35.452+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:35.492+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:35.612+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:35.932+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:39.601+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:41.281+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:43.972+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:45.447+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:45.486+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:45.526+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:45.646+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:45.972+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:49.640+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:51.332+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:54.011+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:55.507+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:55.543+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:55.572+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:55.680+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:56.005+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:41:59.474+08:00 [05936 warning 'Proxy Req 89300'] The client closed the stream with a request not fully forwarded.
2014-12-18T17:41:59.686+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:01.383+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:01.717+08:00 [05648 info 'commonvpxLro' opID=HB-host-2001@115456-5b29654f] [VpxLRO] -- BEGIN task-internal-195749 -- host-2001 -- VpxdInvtHostSyncHostLRO.Synchronize -- 
2014-12-18T17:42:01.718+08:00 [05648 info 'vpxdvpxdInvtHostCnx' opID=HB-host-2001@115456-5b29654f] [VpxdHostSync] Synchronizing host: host-2001 (172.32.1.207, 172.32.1.207)
2014-12-18T17:42:01.728+08:00 [05648 info 'vpxdvpxdVmomi' opID=HB-host-2001@115456-5b29654f] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vpxapi.VpxaService.retrieveChanges)
2014-12-18T17:42:01.741+08:00 [05648 info 'vpxdvpxdVmomi' opID=HB-host-2001@115456-5b29654f] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vmodl.query.PropertyCollector.createFilter)
2014-12-18T17:42:01.751+08:00 [05924 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:42:01.847+08:00 [05924 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:42:01.853+08:00 [05924 info 'vpxdvpxdVmomi'] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vmodl.query.PropertyCollector.waitForUpdates)
2014-12-18T17:42:01.862+08:00 [05648 info 'vpxdvpxdVmomi' opID=HB-host-2001@115456-5b29654f] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vmodl.query.PropertyCollector.Filter.destroy)
2014-12-18T17:42:01.865+08:00 [05648 info 'vpxdvpxdVmomi' opID=HB-host-2001@115456-5b29654f] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vmodl.query.PropertyCollector.cancelWaitForUpdates)
2014-12-18T17:42:02.865+08:00 [05648 info 'vpxdvpxdInvtHostCnx' opID=HB-host-2001@115456-5b29654f] [VpxdHostSync] Retrieved host update to 115456 for host-2001
2014-12-18T17:42:02.909+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:03.936+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:42:03.936+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.206, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:42:03.936+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:42:03.936+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:42:04.052+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:05.576+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:05.601+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:05.619+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:05.721+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:06.046+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:09.727+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:11.424+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:12.909+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:42:12.949+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:14.093+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:15.619+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:15.641+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:15.660+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:15.756+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:16.081+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:19.760+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:21.503+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:22.988+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:24.132+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:25.662+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:25.681+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:25.697+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:25.800+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:26.125+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:29.800+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:31.542+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:33.028+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:34.176+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:35.705+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:35.721+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:35.742+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:35.834+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:36.161+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:39.840+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:41.577+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:43.062+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:44.214+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:45.748+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:45.757+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:45.785+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:45.867+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:46.192+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:49.876+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:51.613+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:53.102+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:53.947+08:00 [05964 info 'commonvpxLro' opID=9A386B63-0000794C-9b] [VpxLRO] -- BEGIN task-internal-195750 --  -- vmodl.query.PropertyCollector.cancelWaitForUpdates -- 28b21e9e-89f6-ed4b-4fab-8c8caff99f63(526f96d3-c036-a9f2-02d5-a32e6ec73b28)
2014-12-18T17:42:53.947+08:00 [05964 info 'commonvpxLro' opID=9A386B63-0000794C-9b] [VpxLRO] -- FINISH task-internal-195750 --  -- vmodl.query.PropertyCollector.cancelWaitForUpdates -- 
2014-12-18T17:42:53.947+08:00 [05236 error 'SoapAdapter.HTTPService'] Failed to read request; stream: <io_obj p:0x000000000f73b4a8, h:10360, <TCP '[::1]:8085'>, <TCP '[::1]:59033'>>, error: class Vmacore::SystemException(您的主机中的软件中止了一个已建立的连接。)
2014-12-18T17:42:54.259+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:55.749+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:42:55.759+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:42:55.786+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:42:55.803+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:55.809+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:55.831+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:55.868+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:42:55.899+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:56.194+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:42:56.225+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:42:59.491+08:00 [05936 warning 'Proxy Req 89308'] The client closed the stream with a request not fully forwarded.
2014-12-18T17:42:59.912+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:01.649+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:03.135+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:03.936+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:43:03.936+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:43:03.937+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.206, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:43:03.937+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:43:04.298+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:05.853+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:05.859+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:05.889+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:05.934+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:06.261+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:09.949+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:10.555+08:00 [02976 info 'commonvpxLro' opID=9A386B63-0000794F-66] [VpxLRO] -- BEGIN task-internal-195751 --  -- vmodl.query.PropertyCollector.cancelWaitForUpdates -- 28b21e9e-89f6-ed4b-4fab-8c8caff99f63(526f96d3-c036-a9f2-02d5-a32e6ec73b28)
2014-12-18T17:43:10.556+08:00 [02976 info 'commonvpxLro' opID=9A386B63-0000794F-66] [VpxLRO] -- FINISH task-internal-195751 --  -- vmodl.query.PropertyCollector.cancelWaitForUpdates -- 
2014-12-18T17:43:10.556+08:00 [02812 error 'SoapAdapter.HTTPService'] Failed to read request; stream: <io_obj p:0x00000000134892b8, h:10988, <TCP '[::1]:8085'>, <TCP '[::1]:64242'>>, error: class Vmacore::SystemException(您的主机中的软件中止了一个已建立的连接。)
2014-12-18T17:43:11.650+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:43:11.686+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:13.171+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:14.338+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:15.905+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:15.910+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:15.942+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:15.975+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:16.297+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:19.986+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:21.726+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:23.208+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:24.373+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:25.955+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:25.961+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:25.984+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:26.014+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:26.329+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:30.022+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:31.766+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:33.244+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:34.414+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:36.006+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:36.011+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:36.031+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:36.050+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:36.370+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:40.059+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:41.802+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:42.531+08:00 [05964 info 'commonvpxLro' opID=01C0A319-0000C0ED-80] [VpxLRO] -- BEGIN task-internal-195752 --  -- vmodl.query.PropertyCollector.cancelWaitForUpdates -- a40802c5-bb73-9f71-dd9f-3025d9066c8b(52688827-bbbd-4a2f-409a-49bdfccce6ef)
2014-12-18T17:43:42.531+08:00 [05100 error 'SoapAdapter.HTTPService'] Failed to read request; stream: <io_obj p:0x000000000ead5618, h:10304, <TCP '[::1]:8085'>, <TCP '[::1]:64281'>>, error: class Vmacore::SystemException(您的主机中的软件中止了一个已建立的连接。)
2014-12-18T17:43:42.532+08:00 [05964 info 'commonvpxLro' opID=01C0A319-0000C0ED-80] [VpxLRO] -- FINISH task-internal-195752 --  -- vmodl.query.PropertyCollector.cancelWaitForUpdates -- 
2014-12-18T17:43:43.282+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:44.415+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:43:44.456+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:46.057+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:46.063+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:46.076+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:46.093+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:46.404+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:50.101+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:51.849+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:53.321+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:54.489+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:56.107+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:56.124+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:56.129+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:56.135+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:43:56.438+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:00.141+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:01.883+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:03.356+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:03.937+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.206, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:44:03.937+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.210, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:44:03.938+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.207, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:44:03.938+08:00 [03244 info 'vpxdvpxdVmomi' opID=SWI-d3d52ad] [ClientAdapterBase::InvokeOnSoap] Invoke done (172.32.1.205, vpxapi.VpxaService.fetchQuickStats)
2014-12-18T17:44:04.529+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:06.144+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:06.166+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:06.173+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:06.184+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:06.483+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:10.141+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain database connection. Retrying...
2014-12-18T17:44:10.174+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:11.922+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:13.394+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:14.566+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:16.195+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:16.217+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:16.223+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:16.228+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:16.528+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:20.208+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:21.967+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:23.435+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:24.602+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:26.236+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:26.259+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:26.275+08:00 [02964 error 'Default' opID=SWI-407db688] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:26.281+08:00 [05960 error 'Default' opID=SWI-4fdf4cb8] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:26.561+08:00 [05956 error 'Default' opID=SWI-74ea80ea] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:30.246+08:00 [04308 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:32.006+08:00 [05368 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:33.468+08:00 [05648 error 'Default' opID=HB-host-2001@115456-5b29654f] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:34.641+08:00 [02804 error 'Default' opID=HB-host-9@650536-24f55e4d] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:36.275+08:00 [05204 error 'Default'] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:36.303+08:00 [05948 error 'Default' opID=SWI-5a554acd] [Vdb::GetConnection] Failed to obtain connection: HY000:28001
2014-12-18T17:44:36.320+08:00 [02964 error 'Default' opI
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值