故障排查：ArcGIS Enterprise on k8s 11.0安装失败（connection failed after 3600 seconds in relational store）

博客主页：https://tomcat.blog.csdn.net
博主昵称：农民工老王
主要领域：Java、Linux、K8S
期待大家的关注💖点赞👍收藏⭐留言💬

故障详情

在安装ArcGIS Enterprise on Kubernetes 11.0的创建组织的阶段遇到如下报错：

The process to create a new organization has failed due to the> following error: <‘Testing managed user connection failed after 3600 seconds.’ in Relational store >.

截图如下：
下载的日志文件中有如下报错：

2023-02-08T10:39:44,141|WARNING|9adc0f9c-6a85-4372-b4e1-559d344017ca||Enterprise Admin|1053|1|52|FrameworkManager|Managed user connection to database is not ready.|| org.postgresql.util.PSQLException: FATAL: password authentication failed for user "mu_n13ht"
	at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:646)
	at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:180)
	at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:235)
	at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
	at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:223)
	at org.postgresql.Driver.makeConnection(Driver.java:402)
	at org.postgresql.Driver.connect(Driver.java:261)
	at org.apache.tomcat.jdbc.pool.PooledConnection.connectUsingDriver(PooledConnection.java:319)
	at org.apache.tomcat.jdbc.pool.PooledConnection.connect(PooledConnection.java:212)
	at org.apache.tomcat.jdbc.pool.ConnectionPool.createConnection(ConnectionPool.java:744)
	at org.apache.tomcat.jdbc.pool.ConnectionPool.borrowConnection(ConnectionPool.java:676)
	at org.apache.tomcat.jdbc.pool.ConnectionPool.init(ConnectionPool.java:483)
	at org.apache.tomcat.jdbc.pool.ConnectionPool.<init>(ConnectionPool.java:154)
	at org.apache.tomcat.jdbc.pool.DataSourceProxy.pCreatePool(DataSourceProxy.java:118)
	at org.apache.tomcat.jdbc.pool.DataSourceProxy.createPool(DataSourceProxy.java:107)
	at org.apache.tomcat.jdbc.pool.DataSourceProxy.getConnection(DataSourceProxy.java:131)
	at com.esri.arcgis.endeavour.admin.managers.FrameworkManager.lambda$createRelationalDataStore$4(FrameworkManager.java:962)
	at com.esri.arcgis.endeavour.admin.util.CallableUtil.retryForFixedTime(CallableUtil.java:215)
	at com.esri.arcgis.endeavour.admin.managers.FrameworkManager.createRelationalDataStore(FrameworkManager.java:956)
	at com.esri.arcgis.endeavour.admin.site.SiteManager$ab.install(SiteManager$ab.java:2604)
	at com.esri.arcgis.endeavour.admin.site.SiteManager$ParallelCreateSiteModules$a.call(SiteManager$ParallelCreateSiteModules$a.java:4225)
	at com.esri.arcgis.endeavour.admin.site.SiteManager$ParallelCreateSiteModules$a.call(SiteManager$ParallelCreateSiteModules$a.java:4220)
	at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.base/java.lang.Thread.run(Unknown Source)

2023-02-08T10:39:45,141|SEVERE|9adc0f9c-6a85-4372-b4e1-559d344017ca||Enterprise Admin|1261|1|1|SiteManager|Relational Datastore Installation Failed.|| java.lang.Exception: Testing managed user connection failed after 3600 seconds.
	at com.esri.arcgis.endeavour.admin.managers.FrameworkManager.createRelationalDataStore(FrameworkManager.java:977)
	at com.esri.arcgis.endeavour.admin.site.SiteManager$ab.install(SiteManager$ab.java:2604)
	at com.esri.arcgis.endeavour.admin.site.SiteManager$ParallelCreateSiteModules$a.call(SiteManager$ParallelCreateSiteModules$a.java:4225)
	at com.esri.arcgis.endeavour.admin.site.SiteManager$ParallelCreateSiteModules$a.call(SiteManager$ParallelCreateSiteModules$a.java:4220)
	at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.base/java.lang.Thread.run(Unknown Source)

问题原因

最开始，我以为就如日志中的提示，是数据库相关的秘钥出现问题，但排查很久，都没有任何收获。
后来才发现是k8s集群配置的nfs服务器的存储空间耗尽，仅有20KB，造成本次部署失败。

解决方案

找到问题原因，就很容易解决了。我先卸载了这次失败的部署。然后按照 如何清理废弃pv和其对应的文件夹（此处有超链接，可以直接点击跳转） 这篇文章的方法，清理了nfs服务器，腾空了200G的空间，然后重新部署即可。

最终成功部署ArcGIS Enterprise on Kubernetes 11.0 。

---

如需转载，请注明本文的出处：农民工老王的CSDN博客https://blog.csdn.net/monarch91 。