Oracle Trace File Analyzer 介绍及简单使用

一、什么是Oracle Trace File Analyzer
Oracle Autonomous Health Framework(AHF) 包含 Oracle ORAchk, Oracle EXAchk, and Oracle Trace File Analyzer(TFA). AHF工具包包含了Oracle常用的多种诊断工具，如 ORAchk, Oracle EXAchk, and Oracle Trace File Analyzer(TFA)等，用于Oracle健康检查等用途。

AHF的下载地址:
Autonomous Health Framework (AHF) - Including TFA and ORAchk/EXAchk (Doc ID 2550798.1)

其中Oracle跟踪文件分析器（Oracle Trace File Analyzer）以下简称tfa，是Oracle提供的一个重要的数据库诊断工具。tfa可以收集诊断数据和诊断信息，监视日志中是否存在可能影响您服务的重大问题。tfa可以标识日志文件中的相关信息，将日志文件修整为仅解决问题所需的部分，还可以跨集群节点收集数据，并将所有内容整合到一个位置。

为获得AHF工具的完整功能，建议以root用户安装；如果非root用户安装，其功能会减少。如果已安装 AHF，则重新安装会在现有位置进行升级。

二、在Linux以守护程序模式在root用户下安装
要获得Oracle Trace File Analyzer的全部功能，需要在root用户下安装tfa。tfa维护访问控制列表（ACL），以确定允许哪些用户访问。默认情况下，GRID_HOME所有者和ORACLE_HOME所有者可以访问各自的诊断信息。如果已经安装了Oracle tfa，则重新安装将升级到现有位置；如果尚未安装Oracle tfa，则推荐位置为/opt/oracle.tfa。

在root用户下执行：
2.1. 下载最新版AHF
2.1.1 使用SSO登陆Oracle Support网站
https://support.oracle.com
2.1.2检索文档ID 2550798.1，下载最新版AHF。
Autonomous Health Framework (AHF)-Including TFA and ORAchk/EXAchk (Document 2550798.1)

安装AHF
2.2 将压缩包上传到RAC数据库服务器其中的一台数据库服务器并解压。
Unzip AHF-LINUX_22.2.4.zip

2.2 在解压后的目录中执行AHF的安装命令。

[root@dkf19c01 soft]# unzip AHF-LINUX_v22.3.2.zip 
Archive:  AHF-LINUX_v22.3.2.zip
  inflating: README.txt              
  inflating: ahf_setup               
 extracting: ahf_setup.dat           
  inflating: oracle-tfa.pub    

具体的安装命令如下：

# ./ahf_setup -ahf_loc /opt -data_dir <ORACLE_BASE of Grid owner>
# ./ahf_setup -ahf_loc /opt -data_dir /u01/app/grid

安装过程如下：

[root@dkf19c01 soft]# ./ahf_setup -ahf_loc /opt -data_dir /u01/app/grid

AHF Installer for Platform Linux Architecture x86_64

AHF Installation Log : /tmp/ahf_install_223200_9921_2023_02_11-22_19_09.log

Starting Autonomous Health Framework (AHF) Installation

AHF Version: 22.3.2 Build Date: 202212190711

TFA is already installed at : /u01/app/19.3.0/grid/tfa/dkf19c01/tfa_home

Installed TFA Version : 183300 Build ID : 20190315044534

AHF Location : /opt/oracle.ahf

AHF Data Directory : /u01/app/grid/oracle.ahf/data

Shutting down TFA : /u01/app/19.3.0/grid/tfa/dkf19c01/tfa_home

Copying TFA Data Files from /u01/app/19.3.0/grid/tfa/dkf19c01/tfa_home

Uninstalling TFA : /u01/app/19.3.0/grid/tfa/dkf19c01/tfa_home

Do you want to add AHF Notification Email IDs ? [Y]|N : N

AHF will also be installed/upgraded on these Cluster Nodes :

1. dkf19c02

The AHF Location and AHF Data Directory must exist on the above nodes
AHF Location : /opt/oracle.ahf
AHF Data Directory : /u01/app/grid/oracle.ahf/data

Do you want to install/upgrade AHF on Cluster Nodes ? [Y]|N : Y

Extracting AHF to /opt/oracle.ahf

Configuring TFA Services

Copying TFA Data Files to AHF

Discovering Nodes and Oracle Resources

Starting TFA Services
Created symlink from /etc/systemd/system/multi-user.target.wants/oracle-tfa.service to /etc/systemd/system/oracle-tfa.service.
Created symlink from /etc/systemd/system/graphical.target.wants/oracle-tfa.service to /etc/systemd/system/oracle-tfa.service.

.-----------------------------------------------------------------------------.
| Host     | Status of TFA | PID   | Port | Version    | Build ID             |
+----------+---------------+-------+------+------------+----------------------+
| dkf19c01 | RUNNING       | 16604 | 5000 | 22.3.2.0.0 | 22320020221219071158 |
| dkf19c02 | RUNNING       |  1532 | 5000 | 18.3.3.0.0 | 18330020190315044534 |
'----------+---------------+-------+------+------------+----------------------'

Running TFA Inventory...

Adding default users to TFA Access list...

.---------------------------------------------------------------.
|                  Summary of AHF Configuration                 |
+-----------------+---------------------------------------------+
| Parameter       | Value                                       |
+-----------------+---------------------------------------------+
| AHF Location    | /opt/oracle.ahf                             |
| TFA Location    | /opt/oracle.ahf/tfa                         |
| Orachk Location | /opt/oracle.ahf/orachk                      |
| Data Directory  | /u01/app/grid/oracle.ahf/data               |
| Repository      | /u01/app/grid/oracle.ahf/data/repository    |
| Diag Directory  | /u01/app/grid/oracle.ahf/data/dkf19c01/diag |
'-----------------+---------------------------------------------'

Starting Orachk Scheduler from AHF

Setting up AHF CLI and SDK

AHF install completed on dkf19c01

Installing AHF on Remote Nodes :

AHF will be installed on dkf19c02, Please wait.

AHF will prompt twice to install/upgrade per Remote Node. So total 2 prompts

Do you want to continue Y|[N] : Y

AHF will continue with Installing on remote nodes

Installing AHF on dkf19c02 :

[dkf19c02] Copying AHF Installer
root@dkf19c02's password: 

[dkf19c02] Running AHF Installer
root@dkf19c02's password: 

AHF binaries are available in /opt/oracle.ahf/bin

AHF is successfully installed

Do you want AHF to store your My Oracle Support Credentials for Automatic Upload ? Y|[N] : 

Moving /tmp/ahf_install_223200_9921_2023_02_11-22_19_09.log to /u01/app/grid/oracle.ahf/data/dkf19c01/diag/ahf/

[root@dkf19c01 soft]# 

2.3 查询版本确认安装成功：

[root@dkf19c01 soft]# tfactl version -all
TFA Version : 223200
TFA Build ID : 20221219071158
TFA Build Label : TFA_AHF22.3_GENERIC_221219.0508
[root@dkf19c01 soft]# 

2.4 查询下tfactl 各个工具的信息如下：

[root@dkf19c02 bin]# tfactl toolstatus

Running command tfactltoolstatus on dkf19c01 ...

.------------------------------------------------------------------.
|                  TOOLS STATUS - HOST : dkf19c01                  |
+----------------------+--------------+--------------+-------------+
| Tool Type            | Tool         | Version      | Status      |
+----------------------+--------------+--------------+-------------+
| AHF Utilities        | alertsummary |       22.3.2 | DEPLOYED    |
|                      | calog        |       22.3.2 | DEPLOYED    |
|                      | dbglevel     |       22.3.2 | DEPLOYED    |
|                      | grep         |       22.3.2 | DEPLOYED    |
|                      | history      |       22.3.2 | DEPLOYED    |
|                      | ls           |       22.3.2 | DEPLOYED    |
|                      | managelogs   |       22.3.2 | DEPLOYED    |
|                      | menu         |       22.3.2 | DEPLOYED    |
|                      | orachk       |       22.3.2 | DEPLOYED    |
|                      | param        |       22.3.2 | DEPLOYED    |
|                      | ps           |       22.3.2 | DEPLOYED    |
|                      | pstack       |       22.3.2 | DEPLOYED    |
|                      | summary      |       22.3.2 | DEPLOYED    |
|                      | tail         |       22.3.2 | DEPLOYED    |
|                      | triage       |       22.3.2 | DEPLOYED    |
|                      | vi           |       22.3.2 | DEPLOYED    |
+----------------------+--------------+--------------+-------------+
| Development Tools    | oratop       |       14.1.2 | DEPLOYED    |
+----------------------+--------------+--------------+-------------+
| Support Tools Bundle | darda        | 2.10.0.R6036 | DEPLOYED    |
|                      | oswbb        | 22.1.0AHF    | RUNNING     |
|                      | prw          | 12.1.13.11.4 | NOT RUNNING |
'----------------------+--------------+--------------+-------------'

Note :-
  DEPLOYED    : Installed and Available - To be configured or run interactively.
  NOT RUNNING : Configured and Available - Currently turned off interactively.
  RUNNING     : Configured and Available.


.------------------------------------------------------------------.
|                  TOOLS STATUS - HOST : dkf19c02                  |
+----------------------+--------------+--------------+-------------+
| Tool Type            | Tool         | Version      | Status      |
+----------------------+--------------+--------------+-------------+
| AHF Utilities        | alertsummary |       22.3.2 | DEPLOYED    |
|                      | calog        |       22.3.2 | DEPLOYED    |
|                      | dbglevel     |       22.3.2 | DEPLOYED    |
|                      | grep         |       22.3.2 | DEPLOYED    |
|                      | history      |       22.3.2 | DEPLOYED    |
|                      | ls           |       22.3.2 | DEPLOYED    |
|                      | managelogs   |       22.3.2 | DEPLOYED    |
|                      | menu         |       22.3.2 | DEPLOYED    |
|                      | orachk       |       22.3.2 | DEPLOYED    |
|                      | param        |       22.3.2 | DEPLOYED    |
|                      | ps           |       22.3.2 | DEPLOYED    |
|                      | pstack       |       22.3.2 | DEPLOYED    |
|                      | summary      |       22.3.2 | DEPLOYED    |
|                      | tail         |       22.3.2 | DEPLOYED    |
|                      | triage       |       22.3.2 | DEPLOYED    |
|                      | vi           |       22.3.2 | DEPLOYED    |
+----------------------+--------------+--------------+-------------+
| Development Tools    | oratop       |       14.1.2 | DEPLOYED    |
+----------------------+--------------+--------------+-------------+
| Support Tools Bundle | darda        | 2.10.0.R6036 | DEPLOYED    |
|                      | oswbb        | 22.1.0AHF    | RUNNING     |
|                      | prw          | 12.1.13.11.4 | NOT RUNNING |
'----------------------+--------------+--------------+-------------'

Note :-
  DEPLOYED    : Installed and Available - To be configured or run interactively.
  NOT RUNNING : Configured and Available - Currently turned off interactively.
  RUNNING     : Configured and Available.

[root@dkf19c02 bin]# 

三、 执行TFA进行巡检：

Run a Oracle Trace File Analyzer (TFA) Collection
With the installation complete we can use the tfactl command to perform a number of collections, including TFA Service Request Data Collections (SRDC). There are a large number of SRDC collection types, with each gathering different information, as described here.

Here are a few examples.

cd /opt/oracle.ahf/tfa/bin/

# Gather diagnostic information about TFA itself.
./tfactl diagnosetfa -local

# Gather information about errors. You are prompted to select a specific incident.
./tfactl diagcollect -srdc ORA-00600
./tfactl diagcollect -srdc ORA-07445

# Collect data for all components for a specific time period.
./tfactl diagcollect -from "2022-06-16 13:00:00" -to "2022-06-16 13:00:00"

# Collect data for all components for the last 12 hours.
./tfactl diagcollect
Each TFA collection produces a single zip file that can be uploaded to My Oracle Support (MOS), as described below.

使用orachk工具进行RAC集群的健康巡检：

[root@dkf19c02 ~]# orachk
 
Clusterware stack is running from /u01/app/19.3.0/grid. Is this the correct Clusterware Home?[y/n][y] 

Searching for running databases . . . . .
.  .  
List of running databases registered in OCR

1. dkf19c
2. None of above

Select databases from list for checking best practices. For multiple databases, select 1 for All or comma separated number like 1,2 etc [1-2][1]. 
.  .  .  .  .  .  

Either Cluster Verification Utility pack (cvupack) does not exist at /opt/oracle.ahf/common/cvu or it is an old or invalid cvupack

Checking Cluster Verification Utility (CVU) version at CRS Home - /u01/app/19.3.0/grid

This version of Cluster Verification Utility (CVU) was released on 13-Mar-2019 and it is older than 180 days. It is highly recommended that you download the latest version of CVU from MOS patch 30839369 to ensure the highest level of accuracy of the data contained within the report

Do you want to download latest version of Cluster Verification Utility (CVU) from my oracle support? [y/n] [y] n

Running older version of Cluster Verification Utility (CVU) from CRS Home - /u01/app/19.3.0/grid

Starting to run orachk in background on dkf19c01 using socket
.  
.  .  .  .
.  .  

Checking Status of Oracle Software Stack - Clusterware, ASM, RDBMS on dkf19c02
.  .  . . . .  
.  .  . . . .  .  .  .  .  .  .  .  
-------------------------------------------------------------------------------------------------------
                                                 Oracle Stack Status                          
-------------------------------------------------------------------------------------------------------
  Host Name       CRS Installed  RDBMS Installed    CRS UP    ASM UP  RDBMS UP    DB Instance Name
-------------------------------------------------------------------------------------------------------
   dkf19c02                   Yes          Yes          Yes      Yes      Yes             dkf19c2
-------------------------------------------------------------------------------------------------------
. 
.  .  .  .  .  .  
. 
. 
. 
.  
. 

*** Checking Best Practice Recommendations ( Pass / Warning / Fail ) ***
.  
============================================================
               Node name - dkf19c02
============================================================
. . . . . . 

 Collecting - ASM Disk Groups
 Collecting - ASM Disk I/O stats
 Collecting - ASM Diskgroup Attributes
 Collecting - ASM disk partnership imbalance
 Collecting - ASM diskgroup attributes
 Collecting - ASM diskgroup usable free space
 Collecting - ASM initialization parameters
 Collecting - Active sessions load balance for dkf19c database
 Collecting - Archived Destination Status for dkf19c database
 Collecting - Cluster Interconnect Config for dkf19c database
 Collecting - Database Archive Destinations for dkf19c database
 Collecting - Database Files for dkf19c database
 Collecting - Database Instance Settings for dkf19c database
 Collecting - Database Parameters for dkf19c database
 Collecting - Database Properties for dkf19c database
 Collecting - Database Registry for dkf19c database
 Collecting - Database Sequences for dkf19c database
 Collecting - Database Undocumented Parameters for dkf19c database
 Collecting - Database Undocumented Parameters for dkf19c database
 Collecting - Database Workload Services for dkf19c database
 Collecting - Dataguard Status for dkf19c database
 Collecting - Files not opened by ASM
 Collecting - List of active logon and logoff triggers for dkf19c database
 Collecting - Log Sequence Numbers for dkf19c database
 Collecting - Percentage of asm disk  Imbalance
 Collecting - Process for shipping Redo to standby for dkf19c database
 Collecting - Redo Log information for dkf19c database
 Collecting - Standby redo log creation status before switchover for dkf19c database
 Collecting - /proc/cmdline
 Collecting - /proc/modules
 Collecting - CPU Information
 Collecting - CRS active version
 Collecting - CRS oifcfg
 Collecting - CRS software version
 Collecting - CSS Reboot time
 Collecting - Cluster interconnect (clusterware)
 Collecting - Clusterware OCR healthcheck
 Collecting - Clusterware Resource Status
 Collecting - Disk I/O Scheduler on Linux
 Collecting - DiskFree Information
 Collecting - DiskMount Information
 Collecting - Huge pages configuration
 Collecting - Interconnect network card speed
 Collecting - Kernel parameters
 Collecting - Linux module config.
 Collecting - Maximum number of semaphore sets on system
 Collecting - Maximum number of semaphores on system
 Collecting - Maximum number of semaphores per semaphore set
 Collecting - Memory Information
 Collecting - NUMA Configuration
 Collecting - Network Interface Configuration
 Collecting - Network Performance
 Collecting - Network Service Switch
 Collecting - OS Packages
 Collecting - OS version
 Collecting - Operating system release information and kernel version
 Collecting - Oracle executable attributes
 Collecting - Patches for Grid Infrastructure
 Collecting - Patches for RDBMS Home
 Collecting - RDBMS and GRID software owner UID across cluster
 Collecting - RDBMS patch inventory
 Collecting - Shared memory segments
 Collecting - Table of file system defaults
 Collecting - Voting disks (clusterware)
 Collecting - number of semaphore operations per semop system call
 Collecting - CHMAnalyzer to report potential Operating system resources usage
 Collecting - CRS Opatch version
 Collecting - CRS user time zone check
 Collecting - Clusterware patch inventory
 Collecting - Custom rc init scripts (rc.local)
 Collecting - Disk Information
 Collecting - Grid Infastructure user shell limits configuration
 Collecting - Interconnect interface config
 Collecting - Linux system service and RAC process configuration
 Collecting - Network interface stats
 Collecting - Root user limits
 Collecting - Verify ORAchk scheduler configuration
 Collecting - Verify TCP Selective Acknowledgement is enabled
 Collecting - Verify no database server kernel out of memory errors
 Collecting - Verify the vm.min_free_kbytes configuration
 Collecting - root time zone check
 Collecting - slabinfo
 Collecting - umask setting for GI owner

Data collections completed. Checking best practices on dkf19c02.
------------------------------------------------------------

 INFO =>     Important Automatic Storage Management (ASM) Notes and Technical White Papers
 INFO =>     Oracle Data Pump Best practices.
 WARNING =>  Linux swap configuration does not meet recommendation
 WARNING =>  Hidden database initialization parameters should not be set per best practice recommendations for dkf19c
 INFO =>     Most recent ADR incidents for /u01/app/oracle/product/19.3.0/dbhome_1
 INFO =>     Oracle GoldenGate failure prevention best practices
 WARNING =>  One or more open PDBs have failed service verification checks for dkf19c
 WARNING =>  OCR and OCR backup locations are the same path
 FAIL =>     The vm.min_free_kbytes configuration is not set as recommended
 CRITICAL => The RMAN snapshot control file location is not shared on all database nodes in the cluster for dkf19c
 CRITICAL => Temporary location is not configured for auto cleanup
 INFO =>     Important Storage Minimum Requirements for Grid & Database Homes
 WARNING =>  NIC bonding is not configured for interconnect
 WARNING =>  NIC bonding is NOT configured for public network (VIP)
 WARNING =>  RAC interconnect network card speed does not meet recommendation
 FAIL =>     system service rngd is not running
 INFO =>     Jumbo frames (MTU >= 9000) are not configured for interconnect
 WARNING =>  All disk groups should have compatible.rdbms attribute set to recommended values
 WARNING =>  All disk groups should have compatible.advm attribute set to recommended values
 FAIL =>     One or more log archive destination and alternate log archive destination settings are not as recommended for dkf19c
 WARNING =>  Database home does not fix for bug 30937410 /u01/app/oracle/product/19.3.0/dbhome_1
 FAIL =>     Database parameter DB_LOST_WRITE_PROTECT is not set to recommended value on dkf19c2 instance
 FAIL =>     Database parameter DB_BLOCK_CHECKING on primary is not set to the recommended value. for dkf19c
 WARNING =>  Oracle patch 30786641 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 INFO =>     Operational Best Practices
 INFO =>     Database Consolidation Best Practices
 INFO =>     Computer failure prevention best practices
 INFO =>     Data corruption prevention best practices
 INFO =>     Logical corruption prevention best practices
 INFO =>     Database/Cluster/Site failure prevention best practices
 INFO =>     Client failover operational best practices
 WARNING =>  fast_start_mttr_target should be greater than or equal to 300 on dkf19c2 instance
 WARNING =>  Oracle patch 30712670 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 29423227 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 31031240 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 29867728 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 31142749 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 26749785 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 29302565 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 29259068 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 INFO =>     Information about hanganalyze and systemstate dump
 FAIL =>     Database control files are not configured as recommended for dkf19c
 WARNING =>  Oracle patch 28907129 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 INFO =>     Database failure prevention best practices
 FAIL =>     ASM Credentials are NOT set correctly.
 WARNING =>  Perl Patch 33912872 is not found in 19c RDBMS_HOME. /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Perl Patch 33912872 is not found in 19c CRS_HOME. /u01/app/19.3.0/grid
 WARNING =>  Oracle patch 32043701 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 31602782 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 33121934 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 33025005 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 32103628 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 31211220 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 INFO =>     The Optimizer fixes for 19c database version is disabled by default for bugs with status value 0 for dkf19c
 INFO =>     Software maintenance best practices
 INFO =>     Oracle recovery manager(rman) best practices
 WARNING =>  Linux Disk I/O Scheduler should be configured to Deadline
 WARNING =>  There exists one or more underscore parameters without a comment for dkf19c

Waiting for orachk to finish on remote nodes 

. . . . . . . . . . . . . . . . 

Copying results from dkf19c01 and generating report. This might take a while. Be patient.

============================================================
               Node name - dkf19c01
============================================================
. . . . . . 

 Collecting - ASM Disk Groups
 Collecting - ASM Disk I/O stats
 Collecting - ASM Diskgroup Attributes
 Collecting - ASM disk partnership imbalance
 Collecting - ASM diskgroup attributes
 Collecting - ASM diskgroup usable free space
 Collecting - ASM initialization parameters
 Collecting - Active sessions load balance for dkf19c database
 Collecting - Archived Destination Status for dkf19c database
 Collecting - Cluster Interconnect Config for dkf19c database
 Collecting - Database Archive Destinations for dkf19c database
 Collecting - Database Files for dkf19c database
 Collecting - Database Instance Settings for dkf19c database
 Collecting - Database Parameters for dkf19c database
 Collecting - Database Properties for dkf19c database
 Collecting - Database Registry for dkf19c database
 Collecting - Database Sequences for dkf19c database
 Collecting - Database Undocumented Parameters for dkf19c database
 Collecting - Database Undocumented Parameters for dkf19c database
 Collecting - Database Workload Services for dkf19c database
 Collecting - Dataguard Status for dkf19c database
 Collecting - Files not opened by ASM
 Collecting - List of active logon and logoff triggers for dkf19c database
 Collecting - Log Sequence Numbers for dkf19c database
 Collecting - Percentage of asm disk  Imbalance
 Collecting - Process for shipping Redo to standby for dkf19c database
 Collecting - Redo Log information for dkf19c database
 Collecting - Standby redo log creation status before switchover for dkf19c database
 Collecting - /proc/cmdline
 Collecting - /proc/modules
 Collecting - CPU Information
 Collecting - CRS active version
 Collecting - CRS oifcfg
 Collecting - CRS software version
 Collecting - Cluster interconnect (clusterware)
 Collecting - Disk I/O Scheduler on Linux
 Collecting - DiskFree Information
 Collecting - DiskMount Information
 Collecting - Huge pages configuration
 Collecting - Interconnect network card speed
 Collecting - Kernel parameters
 Collecting - Linux module config.
 Collecting - Maximum number of semaphore sets on system
 Collecting - Maximum number of semaphores on system
 Collecting - Maximum number of semaphores per semaphore set
 Collecting - Memory Information
 Collecting - NUMA Configuration
 Collecting - Network Interface Configuration
 Collecting - Network Performance
 Collecting - Network Service Switch
 Collecting - OS Packages
 Collecting - OS version
 Collecting - Operating system release information and kernel version
 Collecting - Oracle executable attributes
 Collecting - Patches for Grid Infrastructure
 Collecting - Patches for RDBMS Home
 Collecting - RDBMS and GRID software owner UID across cluster
 Collecting - RDBMS patch inventory
 Collecting - Shared memory segments
 Collecting - Table of file system defaults
 Collecting - number of semaphore operations per semop system call

Data collections completed. Checking best practices on dkf19c01.
------------------------------------------------------------

 WARNING =>  Linux swap configuration does not meet recommendation
 WARNING =>  Hidden database initialization parameters should not be set per best practice recommendations for dkf19c
 INFO =>     Most recent ADR incidents for /u01/app/oracle/product/19.3.0/dbhome_1
 INFO =>     Oracle GoldenGate failure prevention best practices
 WARNING =>  One or more open PDBs have failed service verification checks for dkf19c
 WARNING =>  OCR and OCR backup locations are the same path
 FAIL =>     The vm.min_free_kbytes configuration is not set as recommended
 WARNING =>  ARCHIVELOG mode is disabled for dkf19c
 CRITICAL => The RMAN snapshot control file location is not shared on all database nodes in the cluster for dkf19c
 INFO =>     At some times checkpoints are not being completed for dkf19c
 WARNING =>  Some user sessions lack proper failover mode (BASIC) and method (SELECT) for dkf19c
 CRITICAL => Temporary location is not configured for auto cleanup
 WARNING =>  Controlfile is not multiplexed for dkf19c
 WARNING =>  One or more redo log groups are not multiplexed for dkf19c
 WARNING =>  Primary database is not protected with Data Guard (standby database) for real-time data protection and availability for dkf19c
 WARNING =>  Flashback on PRIMARY is not configured for dkf19c
 INFO =>     Important Storage Minimum Requirements for Grid & Database Homes
 WARNING =>  NIC bonding is not configured for interconnect
 WARNING =>  NIC bonding is NOT configured for public network (VIP)
 WARNING =>  RAC interconnect network card speed does not meet recommendation
 FAIL =>     system service rngd is not running
 INFO =>     Jumbo frames (MTU >= 9000) are not configured for interconnect
 FAIL =>     One or more log archive destination and alternate log archive destination settings are not as recommended for dkf19c
 FAIL =>     Table AUD$[FGA_LOG$] should use Automatic Segment Space Management for dkf19c
 WARNING =>  Database home does not fix for bug 30937410 /u01/app/oracle/product/19.3.0/dbhome_1
 FAIL =>     Database parameter DB_LOST_WRITE_PROTECT is not set to recommended value on dkf19c1 instance
 FAIL =>     Database parameter DB_BLOCK_CHECKING on primary is not set to the recommended value. for dkf19c
 WARNING =>  Oracle patch 30786641 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  fast_start_mttr_target should be greater than or equal to 300 on dkf19c1 instance
 WARNING =>  Oracle patch 30712670 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 29423227 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 31031240 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 29867728 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 31142749 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 26749785 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 29302565 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 29259068 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 FAIL =>     Database control files are not configured as recommended for dkf19c
 WARNING =>  Oracle patch 28907129 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  One or more read/write errors found for ASM disks for dkf19c
 WARNING =>  Database Archivelog Mode should be set to ARCHIVELOG for dkf19c
 WARNING =>  Perl Patch 33912872 is not found in 19c RDBMS_HOME. /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Perl Patch 33912872 is not found in 19c CRS_HOME. /u01/app/19.3.0/grid
 WARNING =>  Oracle patch 32043701 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 31602782 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 33121934 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 33025005 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 32103628 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 WARNING =>  Oracle patch 31211220 is not applied on RDBMS_HOME /u01/app/oracle/product/19.3.0/dbhome_1
 INFO =>     The Optimizer fixes for 19c database version is disabled by default for bugs with status value 0 for dkf19c
 INFO =>     Database feature usage statistics for dkf19c
 WARNING =>  Linux Disk I/O Scheduler should be configured to Deadline
 WARNING =>  There exists one or more underscore parameters without a comment for dkf19c
 WARNING =>  Consider investigating changes to the schema objects such as DDLs or new object creation for dkf19c
 WARNING =>  Consider investigating the frequency of SGA resize operations and take corrective action for dkf19c

------------------------------------------------------------
                      CLUSTERWIDE CHECKS
------------------------------------------------------------

 INFO =>     Information about the impact of CPU contention on database instance performance is available.
------------------------------------------------------------

UPLOAD [if required] - /u01/app/grid/oracle.ahf/data/dkf19c02/orachk/user_root/output/orachk_dkf19c02_dkf19c_021223_175034.zip

[root@dkf19c02 ~]# 

=======================================================