raccheck

[oracle@rac1 tools]$ ./raccheck -h
Usage : ./raccheck [-abvhpfmsuSo:c:t:] 


        -h      Prints this page.
        -a      All (Perform best practice check and recommended patch check)
        -b      Best Practice check only. No recommended patch check
        -v      Show version 
        -p      Patch check only
        -m      exclude checks for Maximum Availability Architecture (MAA) scorecards(see user guide for more details)
        -u      Run raccheck to check pre-upgrade or post-upgrade best practices for 11.2.0.3 and above
                -o pre or -o post is mandatory with -u option like ./raccheck -u -o pre
        -f      Run Offline.Checks will be performed on data already collected from the system
        -o      Argument to an option. if -o is followed by v,V,Verbose,VERBOSE or Verbose, it will print checks which passs on the screen
                if -o option is not specified,it will print only failures on screen. for eg: raccheck -a -o v 


        -clusternodes
                Pass comma separated node names to run raccheck only on subset of nodes.
        -dbnames
                Pass comma separated database names to run raccheck only on subset of databases
        -localonly
                Run raccheck only on local node.
        -debug
                Run raccheck in debug mode. Debug log will be generated. 
                eg:- ./raccheck -debug
        -dbnone
                Do not prompt database selection and skip all database related checks.   
        -dball
                Do not prompt database selection and run database related checks on all databases discovered on system.


        -c      Used only under the guidance of Oracle support or development to override default components 


        -upgrade 
                Used to force upgrade the version of raccheck being run.
        -noupgrade
                Do not prompt for an upgrade even if a later version is available under the location specified by RAT_UPGRADE_LOC.




        Report Options:
        -nopass
                Skip PASS'ed check to print in raccheck report and upload to database.


        -noscore
                Do not print healthscore in HTML report.


        -diff <Old Report> <New Report> [-outfile <Output HTML>]
                Diff two raccheck reports. Pass directory name or zip file or html report file as <Old Report> & <New Report> 
 
        -exadiff <Exalogic collection1> <Exalogic collection2>
                Compare two different Exalogic rack and see if both are from the same release.Pass directory name or zip file as <Exalogic collection
1> & <Exalogic collection2>(applicable for Exalogic only)


        -merge
                Pass comma separated collection names(directory or zip files) to merge collections and prepare single report.
                eg:- ./raccheck -merge raccheck_hostname1_db1_120213_163405.zip,raccheck_hostname2_db2_120213_164826.zip


        -tag <tagname>
                Appends <tagname> to Report Name. <Tagname> must contain only alphanumeric characters.
                for eg: ./raccheck -tag newtag123 will append 'newtag123' to report name like 'raccheck_hostname1_db1_100914_123456_newtag123.html'




        Auto Restart Options:
                -auto_restart -h: Prints help for this option
                -<initsetup|initrmsetup|initcheck|initpresetup>
                initsetup       : Setup auto restart. Auto restart functionality automatically brings up raccheck daemon when node starts
                initrmsetup     : Remove auto restart functionality
                initcheck       : Check if auto restart functionality is setup or not
                initpresetup    : Sets root user equivalency for COMPUTE, STORAGE and IBSWITCHES.(root equivalency for COMPUTE nodes is mandatory for
 setting up auto restart functionality)






        Daemon Options:


        
        -d <start|start_debug|stop|status|info|stop_client|nextautorun|-h>
                start                   : Start the raccheck daemon
                start_debug             : Start the raccheck daemon in debug mode
                stop                    : Stop the raccheck daemon
                status                  : Check if the raccheck daemon is running
                info                    : Print information about running raccheck daemon
                stop_client             : Stop the raccheck daemon client


                nextautorun [-id <ID>]  : print the next auto run time
                                          if '-id <ID>' is specified, it will print the next auto run time for specified autorun schedule ID


                -h                      : Prints help for this option






        -daemon
                run raccheck only if daemon is running
        -nodaemon
                Dont use daemon to run raccheck 
        [-id <ID>] -set
                configure raccheck daemon parameter like 'param1=value1;param2=value2... '
                if '-id <ID>' is specified, it will configure raccheck daemon parameter(s) for specified autorun schedule ID
               
                 Supported parameters are:-
 
                 (Deprecated) - AUTORUN_INTERVAL <n[d|h]> :- Automatic rerun interval in daemon mode.Set it zero to disable automatic rerun which is 
zero.
 
                 AUTORUN_SCHEDULE * * * *       :- Automatic run at specific time in daemon mode.
                                  - - - -
                                  ? ? ? ?
                                  ? ? ? +----- day of week (0 - 6) (0 to 6 are Sunday to Saturday)
                                  ? ? +---------- month (1 - 12)
                                  ? +--------------- day of month (1 - 31)
                                  +-------------------- hour (0 - 23)
 
                     example: raccheck -set 'AUTORUN_SCHEDULE=8,20 * * 2,5' will schedule runs on tuesday and friday at 8 and 20 hour.
                  
                 AUTORUN_FLAGS <flags> : raccheck flags to use for auto runs.
         
                     example: raccheck -set 'AUTORUN_INTERVAL=12h;AUTORUN_FLAGS=-profile sysadmin' to run sysadmin profile every 12 hours
 
                              raccheck -set 'AUTORUN_INTERVAL=2d;AUTORUN_FLAGS=-profile dba' to run dba profile once every 2 days.
 
                 NOTIFICATION_EMAIL : Comma separated list of email addresses used for notifications by daemon if mail server is configured.


                 PASSWORD_CHECK_INTERVAL <number of hours> : Interval to verify passwords in daemon mode


                 COLLECTION_RETENTION <number of days> : Purge raccheck collection directories and zip files older than specified days. 


        [-id <ID>] -unset <parameter | all>
                unset the parameter
                if '-id <ID>' is specified, it will unset the parameter for specified autorun schedule ID
                  example: raccheck -unset AUTORUN_SCHEDULE


        [-id <ID>] -get <parameter | all>
                Print the value of parameter. 
                if '-id <ID>' is specified,  it will print the value of parameter for specified autorun schedule ID






        -vmguest
                Pass comma separated filenames containing exalogic guest VM list(applicable for Exalogic only)


        -hybrid [-phy]
                phy     :Pass comma separated physical compute nodes(applicable for Exalogic only)
                         eg:- ./raccheck -hybrid -phy phy_node1,phy_node2


 
        Profile Run Options:
        -profile
                Pass specific profile. 
                With -h prints help.
                List of supported profiles:


                 asm             asm Checks          
                 clusterware     Oracle clusterware checks
                 compute_node    Compute Node checks (Exalogic only)
                 control_VM      Checks only for Control VM(ec1-vm, ovmm, db, pc1, pc2). No cross node checks
                 dba             dba Checks          
                 ebs             Oracle E-Business Suite checks
                 em              EM related checks   
                 goldengate      Oracle GoldenGate checks
                 maa             Maximum Availability Architecture Checks
                 preinstall      Pre-installation checks
                 sysadmin        sysadmin checks     


        -excludeprofile
                Pass specific profile.
                List of supported profiles is same as for -profile.


        
        -cells
                Pass comma separated storage server names to run raccheck only on selected storage servers.


        -ibswitches
                Pass comma separated infiniband switch names to run raccheck only on selected infiniband switches.


        -zfsnodes
                Pass comma separated ZFS storage appliance names to run raccheck only on selected storage appliances.


        -dbserial
                Run SQL, SQL_COLLECT and OS Checks in serial


        -dbparallel [n]
                Run SQL, SQL_COLLECT and OS Checks in parallel.
                n       : Specified number of Child processes. Default is 25% of CPUs.

[oracle@rac1 tools]

[oracle@rac1 tools]$ ./raccheck -a -o v


CRS stack is running and CRS_HOME is not set. Do you want to set CRS_HOME to /u01/11.2.0/grid?[y/n][y]y


Checking ssh user equivalency settings on all nodes in cluster


Node rac2 is configured for ssh user equivalency for oracle user
 


Searching for running databases . . . . .


. . 
List of running databases registered in OCR
1. orcl
2. None of above


Select databases from list for checking best practices. For multiple databases, select 1 for All or comma separated number like 1,2 etc [1-2][1].
. . 




Checking Status of Oracle Software Stack - Clusterware, ASM, RDBMS


. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 
-------------------------------------------------------------------------------------------------------
                                                 Oracle Stack Status                            
-------------------------------------------------------------------------------------------------------
Host Name  CRS Installed  RDBMS Installed  CRS UP    ASM UP    RDBMS UP  DB Instance Name
-------------------------------------------------------------------------------------------------------
rac1        Yes             Yes             Yes        Yes      Yes      orcl1     
rac2        Yes             Yes             Yes        Yes      No                 
-------------------------------------------------------------------------------------------------------




Copying plug-ins


. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 


. . . . . . 




133 of the included audit checks require root privileged data collection . If sudo is not configured or the root password is not available, audit checks which  require root privileged data collection can be skipped.




1. Enter 1 if you will enter root password for each  host when prompted


2. Enter 2 if you have sudo configured for oracle user to execute root_raccheck.sh script 


3. Enter 3 to skip the root privileged collections 


4. Enter 4 to exit and work with the SA to configure sudo  or to arrange for root access and run the tool later.


Please indicate your selection from one of the above options for root access[1-4][1]:- 




Is root password same on all nodes?[y/n][y]y




Enter root password :- 


Verifying root password.


. . 




*** Checking Best Practice Recommendations (PASS/WARNING/FAIL) ***






Collections and audit checks log file is 
/home/oracle/tools/raccheck_rac1_orcl_121814_210633/log/raccheck.log






Checking for prompts in /home/oracle/.bash_profile on rac1 for oracle user...








Checking for prompts in /home/oracle/.bash_profile on rac2 for oracle user...






Starting to run raccheck in background on rac2


=============================================================
                    Node name - rac1                                
=============================================================


Collecting - ASM Disk Groups 
Collecting - ASM Disk I/O stats 
Collecting - ASM Diskgroup Attributes 
Collecting - ASM disk partnership imbalance 
Collecting - ASM diskgroup attributes 
Collecting - ASM diskgroup usable free space 
Collecting - ASM initialization parameters 
Collecting - Active sessions load balance for orcl database
Collecting - Archived Destination Status for orcl database
Collecting - Cluster Interconnect Config for orcl database
Collecting - Database Archive Destinations for orcl database
Collecting - Database Files for orcl database
Collecting - Database Instance Settings for orcl database
Collecting - Database Parameters for orcl database
Collecting - Database Parameters for orcl database
Collecting - Database Properties for orcl database
Collecting - Database Registry for orcl database
Collecting - Database Sequences for orcl database
Collecting - Database Undocumented Parameters for orcl database
Collecting - Database Undocumented Parameters for orcl database
Collecting - Database Workload Services for orcl database
Collecting - Dataguard Status for orcl database
Collecting - Files not opened by ASM 
Collecting - Log Sequence Numbers for orcl database
Collecting - Percentage of asm disk  Imbalance 
Collecting - Process for shipping Redo to standby for orcl database
Collecting - RDBMS Feature Usage for orcl database
Collecting - Redo Log information for orcl database
Collecting - Standby redo log creation status before switchover for orcl database
Collecting - /proc/cmdline
Collecting - /proc/modules
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - CSS Reboot time
Collecting - CSS disktimout
Collecting - Cluster interconnect (clusterware)
Collecting - Clusterware OCR healthcheck 
Collecting - Clusterware Resource Status
Collecting - DiskFree Information
Collecting - DiskMount Information
Collecting - Huge pages configuration
Collecting - Interconnect network card speed
Collecting - Kernel parameters
Collecting - Linux module config.
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - NUMA Configuration
Collecting - Network Interface Configuration
Collecting - Network Performance
Collecting - Network Service Switch
Collecting - OS Packages
Collecting - OS version
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure 
Collecting - Patches for RDBMS Home 
Collecting - Shared memory segments
Collecting - Table of file system defaults
Collecting - Verify ioctl to advm [ACFS]
Collecting - Voting disks (clusterware)
Collecting - number of semaphore operations per semop system call
Preparing to run root privileged commands  rac1.
Collecting - ACFS Volumes status 
Collecting - ACFS and ASM driver version comparison [ACFS] 
Collecting - Broadcast Requirements for Networks 
Collecting - CRS user time zone check 
Collecting - Custom rc init scripts (rc.local) 
Collecting - Disk Information 
Collecting - Generic ACFS health [ACFS] 
Collecting - Grid Infastructure user shell limits configuration 
Collecting - Health of the mounted ACFS file systems [ACFS] 
Collecting - Health of unmounted ACFS file systems [ACFS] 
Collecting - Interconnect interface config 
Collecting - Network interface stats 
Collecting - Number of RDBMS LMS running in real time 
Collecting - OCFS2 disks 
/home/oracle/root_raccheck.sh: line 79: /sbin/mounted.ocfs2: No such file or directory
Collecting - OLR Integrity 
Collecting - Root user limits 
Collecting - Verify no database server kernel out of memory errors  
Collecting - Volume list for unmount ACFS file system [ACFS] 
Collecting - ocsf status 
/home/oracle/root_raccheck.sh: line 104: /etc/init.d/o2cb: No such file or directory
Collecting - root time zone check 
Collecting - slabinfo 




Data collections completed. Checking best practices on rac1.
--------------------------------------------------------------------------------------




 WARNING => Cluster Health Monitor (CHM) repository does not provide recommended level of retention
 FAIL =>    Database DB_CREATE_FILE_DEST and DB_RECOVERY_FILE_DEST are NOT in different diskgroups for orcl
 INFO =>    Important Automatic Storage Management (ASM) Notes and Technical White Papers
 PASS =>    AWR_FLUSH_EMERGENCY_COUNT value is equal to ZERO for orcl
 WARNING => Package gdb-7.0.1-42.el5-x86_64 does not meet recommendation for gdb-7.0.1-45.el5-x86_64 
 INFO =>    Follow Data Pump Best practices.
 FAIL =>    Bash is vulnerable to code injection (CVE-2014-6271)
 PASS =>    SYS.IDGEN1$ sequence cache size >= 1,000 for orcl
 PASS =>    SYS.AUDSES$ sequence cache size >= 10,000 for orcl
 PASS =>    ORA_CRS_HOME environment variable is not set
 PASS =>    ARCHIVELOG mode is enabled for orcl
 PASS =>    net.core.wmem_default Is Configured Properly
 PASS =>    net.core.wmem_max Is Configured Properly
 PASS =>    net.core.rmem_default Is Configured Properly
 PASS =>    None of the hostnames contains an underscore character
 PASS =>    Interconnect is configured on non-routable network addresses
 PASS =>    net.core.rmem_max is Configured Properly
 PASS =>    OCR is being backed up daily
 INFO =>    $CRS_HOME/log/hostname/client directory has too many older log files.
 PASS =>    The number of async IO descriptors is sufficient (/proc/sys/fs/aio-max-nr)
 PASS =>    The SYS and SYSTEM userids have a default tablespace of SYSTEM for orcl
 PASS =>    Kernel Parameter kernel.shmall OK
 PASS =>    Kernel Parameter SEMOPM OK
 PASS =>    Kernel Parameter SEMMNI OK
 PASS =>    Kernel Parameter SEMMSL OK
 PASS =>    Kernel Parameter kernel.shmmni OK
 PASS =>    Kernel Parameter SEMMNS OK
 INFO =>    core_dump_dest does not have too many older core dump files for orcl
 INFO =>    user_dump_dest does not have trace files older than 30 days for orcl
 INFO =>    No ORA-00600 errors found in alert log for orcl
 INFO =>    No ORA-07445 errors found in alert log for orcl
 INFO =>    Alert log is not too big for orcl
 INFO =>    background_dump_dest does not have any files older than 30 days for orcl
 INFO =>    Tablespace allocation type is SYSTEM for all appropriate tablespaces for orcl
 INFO =>    Avg GC CR Block Receive Time Within Acceptable Range for orcl
 INFO =>    Avg GC CURRENT Block Receive Time Within Acceptable Range for orcl
 INFO =>    Instance is using Automatic Undo Management on orcl1 instance
 INFO =>    At some times checkpoints are not being completed for orcl
 PASS =>    Package glibc-common-2.5-x86_64 meets or exceeds recommendation
 PASS =>    Package elfutils-libelf-devel-0.125-x86_64 meets or exceeds recommendation
 PASS =>    Package elfutils-libelf-0.125-x86_64 meets or exceeds recommendation
 PASS =>    Package libaio-devel-0.3.106-x86_64 meets or exceeds recommendation
 PASS =>    Failover method (SELECT) and failover mode (BASIC) are configured properly for orcl
 PASS =>    No Global Cache lost blocks detected for orcl
 INFO =>    Avg message received queue time is <= recommended for orcl
 INFO =>    Avg message sent queue time is <= recommended for orcl
 INFO =>    Avg message sent queue time on ksxp is <= recommended for orcl
 PASS =>    Package libgcc-4.1.2-42.el5-x86_64 meets or exceeds recommendation
 PASS =>    Package libaio-devel-0.3.106-3.2-i386 meets or exceeds recommendation
 PASS =>    Package make-3.81-x86_64 meets or exceeds recommendation
 PASS =>    Package binutils-2.17.50.0.6-x86_64 meets or exceeds recommendation
 PASS =>    Package gcc-c++-4.1.2-42.el5-x86_64 meets or exceeds recommendation
 PASS =>    Package libstdc++-devel-4.1.2-42.el5-x86_64 meets or exceeds recommendation
 PASS =>    Package libaio-devel-0.3.106-3.2-x86_64 meets or exceeds recommendation
 WARNING => Package unixODBC-devel-2.2.11-x86_64 is recommended but NOT installed
 PASS =>    Package glibc-2.5-24-i386 meets or exceeds recommendation
 PASS =>    Package libstdc++-4.1.2-42.el5-i386 meets or exceeds recommendation
 PASS =>    Package libstdc++-devel-4.1.2-42.el5-i386 meets or exceeds recommendation
 PASS =>    Package libgcc-4.1.2-42.el5-i386 meets or exceeds recommendation
 PASS =>    Package libaio-0.3.106-3.2-x86_64 meets or exceeds recommendation
 PASS =>    Package libaio-0.3.106-3.2-i386 meets or exceeds recommendation
 PASS =>    Package sysstat-7.0.2-x86_64 meets or exceeds recommendation
 PASS =>    Package compat-libstdc++-33-3.2.3-61-x86_64 meets or exceeds recommendation
 PASS =>    Package glibc-devel-2.5-24-x86_64 meets or exceeds recommendation
 PASS =>    Package libstdc++-4.1.2-42.el5-x86_64 meets or exceeds recommendation
 PASS =>    Package compat-libstdc++-33-3.2.3-61-i386 meets or exceeds recommendation
 PASS =>    Package glibc-devel-2.5-24-i386 meets or exceeds recommendation
 PASS =>    $ORACLE_HOME/bin/oradism setuid bit is set for /u01/app/oracle/product/11.2.0/db_1
 PASS =>    $ORACLE_HOME/bin/oradism ownership is root for /u01/app/oracle/product/11.2.0/db_1
 INFO =>    audit_file_dest does not have any audit files older than 30 days for orcl
 PASS =>    remote_login_passwordfile is configured according to recommendation on orcl1 instance
 PASS =>    Controlfile is multiplexed for orcl
 PASS =>    Redo logs are multiplexed for orcl
 INFO =>    All data and temporary are autoextensible for orcl
 INFO =>    oracleasm (asmlib) module is NOT loaded
 PASS =>    /tmp is on a dedicated filesystem
 PASS =>    ACFS driver is online [ACFS]
 PASS =>    Linux Swap Configuration meets or exceeds Recommendation
 WARNING => Shell limit soft nproc for DB is NOT configured according to recommendation
 PASS =>    Shell limit hard nofile for DB is configured according to recommendation
 PASS =>    Shell limit soft nproc for GI is configured according to recommendation
 PASS =>    Shell limit soft nofile for GI is configured according to recommendation
 PASS =>    Shell limit hard nproc for DB is configured according to recommendation
 PASS =>    Shell limit hard nofile for GI is configured according to recommendation
 PASS =>    Shell limit hard nproc for GI is configured according to recommendation
 PASS =>    Free space in /tmp directory meets or exceeds recommendation of minimum 1GB
 PASS =>    ACFS registry is online [ACFS]
 PASS =>    Shell limit hard stack for DB is configured according to recommendation
 INFO =>    Kernel Parameter fs.file-max is configuration meets or exceeds recommendation
 PASS =>    kernel.shmmax parameter is configured according to recommendation
 PASS =>    ip_local_port_range is configured according to recommendation
 INFO =>    Public interface is configured and exists in OCR
 PASS =>    SELinux is not being Enforced.
 INFO =>    All redo log files are of same size for orcl
 INFO =>    CSS misscount is set to the default value of 30
 PASS =>    All voting disks are online
 INFO =>    Number of SCAN listeners is NOT equal to the recommended number of 3.
 PASS =>    CRS version is higher or equal to ASM version.
 WARNING => Database Parameter memory_target is not set to the recommended value on orcl1 instance
 FAIL =>    Operating system hugepages count does not satisfy total SGA requirements
 WARNING => NIC bonding is NOT configured for public network (VIP)
 PASS =>    crsd Log Ownership is Correct (root root)
 PASS =>    crsd/orarootagent_root Log Ownership is Correct (root root)
 PASS =>    ohasd/orarootagent_root Log Ownership is Correct (root root)
 PASS =>    ohasd Log Ownership is Correct (root root)
 INFO =>    CSS disktimeout is set to the default value of 200
 PASS =>    CSS reboottime is set to the default value of 3
 WARNING => OSWatcher is not running as is recommended.
 INFO =>    Jumbo frames (MTU >= 8192) are not configured for interconnect
 WARNING => NTP is not running with correct setting
 PASS =>    asm_power_limit is set to recommended value of 1
 FAIL =>    Database parameter DB_BLOCK_CHECKSUM is NOT set to recommended value on orcl1 instance
 PASS =>    Shell limit hard stack for GI is configured according to recommendation
 PASS =>    ASM Audit file destination file count <= 100,000
 FAIL =>    Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on orcl1 instance
 PASS =>    OCR physical integrity check succeeded
 INFO =>    umask for RDBMS owner is set to 0022
 WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for orcl
 FAIL =>    Flashback on PRIMARY is not configured for orcl
 INFO =>    Operational Best Practices
 PASS =>    Clusterware is running
 INFO =>    Database Consolidation Best Practices
 INFO =>    Computer failure prevention best practices
 INFO =>    Data corruption prevention best practices
 INFO =>    Logical corruption prevention best practices
 INFO =>    Database/Cluster/Site failure prevention best practices
 INFO =>    Client failover operational best practices
 PASS =>    All bigfile tablespaces have non-default maxbytes values set for orcl
 PASS =>    Database parameter UNDO_RETENTION on PRIMARY is not null on orcl1 instance
 WARNING => fast_start_mttr_target should be greater than or equal to 300. on orcl1 instance
 PASS =>    Database parameter CURSOR_SHARING is set to recommended value on orcl1 instance


 INFO =>    IMPORTANT: Oracle Database Patch 13466801, 13343438, 13348650, 13696251 13919095,14275572,14727347,16083653,16742216,17272731 or 17735354 PSU is NOT applied to RDBMS Home /u01/app/oracle/product/11.2.0/db_1
 PASS =>    RECYCLEBIN on PRIMARY is set to the recommended value on orcl1 instance
 INFO =>    Information about hanganalyze and systemstate dump
 PASS =>    Database Parameter parallel_execution_message_size is set to the recommended value on orcl1 instance
 FAIL =>    Your Configuration is NOT in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/11.2.0/grid
 FAIL =>    Your Configuration is NOT in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/app/oracle/product/11.2.0/db_1
 PASS =>    Remote listener parameter is set to achieve load balancing and failover on orcl1 instance
 PASS =>    Local listener init parameter is set to local node VIP for orcl
 PASS =>    ezconnect is configured in sqlnet.ora
 PASS =>    No server-side TNSNAMES.ora aliases resolve using SCAN EZ syntax for orcl
 PASS =>    Value of remote_listener parameter is able to tnsping for orcl
 PASS =>    Remote listener is set to SCAN name for orcl
 PASS =>    No reported block corruptions in V$DATABASE_BLOCK_CORRUPTIONS for orcl
 PASS =>    All network interfaces for cluster_interconnect are on separate subnets
 PASS =>    Zero Configuration Networking is set to recommended value
 PASS =>    No read/write errors found for ASM disks for orcl
 PASS =>    Package glibc-2.5-24-x86_64 meets or exceeds recommendation
 FAIL =>    Table AUD$[FGA_LOG$] should use Automatic Segment Space Management for orcl
 INFO =>    Instance is using Automatic Undo Management on orcl1 instance
 INFO =>    Database failure prevention best practices
 PASS =>    Database Archivelog Mode is set to ARCHIVELOG for orcl
 PASS =>    Default temporary tablespace is set for orcl
 PASS =>    All tablespaces are using Automatic segment storage management for orcl
 PASS =>    All tablespaces are locally managed tablespace for orcl
 FAIL =>    Primary database is NOT protected with Data Guard (standby database) for real-time data protection and availability for orcl
 WARNING => avahi-daemon process is running
 PASS =>    Grid infastructure network broadcast requirements are met
 WARNING => Redo log write time is more than 500 milliseconds for orcl
 PASS =>    loopback address is configured as recommended in /etc/hosts
 INFO =>    No disks found which are not part of any disk group
 INFO =>    No corrupt ASM header blocks indicated in ASM alert log (ORA-15196 errors)
 PASS =>    No clusterware resource are in unknown state
 WARNING => TFA Collector is either not installed or not running
 PASS =>    System clock is synchronized to hardware clock at system shutdown
 INFO =>    Parallel Execution Health-Checks and Diagnostics Reports for orcl
 PASS =>    OCR and Voting disks are stored in ASM
 PASS =>    The data files are all recoverable for orcl
 PASS =>    Linux transparent huge pages are disabled
 WARNING => vm.min_free_kbytes should be set as recommended.
 PASS =>    pam_limits configured properly for shell limits
 PASS =>    Package cvuqdisk-1.0.9-1-x86_64 meets or exceeds recommendation
 WARNING => Oracle Patch NOT Applied on GI Home for issue different subnet failed to connect to VIP after Restart. /u01/11.2.0/grid
 WARNING => OS parameter vm.swappiness is NOT set to the recommended value
 PASS =>    All diskgroups from v$asm_diskgroups are registered in clusterware registry
 FAIL =>    FRA space management problem file types are present without an RMAN backup completion within the last 7 days. for orcl
 INFO =>    Oracle recovery manager(rman) best practices
 WARNING => RMAN controlfile autobackup should be set to ON for orcl
 PASS =>    control_file_record_keep_time is within recommended range [1-9] for orcl
 FAIL =>    ASM_DISKSTRING parameter is either null or set to /dev/*
 WARNING => Linux Disk I/O Scheduler should be configured to [Deadline]
 PASS =>    Berkeley Database location points to correct GI_HOME
 INFO =>    All optimizer related parameters are set to the default value (Parameter Set 1 of 3) for orcl
 INFO =>    Consider increasing the COREDUMPSIZE size
 PASS =>    Online(hot) patches are not applied to ORACLE_HOME. for orcl
 WARNING => ASM memory_target is not set to recommended value
 PASS =>    Table containing SecureFiles LOB storage belongs to a tablespace with extent allocation type that is SYSTEM managed (AUTOALLOCATE) for orcl
 PASS =>    Online(hot) patches are not applied to CRS_HOME.
 PASS =>    Database parameter NLS_SORT is set to BINARY for orcl
 PASS =>    Database parameter DB_FILE_MULTIBLOCK_READ_COUNT is unset as recommended for orcl
 PASS =>    Database parameter OPTIMIZER_FEATURES_ENABLE is set to the current database version for orcl
 INFO =>    No obsolete initialization parameters are set for orcl
 INFO =>    All optimizer related parameters are set to the default value (Parameter Set 3 of 3) for orcl
 INFO =>    All optimizer related parameters are set to the default value (Parameter Set 2 of 3) for orcl
 PASS =>    ASM disks have enough free space for rebalance
 PASS =>    ASM disk permissions are set as recommended
 INFO =>    Consider investigating changes to the schema objects such as DDLs or new object creation for orcl
 PASS =>    The database parameter session_cached_cursors is set to the recommended value for orcl
 INFO =>    Consider investigating the frequency of SGA resize operations and take corrective action for orcl
 INFO =>    Information about 11.2.0.3 support
 PASS =>    Shell limit soft stack for DB is configured according to recommendation
 PASS =>    kernel.panic_on_oops parameter is configured according to recommendation
 PASS =>    There are no duplicate parameter entries in the database init.ora(spfile) file for orcl




Best Practice checking completed.Checking recommended patches on rac1.
---------------------------------------------------------------------------------




Collecting patch inventory on  CRS HOME /u01/11.2.0/grid
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/11.2.0/db_1 
---------------------------------------------------------------------------------
1 Recommended CRS patches for 112030 from /u01/11.2.0/grid on rac1
---------------------------------------------------------------------------------
Patch#   CRS  ASM    RDBMS RDBMS_HOME                              Patch-Description                            
---------------------------------------------------------------------------------
18706488  no          no  /u01/app/oracle/product/11.2.0/db_1GRID INFRASTRUCTURE PATCH SET UPDATE 11.2.0.3.11 (INCLUDES DB PSU 11.2.0.3.11)
---------------------------------------------------------------------------------




---------------------------------------------------------------------------------
1 Recommended RDBMS patches for 112030 from /u01/app/oracle/product/11.2.0/db_1 on rac1
---------------------------------------------------------------------------------
Patch#   RDBMS    ASM     type                Patch-Description                       
---------------------------------------------------------------------------------
18706488  no             merge               GRID INFRASTRUCTURE PATCH SET UPDATE 11.2.0.3.11 (INCLUDES DB PSU 11.2.0.3.11)
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------




---------------------------------------------------------------------------------
              Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on CRS Applied on RDBMS Applied on ASM 
---------------------------------------------------------------------------------
1              0              0                0              
---------------------------------------------------------------------------------




---------------------------------------------------------------------------------
              RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on RDBMS Applied on ASM ORACLE_HOME    
---------------------------------------------------------------------------------
 1              0              0                /u01/app/oracle/product/11.2.0/db_1
---------------------------------------------------------------------------------










Copying results from rac2 and generating report. This might take a while. Be patient.


=============================================================
                    Node name - rac2                                
=============================================================


Collecting - /proc/cmdline
Collecting - /proc/modules
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - Cluster interconnect (clusterware)
Collecting - DiskFree Information
Collecting - DiskMount Information
Collecting - Huge pages configuration
Collecting - Interconnect network card speed
Collecting - Kernel parameters
Collecting - Linux module config.
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - NUMA Configuration
Collecting - Network Interface Configuration
Collecting - Network Performance
Collecting - Network Service Switch
Collecting - OS Packages
Collecting - OS version
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure 
Collecting - Patches for RDBMS Home 
Collecting - Table of file system defaults
Collecting - Verify ioctl to advm [ACFS]
Collecting - number of semaphore operations per semop system call
Preparing to run root privileged commands  rac2.


Collecting - ACFS Volumes status 
Collecting - ACFS and ASM driver version comparison [ACFS] 
Collecting - Broadcast Requirements for Networks 
Collecting - CRS user time zone check 
Collecting - Disk Information 
Collecting - Generic ACFS health [ACFS] 
Collecting - Grid Infastructure user shell limits configuration 
Collecting - Health of the mounted ACFS file systems [ACFS] 
Collecting - Health of unmounted ACFS file systems [ACFS] 
Collecting - Interconnect interface config 
Collecting - Network interface stats 
Collecting - Number of RDBMS LMS running in real time 
Collecting - OCFS2 disks 
/home/oracle/root_raccheck.sh: line 74: /sbin/mounted.ocfs2: No such file or directory
Collecting - OLR Integrity 
Collecting - Root user limits 
Collecting - Verify no database server kernel out of memory errors  
Collecting - Volume list for unmount ACFS file system [ACFS] 
Collecting - ocsf status 
/home/oracle/root_raccheck.sh: line 99: /etc/init.d/o2cb: No such file or directory
Collecting - root time zone check 
Collecting - slabinfo 




Data collections completed. Checking best practices on rac2.
--------------------------------------------------------------------------------------






 WARNING => Package gdb-7.0.1-42.el5-x86_64 does not meet recommendation for gdb-7.0.1-45.el5-x86_64 
 FAIL =>    Bash is vulnerable to code injection (CVE-2014-6271)
 PASS =>    ORA_CRS_HOME environment variable is not set
 PASS =>    net.core.wmem_default Is Configured Properly
 PASS =>    net.core.wmem_max Is Configured Properly
 PASS =>    net.core.rmem_default Is Configured Properly
 PASS =>    None of the hostnames contains an underscore character
 PASS =>    Interconnect is configured on non-routable network addresses
 PASS =>    net.core.rmem_max is Configured Properly
 INFO =>    $CRS_HOME/log/hostname/client directory has too many older log files.
 PASS =>    The number of async IO descriptors is sufficient (/proc/sys/fs/aio-max-nr)
 PASS =>    Kernel Parameter kernel.shmall OK
 PASS =>    Kernel Parameter SEMOPM OK
 PASS =>    Kernel Parameter SEMMNI OK
 PASS =>    Kernel Parameter SEMMSL OK
 PASS =>    Kernel Parameter kernel.shmmni OK
 PASS =>    Kernel Parameter SEMMNS OK
 PASS =>    Package glibc-common-2.5-x86_64 meets or exceeds recommendation
 PASS =>    Package elfutils-libelf-devel-0.125-x86_64 meets or exceeds recommendation
 PASS =>    Package elfutils-libelf-0.125-x86_64 meets or exceeds recommendation
 PASS =>    Package libaio-devel-0.3.106-x86_64 meets or exceeds recommendation
 PASS =>    Package libgcc-4.1.2-42.el5-x86_64 meets or exceeds recommendation
 PASS =>    Package libaio-devel-0.3.106-3.2-i386 meets or exceeds recommendation
 PASS =>    Package make-3.81-x86_64 meets or exceeds recommendation
 PASS =>    Package binutils-2.17.50.0.6-x86_64 meets or exceeds recommendation
 PASS =>    Package gcc-c++-4.1.2-42.el5-x86_64 meets or exceeds recommendation
 PASS =>    Package libstdc++-devel-4.1.2-42.el5-x86_64 meets or exceeds recommendation
 PASS =>    Package libaio-devel-0.3.106-3.2-x86_64 meets or exceeds recommendation
 WARNING => Package unixODBC-devel-2.2.11-x86_64 is recommended but NOT installed
 PASS =>    Package glibc-2.5-24-i386 meets or exceeds recommendation
 PASS =>    Package libstdc++-4.1.2-42.el5-i386 meets or exceeds recommendation
 PASS =>    Package libstdc++-devel-4.1.2-42.el5-i386 meets or exceeds recommendation
 PASS =>    Package libgcc-4.1.2-42.el5-i386 meets or exceeds recommendation
 PASS =>    Package libaio-0.3.106-3.2-x86_64 meets or exceeds recommendation
 PASS =>    Package libaio-0.3.106-3.2-i386 meets or exceeds recommendation
 PASS =>    Package sysstat-7.0.2-x86_64 meets or exceeds recommendation
 PASS =>    Package compat-libstdc++-33-3.2.3-61-x86_64 meets or exceeds recommendation
 PASS =>    Package glibc-devel-2.5-24-x86_64 meets or exceeds recommendation
 PASS =>    Package libstdc++-4.1.2-42.el5-x86_64 meets or exceeds recommendation
 PASS =>    Package compat-libstdc++-33-3.2.3-61-i386 meets or exceeds recommendation
 PASS =>    Package glibc-devel-2.5-24-i386 meets or exceeds recommendation
 PASS =>    $ORACLE_HOME/bin/oradism setuid bit is set for /u01/app/oracle/product/11.2.0/db_1
 PASS =>    $ORACLE_HOME/bin/oradism ownership is root for /u01/app/oracle/product/11.2.0/db_1
 INFO =>    oracleasm (asmlib) module is NOT loaded
 PASS =>    /tmp is on a dedicated filesystem
 PASS =>    ACFS driver is online [ACFS]
 PASS =>    Linux Swap Configuration meets or exceeds Recommendation
 WARNING => Shell limit soft nproc for DB is NOT configured according to recommendation
 PASS =>    Shell limit hard nofile for DB is configured according to recommendation
 PASS =>    Shell limit soft nproc for GI is configured according to recommendation
 PASS =>    Shell limit soft nofile for GI is configured according to recommendation
 PASS =>    Shell limit hard nproc for DB is configured according to recommendation
 PASS =>    Shell limit hard nofile for GI is configured according to recommendation
 PASS =>    Shell limit hard nproc for GI is configured according to recommendation
 PASS =>    Free space in /tmp directory meets or exceeds recommendation of minimum 1GB
 PASS =>    ACFS registry is online [ACFS]
 PASS =>    Shell limit hard stack for DB is configured according to recommendation
 INFO =>    Kernel Parameter fs.file-max is configuration meets or exceeds recommendation
 PASS =>    kernel.shmmax parameter is configured according to recommendation
 PASS =>    ip_local_port_range is configured according to recommendation
 INFO =>    Public interface is configured and exists in OCR
 PASS =>    SELinux is not being Enforced.
 INFO =>    Number of SCAN listeners is NOT equal to the recommended number of 3.
 PASS =>    CRS version is higher or equal to ASM version.
 FAIL =>    Operating system hugepages count does not satisfy total SGA requirements
 WARNING => NIC bonding is NOT configured for public network (VIP)
 PASS =>    crsd Log Ownership is Correct (root root)
 PASS =>    crsd/orarootagent_root Log Ownership is Correct (root root)
 PASS =>    ohasd/orarootagent_root Log Ownership is Correct (root root)
 PASS =>    ohasd Log Ownership is Correct (root root)
 WARNING => OSWatcher is not running as is recommended.
 INFO =>    Jumbo frames (MTU >= 8192) are not configured for interconnect
 WARNING => NTP is not running with correct setting
 PASS =>    asm_power_limit is set to recommended value of 1
 PASS =>    Shell limit hard stack for GI is configured according to recommendation
 PASS =>    ASM Audit file destination file count <= 100,000
 INFO =>    umask for RDBMS owner is set to 0022
 PASS =>    Clusterware is running
 FAIL =>    Your Configuration is NOT in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/11.2.0/grid
 FAIL =>    Your Configuration is NOT in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/app/oracle/product/11.2.0/db_1
 PASS =>    All network interfaces for cluster_interconnect are on separate subnets
 PASS =>    Zero Configuration Networking is set to recommended value
 PASS =>    Package glibc-2.5-24-x86_64 meets or exceeds recommendation
 WARNING => avahi-daemon process is running
 PASS =>    Grid infastructure network broadcast requirements are met
 PASS =>    loopback address is configured as recommended in /etc/hosts
 INFO =>    No corrupt ASM header blocks indicated in ASM alert log (ORA-15196 errors)
 PASS =>    No clusterware resource are in unknown state
 WARNING => TFA Collector is either not installed or not running
 PASS =>    System clock is synchronized to hardware clock at system shutdown
 PASS =>    OCR and Voting disks are stored in ASM
 PASS =>    Linux transparent huge pages are disabled
 WARNING => vm.min_free_kbytes should be set as recommended.
 PASS =>    pam_limits configured properly for shell limits
 PASS =>    Package cvuqdisk-1.0.9-1-x86_64 meets or exceeds recommendation
 WARNING => Oracle Patch NOT Applied on GI Home for issue different subnet failed to connect to VIP after Restart. /u01/11.2.0/grid
 PASS =>    All diskgroups from v$asm_diskgroups are registered in clusterware registry
 FAIL =>    ASM_DISKSTRING parameter is either null or set to /dev/*
 WARNING => Linux Disk I/O Scheduler should be configured to [Deadline]
 PASS =>    Berkeley Database location points to correct GI_HOME
 INFO =>    Consider increasing the COREDUMPSIZE size
 WARNING => ASM memory_target is not set to recommended value
 PASS =>    Online(hot) patches are not applied to CRS_HOME.
 PASS =>    ASM disks have enough free space for rebalance
 PASS =>    ASM disk permissions are set as recommended
 PASS =>    Shell limit soft stack for DB is configured according to recommendation
 PASS =>    kernel.panic_on_oops parameter is configured according to recommendation




Best Practice checking completed.Checking recommended patches on rac2.
---------------------------------------------------------------------------------




Collecting patch inventory on  CRS HOME /u01/11.2.0/grid
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/11.2.0/db_1 
---------------------------------------------------------------------------------
1 Recommended CRS patches for 112030 from /u01/11.2.0/grid on rac2
---------------------------------------------------------------------------------
Patch#   CRS  ASM    RDBMS RDBMS_HOME                              Patch-Description                            
---------------------------------------------------------------------------------
18706488  no          no  /u01/app/oracle/product/11.2.0/db_1GRID INFRASTRUCTURE PATCH SET UPDATE 11.2.0.3.11 (INCLUDES DB PSU 11.2.0.3.11)
---------------------------------------------------------------------------------




---------------------------------------------------------------------------------
1 Recommended RDBMS patches for 112030 from /u01/app/oracle/product/11.2.0/db_1 on rac2
---------------------------------------------------------------------------------
Patch#   RDBMS    ASM     type                Patch-Description                       
---------------------------------------------------------------------------------
18706488  no             merge               GRID INFRASTRUCTURE PATCH SET UPDATE 11.2.0.3.11 (INCLUDES DB PSU 11.2.0.3.11)
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------




---------------------------------------------------------------------------------
              Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on CRS Applied on RDBMS Applied on ASM 
---------------------------------------------------------------------------------
1              0              0                0              
---------------------------------------------------------------------------------




---------------------------------------------------------------------------------
              RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on RDBMS Applied on ASM ORACLE_HOME    
---------------------------------------------------------------------------------
 1              0              0                /u01/app/oracle/product/11.2.0/db_1
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
                      CLUSTERWIDE CHECKS
---------------------------------------------------------------------------------
 PASS =>    RDBMS software owner UID matches across cluster
 PASS =>    GI/CRS software owner UID matches across cluster
 PASS =>    Public network interface names are the same across cluster
 PASS =>    Timezone matches for current user across cluster.
 PASS =>    Clusterware active version matches across cluster.
 PASS =>    OS Kernel version(uname -r) matches across cluster.
 INFO =>    Operating system version matches across cluster.
 PASS =>    Time zone matches for GI/CRS software owner across cluster
 PASS =>    Time zone matches for root user across cluster
 PASS =>    Clusterware software version matches across cluster.
---------------------------------------------------------------------------------
 


Detailed report (html) - /home/oracle/tools/raccheck_rac1_orcl_121814_210633/raccheck_rac1_orcl_121814_210633.html




UPLOAD(if required) - /home/oracle/tools/raccheck_rac1_orcl_121814_210633.zip