做一个开发人员认可的测试人员(系列5) ---也谈STAFF的应用

为了减少人工干预，引入STAFF和批处理脚本把常做的事情自动化起来。

1 定时程序

:: Sleep.bat - Sleep/Delay/Wait n seconds :: Herbert Kleebauer(Germany) - 2005/05/29 :: Modified by Will Sort - 2005/06/02 @echo off echo q | debug>nul echo Bj@jzh`0X-`/PPPPPPa(DE(DM(DO(Dh(Ls(Lu(LX(LeZRR]EEEUYRX2Dx=>sleep.com echo 0DxFP,0Xx.t0P,=XtGsB4o@$?PIyU WwX0GwUY Wv;ovBX2Gv0ExGIuht6>>sleep.com echo T}{z~~@GwkBG@OEKcUt`~}@MqqBsy?seHB~_Phxr?@zAB`LrPEyoDt@Cj?>>sleep.com echo pky_jN@QEKpEt@ij?jySjN@REKpEt@jj?jyGjN@SEKkjtlGuNw?p@pjirz>>sleep.com echo LFvAURQ?OYLTQ@@?~QCoOL~RDU@?aU?@{QOq?@}IKuNWpe~FpeQFwH?Vkk>>sleep.com echo _GSqoCvH{OjeOSeIQRmA@KnEFB?p??mcjNne~B?M??QhetLBgBPHexh@e=>>sleep.com echo EsOgwTLbLK?sFU`?LDOD@@K@xO?SUudA?_FKJ@N?KD@?UA??O}HCQOQ??R>>sleep.com echo _OQOL?CLA?CEU?_FU?UAQ?UBD?LOC?ORO?UOL?UOD?OOI?UgL?LOR@YUO?>>sleep.com echo dsmSQswDOR[BQAQ?LUA?_L_oUNUScLOOuLOODUO?UOE@OwH?UOQ?DJTSDM>>sleep.com echo QTqrK@kcmSULkPcLOOuLOOFUO?hwDTqOsTdbnTQrrDsdFTlnBTm`lThKcT>>sleep.com echo @dmTkRQSoddTT~?K?OCOQp?o??Gds?wOw?PGAtaCHQvNntQv_w?A?it/EH>>sleep.com echo {zpQpKGk?Jbs?FqokOH{T?jPvP@IQBDFAN?OHROL?Kj??pd~aN?OHROd?G>>sleep.com echo Q??PGT~B??OC~?ipO?T?~U?p~cUo0x>>sleep.com sleep.com>sleep.exe del sleep.com echo Begin to wait at %time% echo wait 60 seconds: sleep.exe 60000 echo End of waiting at %time%

以上的这段可以精确的等待60秒，至少比Ping某个IP得到的延时要稳定。
把这个保存为批处理就能精确的等待延时了。

2 恢复DB

::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ : STAF to restore CM DB ::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ rem STAF cmx12 process start command "C:/Run-ORACLE-Restore.bat" rem Call C:/cm83/bin/sleep60min.bat rem del sleep.exe echo USE AIX_CMRESTOREDB.BAT echo stop sevrer1 echo %time% rem STAF cmx12 process start command "c:/stopserver.bat" REM 这里的stopserver.bat是在cmx12机器上C:/的。这里用远端的机器来调用。 call c:/cm83/bin/aix_stopserver1.bat Call C:/cm83/bin/sleep2min.bat del sleep.exe echo %TIME% rem echo stop DB rem echo %time% rem call c:/shutdown-oracle-db.bat rem Call C:/sleep.bat rem del sleep.exe rem echo %TIME% rem echo stop DB services rem echo %time% rem STAF cmx12 process start command "c:/stop-oracle-services.bat" rem Call C:/cm83/bin/sleep2min.bat rem del sleep.exe rem echo %TIME% echo restore DB svtlsdb echo %time% rem STAF cmx12 process start command "c:/Restore-ORACLE-DB1.bat" call C:/cm83/bin/aix_lsrestore.bat Call C:/cm83/bin/sleep2min.bat del sleep.exe echo %TIME% echo restore DB svtrm1 echo %time% rem STAF cmx12 process start command "c:/Restore-ORACLE-DB2.bat" call C:/cm83/bin/aix_rmrestore.bat Call C:/cm83/bin/sleep2min.bat del sleep.exe echo %TIME% echo delete old lbosdata echo %time% rem STAF cmx12 process start command "c:/rmlbosdata.bat" call c:/cm83/bin/aix_rmlbosdata.bat Call C:/cm83/bin/sleep2min.bat del sleep.exe echo %TIME% echo restore lbosdata echo %time% rem STAF cmx12 process start command "c:/restoreLbosdata.bat" call C:/cm83/bin/aix_cplbosdata.bat Call C:/cm83/bin/sleep2min.bat del sleep.exe echo %TIME% rem echo start DB rem echo %time% rem call c:/start-oracle-DB.bat rem Call C:/sleep.bat rem del sleep.exe rem echo %TIME% rem echo start DB services rem echo %time% rem STAF cmx12 process start command "c:/start-oracle-services.bat" rem Call C:/cm83/bin/sleep2min.bat rem del sleep.exe rem echo %TIME% echo start sevrer1 echo %time% rem STAF cmx12 process start command "c:/startserver.bat" call C:/cm83/bin/aix_startserver1.bat Call C:/cm83/bin/sleep2min.bat del sleep.exe echo %TIME%

 

AIX的DB2恢复SQL：

db2stop force; db2start; force application all; drop db svtlsdb; restore db svtlsdb;

调用的时候这么用：
AIX_LS_Restiore.sh

date echo "This will restore svtlsdb" cd /home/dbbak/done #/home/db2inst1/sqllib/bin/db2 force application all #/home/db2inst1/sqllib/bin/db2 restore db svtlsdb /home/db2inst1/sqllib/bin/db2 -tvf /home/lsrestore.sql echo "svtlsdb restore complete" date

评点：
DB2的脚本里面有停止DB2的命令
而Oracle在Windows上面仅仅停止DB是不够的，最主要是停止Windows上面的Oracle的服务。
在Windows-Oracle上面，停了DB而不停止服务是不行的，而停止了服务，DB自然也就停止了。

关于Oracle的恢复：
shutdown_svtlsdb.sql
conn sys/pass4svt@svtlsdb as sysdba; prompt This SQL will start svtlsdb DB shutdown immediate; prompt Run stat complete successfully! exit

startup_svtlsdb.sql:

conn sys/pass4svt@svtlsdb as sysdba; prompt This SQL will start svtlsdb DB startup; prompt Run stat complete successfully! exit

stop-oracle-services.bat：

sc stop OracleOraDb10g_home1TNSListener sc stop OracleOraDb10g_home1TNSListener Call C:/sleep.bat del sleep.exe sc stop OracleServiceSVTLSDB sc stop OracleServiceSVTLSDB Call C:/sleep.bat del sleep.exe sc stop OracleServiceSVTRM1 sc stop OracleServiceSVTRM1 Call C:/sleep.bat del sleep.exe

之所以停止2次是因为服务分为Running/Start-Pending/Stop-Pending/Stopped 4种状态，停2次可以确保服务完全停止。
调用的时候这么用：
Run-ORACLE-Restore.bat:
(先停Server1，再停DB再停服务，恢复lbosdata,恢复DB，起Oracle数据库，起Oracle的服务，起Server1，数据库恢复那块可以用7Z或者RAR的命令行去实现。)

echo stop sevrer1 echo %time% call c:/stopserver.bat Call C:/sleep.bat del sleep.exe echo %TIME% rem echo stop DB rem echo %time% rem call c:/shutdown-oracle-db.bat rem Call C:/sleep.bat rem del sleep.exe rem echo %TIME% echo stop DB services echo %time% call c:/stop-oracle-services.bat Call C:/sleep.bat del sleep.exe echo %TIME% echo restore DB echo %time% call c:/Restore-ORACLE-DB.bat Call C:/sleep.bat del sleep.exe echo %TIME% echo restore lbosdata echo %time% call c:/restoreLbosdata.bat Call C:/sleep.bat del sleep.exe echo %TIME% rem echo start DB rem echo %time% rem call c:/start-oracle-DB.bat rem Call C:/sleep.bat rem del sleep.exe rem echo %TIME% echo start DB services echo %time% call c:/start-oracle-services.bat Call C:/sleep.bat del sleep.exe echo %TIME% echo start sevrer1 echo %time% call c:/startserver.bat Call C:/sleep.bat del sleep.exe echo %TIME%

 

3 DB调优脚本
DB2
tune_ls.sh：
db2 force applications all db2 connect to svtlsdb user SVTLSADM using pass4svt db2 -x "select tabname from syscat.tables where type='T' and tabschema='SVTLSADM '" | sed -e "s/ *.$//" | sed -e "s/^/runstats on table SVTLSADM./" | sed -e "s/ $/ with distribution and detailed indexes all/" > dostatsls.sql db2 -vf dostatsls.sql db2 -x "select 'REORG TABLE SVTLSADM.' concat tabname CONCAT '' from syscat.tabl es where type='T' and tabschema='SVTLSADM'" > doreorg.sql db2 -vf doreorg.sql db2rbind svtlsdb -l /home/rbind.log all -u SVTLSADM -p pass4svt db2 -x "select tabname from syscat.tables where type='T' and tabschema='SVTLSADM '" | sed -e "s/ *.$//" | sed -e "s/^/runstats on table SVTLSADM./" | sed -e "s/ $/ with distribution and detailed indexes all/" > dostatsls.sql db2 -vf dostatsls.sql db2 connect reset ~

tune-db2-ls-db.bat：

db2 force applications all db2 connect to svtlsdb user svtlsadm using pass4svt db2 -x "select 'REORG TABLE SVTLSADM.' concat tabname CONCAT ';' from syscat.tables where type='T' and tabschema='SVTLSADM'" > doreorg.sql db2 -tvf doreorg.sql db2 -x "select tabname from syscat.tables where type='T' and tabschema='SVTLSADM'" | sed -e "s/ *.$//" | sed -e "s/^/runstats on table SVTLSADM./" | sed -e "s/$/ with distribution and detailed indexes all;/" > dostatsls.sql db2 -tvf dostatsls.sql db2rbind svtlsdb -l c:/temp/rbind.log all -u svtlsadm -p pass4svt db2 connect reset

Oracle
new_svtlsdb.sql

conn sys/pass4svt@svtlsdb as sysdba; prompt This SQL will run stat on svtlsdb DB execute dbms_stats.gather_schema_stats(ownname =>'sys',estimate_percent => dbms_stats.auto_sample_size,method_opt=>'for all columns size auto', cascade=>true); execute dbms_stats.gather_schema_stats(ownname =>'system',estimate_percent => dbms_stats.auto_sample_size,method_opt=>'for all columns size auto', cascade=>true); execute dbms_stats.gather_schema_stats(ownname =>'svtlsadm',estimate_percent => dbms_stats.auto_sample_size,method_opt=>'for all columns size auto', cascade=>true); analyze table svtlsadm.ICMSTITEMS001001 compute statistics for all indexes for all indexed columns; analyze table svtlsadm.ICMSTUSERS compute statistics for all indexes for all indexed columns; analyze table svtlsadm.ICMSTCOMPILEDACL compute statistics for all indexes for all indexed columns; analyze table svtlsadm.ICMUT01008001 compute statistics for all indexes for all indexed columns; analyze table svtlsadm.ICMUT00301001 compute statistics for all indexes for all indexed columns; analyze table svtlsadm.ICMSTRI001001 compute statistics for all indexes for all indexed columns; analyze table svtlsadm.ICMSTITEMS001001 compute statistics for all indexes for all indexed columns; analyze table svtlsadm.ICMSTCOMPILEDPERM compute statistics for all indexes for all indexed columns; analyze table svtlsadm.ICMUT01065001 compute statistics for all indexes for all indexed columns; prompt Run stat complete successfully!

 

对Oracle里面的几张大表进行Analyse避免出现幺蛾子的性能问题。

tune-oracle-ls-db.bat
set oracle_sid=svtlsdb sqlplus svtlsadm/pass4svt@svtlsdb @new_svtlsdb.sql

 

4 FTP下载

Too Simple! Native!

 

5 5 杀/启进程
杀掉所有的命令行
::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ c:/windows/system32/taskkill /F /IM cmd.exe ::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

 

杀掉Visual Studio的编辑器

::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ c:/windows/system32/taskkill /F /IM devenv.exe ::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

 

杀掉所有的DMTester

::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ c:/windows/system32/taskkill /F /IM DMTester.exe ::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

 

杀掉用户名称为DM_User的进程

::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ echo stop DM dllhost.exe taskkill /F /FI "USERNAME eq DM_User" ::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

DM的MemoryTool是调用了WMI(Microsoft management Interface的VBS写的，直接双击运行是Windows的Wscript执行的，需要人工点击鼠标，为了命令行运行，采用下面的脚本)

cd C:/MemoryTool cscript C:/MemoryTool/process2.vbs

所以在停止的时候也是通过taskkill /F /IM cscript.exe来杀掉的

对于DM自己的服务
DMServerStartService.bat
注意85的DM不含有DB2的Title

@echo off echo Start DM Cache Service REM start twice because it has start-pend state REM first delete remaing cache cd C:/Program Files/IBM/DB2 Document Manager/dmserver rm -rf * Call C:/sleep.bat del sleep.exe sc start IBMDMCacheManager sc start IBMDMCacheManager Call C:/sleep2min.bat del sleep.exe Call C:/sleep.bat del sleep.exe echo Start DM Cache Service sc start IBMDMLifeCycleManager sc start IBMDMLifeCycleManager Call C:/sleep.bat del sleep.exe

注意CacheServices和LifecycleServices都需要提前配置好，没有命令行配置的文档或者方法。

 

6 跑Case
串行的跑
cd /d C:/DMTester/Release DMTester -t C:/cm83/source/TestCases/LC_FLD/crudTest/SUMIT_REVIEW.txt DMTester -t C:/cm83/source/TestCases/LC_DOC/crudTest/SUMIT_REVIEW.txt

 

并发的跑

::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ ::Start DM API SingleUser case: Sequential, not continue until finish. ::@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ rem cd C:/cm83/bin rem echo Start DM single user API testing rem Call C:/cm83/bin/RunSingleDMTester.bat rem Call C:/cm83/bin/sleep.bat rem del sleep.exe start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/PLCS_FLD/crudTest/SUMIT_REVIEW.txt -l 99999 -d 45000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/WC_CLAIM_DOC/crudTest/SUMIT_REVIEW.txt -l 99999 -d 45000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/SS_FLD_2/crudTest/CRUDFld.txt -l 99999 -d 43000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/LC_FLD/crudTest/SUMIT_REVIEW.txt -l 99999 -d 45000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/PLCS_DOC/crudTest/SUMIT_REVIEW.txt -l 99999 -d 45000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/POLICY_FLD/crudTest/retrieveItem.txt -l 99999 -d 43000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/PC_CLAIM_FLD/crudTest/updateItem.txt -l 99999 -d 43000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/NO_FAULT_DOC/crudTest/deleteItem.txt -l 99999 -d 43000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/TestCases/R_FLD_2/crudTest/CRUDFld.txt -l 99999 -d 43000 call C:/cm83/bin/sleep10sec.bat start /dC:/DMTester/Release DMTester -t C:/cm83/source/allOper.txt -l 99999 -d 43000 call C:/cm83/bin/sleep10sec.bat del sleep.exe echo wait 2 hours Call C:/cm83/bin/sleep150min.bat rem 这里是跑的150分钟的Stress del sleep.exe

 

7 收集日志

CM在Unix上面
GetPerfLogs_AIX.bat
echo copy logs REM for AIX-DB2 call C:/cm83/bin/aix_getlog.bat copy C:/perflogs/cpu.csv C:/perflogs/APILogs/CM/ copy C:/perflogs/disk.csv C:/perflogs/APILogs/CM/ copy C:/perflogs/diskio.csv C:/perflogs/APILogs/CM/ copy C:/perflogs/mem.csv C:/perflogs/APILogs/CM/ copy C:/perflogs/mon2log C:/perflogs/APILogs/CM/ copy C:/perflogs/mon2pidlock C:/perflogs/APILogs/CM/ copy C:/perflogs/process.csv C:/perflogs/APILogs/CM/ Call C:/cm83/bin/sleep.bat del sleep.exe

 

aix_getlog.bat

echo "Getting CM monitor log" cd C:/PerfLogs psftp.exe root@irmfvt10 -pw pass4svt -b c:/cm83/bin/aix_getlist.ini cd c:/cm83/bin

 

aix_getlist.ini

cd /home/perflogs lcd C:/PerfLogs get cpu.csv get disk.csv get diskio.csv get mem.csv get mon2log get mon2pidlock get process.csv quit

 

对于CM在Window上的：
把别人的C Mount为自己的Y和Z盘，直接利用Copy或者CP命令操作

GetLogs.bat:

REM for Win-Oracle copy C:/perflogs/*cmx12* C:/perflogs/APILogs/CM/ Call C:/cm83/bin/sleep.bat del sleep.exe copy C:/perflogs/*cmx13* C:/perflogs/APILogs/DMServer/ Call C:/cm83/bin/sleep.bat del sleep.exe copy Y:/MemoryTool/*.csv C:/perflogs/APILogs/DMServer/ Call C:/cm83/bin/sleep.bat del sleep.exe copy C:/perflogs/*cmx29* C:/perflogs/APILogs/DMClient/ Call C:/cm83/bin/sleep.bat del sleep.exe copy C:/DMTester/Release/*.log C:/perflogs/APILogs/DMClient/DMTester Call C:/cm83/bin/sleep.bat del sleep.exe goto End

 

8 装环境(未完成)

9 自动升级安装(未完成)

10 自动分析日志(未完成)

 

附录：

STAFF安装和配置文档

解压缩上述压缩包，安装STAFF
在STAFF安装目录下面，找到STAF.CFG
修改为
# Turn on tracing of internal errors and deprecated options^M trace enable tracepoints "error deprecated"^M ^M # Enable TCP/IP connections^M interface ssl library STAFTCP option Secure=Yes option Port=6550^M interface tcp library STAFTCP option Secure=No option Port=6500^M ^M # Set default local trust^M TRUST LEVEL 5 DEFAULT^M TRUST LEVEL 5 MACHINE local://local^M TRUST LEVEL 5 MACHINE tcp://*.*^M TRUST LEVEL 5 MACHINE ssl://*.*^M ^M # Add default service loader^M serviceloader library STAFDSLS^M ^M SET MAXQUEUESIZE 10000 ~

这样这台AIX就能人尽可夫了。只要在这台AIX上面有的批处理，别的机器调用STAFF就能执行。

 

STAFF就是在操作系统上面建一个STAF的用户，同时监听所有在STAF.CFG指定的机器的服务。
目前支持Perl Pathon C++ JAVA和批处理。

我们图省事就用批处理。
今后可以考虑使用Java来使得这个更加稳定。

 

PUTTY配置文档

默认安装即可，安装后，客户机需要用SSH协议连接一次目标机，确认一下安全密钥

 

 

SSH和SFTP配置文档

安装SSH服务软件包
编辑SSH服务配置文件/etc/ssh/sshd_config
确保最后一行
Subsystem       sftp    /usr/lib/ssh/sftp-server
没有被注释
启动/重启SSH服务：
startsrc -g ssh