Automation Case Selection Criteria

Regression Selection Criteria :

    

When you finish new feature test design, the next step you should do is to figure out the regression test cases which would be rerun every time the change occurs.  This article is to serve as a guide indicating what kind of cases should be picked up during regression cases selection. 

Principle： 

1.  Regression Scope should be as big as possible so ideally all test cases ought to be in regression suite, but reality is that  team is not able afford full scope, so the scope should be defined based on phase at the time.
2.  Manual regression scope should be controlled considering the effort constrain 
3.  So try best to automate more test cases, all automated test cases are in regression suite by default , but we need tailor the manual scope.

Manual Regression Case Scope Criteria:

•   Cases going through critical happy path based on every standard user story  (Critical )
•   Key negative cases impacting business flow  (Major)
•   Cases going through paths as are known as the ones frequently touched by customer daily operation  (Critical)
•   Cases going through area where own high bug density (Major)
•   Cases covers the customer reported defect  (Major)
•   Cases covers integrated connections , for sure E2E cases.  (Critical)
•   Cases covers api open to customers (Critical)
•   Cases related to the changes identified during ongoing release .(Major)
•  ...

 

Manual Regression Case selection Criteria:

第一，新修改的功能，这个显然是重点

第二，新修改的功能的关联功能，就是有耦合的部分，这个一般最好咨询一下开发人员

第三，程序最有卖点或者说亮点的部分，这个地方一旦有问题，会使程序质量大打折扣

第四，程序中最致命的部分，譬如说安全隐患，数据泄露，加密注册，

第五，程序中比较脆弱的部分，这个要咨询开发人员，一般就是他们心中最没底的地方

第六，程序的主干功能

 

What cases should be eliminated from suite:

•     Steps already covered by other cases (duplicated)
•     UI related only cases, hardly related to business operation flow 
•     Non-critical path of feature should not be the regular ones in regression

 

Regression suite should be maintained on timely basis,  be very cautious on elimination, supplementing right cases is the priority 

 

Automation Case selectio cirtiera: 

• Priority : UT -  API - UI 
• Happy path , cirtical path,   Acceptence Case 
• Full regression

转载于:https://my.oschina.net/u/3747182/blog/1589224