Web Service Test Automation Standards

Tools

 

Test Goal

  • Cover all URL endpoints for Health Test and Bad Request
  • Cover all HTTP statuses served by the service (positive and negative)
  • Cover basic request response requirements.
  • Cover incremental URL endpoints along with its variations for rest of test types.
  • Cover data variations that results response variations.
  • Cover use cases that simulates user behavior from an application.
  • Cover performance test using various strategies

 

Test Types

1. Sanity Test

  • Health Test (Checks for service does not return HTTP status 500 and 503)
  • Bad Request Test (Checks for service handles negative requests with service defined appropriate HTTP status codes)
  • Service Sanity Test (Checks for required responses exists and not null, data types where appropriate, requests node data matches response node data if exists)

2. Functional Test (User scenarios on client side that can be achieved by series of service requests -             Helpful for isolation test)


3. Regression Test (All Service Sanity and Functional tests)


4. Smoke Test (Health and bad request test types and used for post deployment)


5. Data Driven Test (Cover service sanity test with data variations)


6. Performance Test

  • Simple Strategy
  • Fixed Rate Strategy
  • Variance Strategy

 

Target Environment To Run Test & Schedule

All Environments 

  •  Smoke test must run after every deployment

Development

  • All tests run on demand

QA

  • Regular scheduled test (All types)

Staging

  • All test run on demand

Production

  • Health, Bad Request and Sanity test types should run against production. This comprehensive check should be scheduled 3 or 4 times a day to run against each production server. Scheduled time must be agreed upon QA, product owners.

Test Data

  • Test data running in QA, Staging, and Production environment should be controlled data set. These controlled data set should be agreed by QA and Product owners.
  • Test data for Production should also be configurable so that when needed for quick test, data could be passed as a parameter.
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值