一些自动化测试概念

自动化测试的重要概念介绍

The Benefits of Automation and Tools

Regression testing 回归测试

目的：check that the bugs you found in previous test runs were
indeed fixed and that no new bugs were introduced

This process of rerunning your tests is known as regression testing.

The principal attributes of tools and automation are

Speed

Think about how long it would take you to manually try a few thousand test cases for the Windows Calculator. You might average a test case every 5 seconds or so.
Automation might be able to run 10, 100, even 1000 times that fast.

Efficiency

While you’re busy running test cases, you can’t be doing anything else. If you have a test tool that reduces the time it takes for you to run your tests, you have more time for test planning and thinking up new tests.

Accuracy and Precision. After trying a few hundred cases, your attention span will

wane and you’ll start to make mistakes. A test tool will perform the same test and check the results perfectly, each and every time.

Relentlessness. Test tools and automation never tire or give up. They’re like that

battery-operated bunny of the TV commercials—they can keep going and going and.…

Reminder

Software test tools aren’t a substitute for software testers—they just help software testers perform their jobs better.

Test Tools

分类：non-invasive and invasive

Non-invasive

If a tool is used only to monitor and examine the software without modifying it, it’s considered non-invasive.

Invasive

If, however, the tool modifies the program code or manipulates the operating environment in any way, it’s invasive.

There are varying degrees of invasiveness and testers usually try to use tools that are as non-invasive as possible to reduce the possibility that their tools are affecting the test results.

Viewers and Monitors

A viewer or monitor test tool allows you to see details of the software’s operation that you wouldn’t normally be able to see.

A code coverage analyzer is an example of a viewing tool.

Most code coverage analyzers are invasive tools because they need to be compiled and linked into the program to access the information they provide.

The code debuggers that come with most compilers are also considered viewers because they allow programmers or white-box testers to view internal variable values and program states.

Drivers

Drivers are tools used to control and operate the software being tested.

One of the simplest examples of a driver is a batch file, a simple list of programs or commands that are executed sequentially.

Stubs 桩

Stubs are essentially the opposite of drivers in that they don’t control or operate the software being tested; they instead receive or respond to data that the software sends.

When to use

Stubs are frequently used when software needs to communicate with external devices.

Stub vs Emulator

emulator used to describe a device that’s a plug-in replacement for the real device.

The difference between an emulator and a stub is that the stub also provides a means for a tester to view and interpret the data sent to it.

Stress and Load Tools

Interference Injectors and Noise Generators

Analysis Tools

a best-of-the-rest group

Screen capture and comparison software
• Debugger
• Binary-hex calculator 二进制转十六进制
• Stopwatch

Software Test Automation

Macro Recording and Playback 宏的录制和回放

什么是宏
可编程的宏 Programmed Macros

Fully Programmable Automated Testing Tools

Verification

Verification is the last big hurdle to overcome with automated software testing. Once you have
that, you can take nearly any test case and create automation that will make trying that case
either much easier or completely automatic.

Test Varification vs Tset Oracle

Tset Oracle: 准则

Random Testing: Monkeys and Gorillas

The term test monkey comes from the idea that if you had a million monkeys typing on a million keyboards for a million years, statistically, they might eventually write a Shakespearean play, Curious George, or some other great work. “测试猴子”这个词来源于这样一个想法：如果你有一百万只猴子在一百万年的键盘上打字，从统计上看，他们最终可能会写一部莎士比亚的戏剧，“好奇” 乔治，或者其他伟大的作品。

Dumb/Semi-Smart/Smart Monkey

Realities of Using Test Tools and Automation

1. The software changes.
2. There’s no substitute for the human eye and intuition.
3. Verification is hard to do.
4. It’s easy to rely on automation too much.
5. Don’t spend so much time working on tools and automation that you fail to test the software.
6. If you’re writing macros, developing a tool, or programming a monkey, you’re doing development work.
7. Some tools are invasive and can cause the software being tested to improperly fail.