JAVA+TestNG 测试套执行、重复执行失败用例

1、创建测试用例demo1:

package base;

import org.testng.Assert;
import org.testng.annotations.Test;

public class Demo1 {

	@Test(groups ={"API Test","Function Test"})  //必定执行失败
	public void test1(){
		Assert.assertEquals(2, 3);
		
	}
	
	@Test(groups = {"API Test"})
	public void test2(){
		System.out.println( "Hello2");
	}
	
	@Test
	public void test3(){
		System.out.println( "Hello3");
	}
	
}

2、先执行一遍上述文件，在输出信息中可看到执行的testNG.xml路径，如：

拷贝上述文件到自己的测试套目录，如src/run/testng-customsuite.xml

3、现在可对步骤2的xml文件做编辑

3.1 下面这么写，代表执行所有标签前缀为Function的test用例，代表此处支持正则表达式，当然也可以写具体指如：Function Test,下面的写法执行的是test1

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd">
<suite name="Default suite">
  <test verbose="2" name="Default test">
      <groups>
          <run>
              <include name ="Function.*"/> 
          </run>
      </groups>
    <classes>
      <class name="base.Demo1"/>
    </classes>
  </test> <!-- Default test -->
</suite> <!-- Default suite -->

3.2 也可以按照排除法来执行标签用例，以下面的为例，执行结果是：test1/test3；注意：虽然test1属于API Test,但因为它还属于Function Test，故也会被执行

注意exclude必须以</exclude>结尾

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd">
<suite name="Default suite">
  <test verbose="2" name="Default test">
      <groups>
          <run>
              <exclude name ="API Test/">
              </exclude>
          </run>
      </groups>
    <classes>
      <class name="base.Demo1"/>
    </classes>
  </test> <!-- Default test -->
</suite> <!-- Default suite -->

3.3 若要全部执行，则需要这么写，但这么写也仍然是执行ALl包括的标签：Function Test+API Test，

故还是需要在每个想执行到的test中加group标签，或者在testNG.xml中不设置<groups>这个过滤条件，则可以按照class进行执行

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd">
<suite name="Default suite">
  <test verbose="2" name="Default test">
      <groups>
          <define name ="all">
              <include name ="Function Test"/> 
              <include name ="API Test/">
          </define>
          <run>
              <include name ="all"/>
          </run>
      </groups>
    <classes>
      <class name="base.Demo1"/>
    </classes>
  </test> <!-- Default test -->
</suite> <!-- Default suite -->

4、在TestNG中会自动记录你上一次运行情况，在test-output下会生成html格式报告，和把失败的用例都放在testng-failed.xml，故想执行完一遍testNG.xml后，再执行一遍testng-failed.xml，故编写如下java文件，可只执行如下文件可实现上述两个步骤：

package runner;

import java.util.ArrayList;
import java.util.List;
import org.testng.TestNG;

public class RunTestNG {
	public static void main(String[] args) throws InterruptedException{
		TestNG testNG = new TestNG();
		List<String> suites = new ArrayList<String>();
		System.out.println(System.getProperty("user.dir"));
		suites.add(".\\src\\runner\\testng-customsuite.xml");
		testNG.setTestSuites(suites);
		testNG.run();
		
		//等待执行结束，然后去执行失败用例
		TestNG testNG1 = new TestNG();
		List<String> suites1 = new ArrayList<String>();
		Thread.sleep(5000);
		suites1.add(".\\test-output\\testng-failed.xml");
		testNG1.setTestSuites(suites1);
		testNG1.run();
					
	}	
}

4.2 另一种重复执行失败用例的方法，继承ITestListener的接口：

package base;

import java.util.ArrayList;
import java.util.List;
import org.testng.annotations.Test;
import org.testng.Assert;
import org.testng.AssertJUnit;
import org.testng.ITestContext;
import org.testng.ITestListener;
import org.testng.ITestResult;
import org.testng.TestNG;

public class ListenerDemo implements ITestListener{

	@Override
	public void onTestStart(ITestResult result) {
		// TODO Auto-generated method stub
		System.out.println("用例启动"+ result.toString());
		
	}

	@Override
	public void onTestSuccess(ITestResult result) {
		// TODO Auto-generated method stub
		System.out.println("run success"+result.toString());
	}

	@Override
	public void onTestFailure(ITestResult result) {
		// TODO Auto-generated method stub
		System.out.println("run fail"+result.toString());
		TestNG testNG1 = new TestNG();
		List<String> suites1 = new ArrayList<String>();
		try {
			Thread.sleep(5000);
		} catch (InterruptedException e) {
			// TODO Auto-generated catch block
			e.printStackTrace();
		}
		suites1.add(".\\test-output\\testng-failed.xml");
		testNG1.setTestSuites(suites1);
		testNG1.run();
	}

	@Override
	public void onTestSkipped(ITestResult result) {
		// TODO Auto-generated method stub
		
	}

	@Override
	public void onTestFailedButWithinSuccessPercentage(ITestResult result) {
		// TODO Auto-generated method stub
		
	}

	@Override
	public void onStart(ITestContext context) {
		// TODO Auto-generated method stub
		
	}

	@Override
	public void onFinish(ITestContext context) {
		// TODO Auto-generated method stub
		
	} 
	
	@Test
	public void listenerExampletest(){
		Assert.assertTrue(11==10);
	}

	
	
}

testng.xml中增加listener的监听：

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd">
<suite name="Default suite">
  <listeners>
      <listener class-name ="base.ListenerDemo"/>
  </listeners> 
  <test name="Testng_learn">
     <classes>
       <class name="base.ListenerDemo"/>
    </classes>
  </test> <!-- Default test -->
</suite> <!-- Default suite -->

 执行上述xml文件：