selenium结合sikuli实现百度的图片搜索功能

本文是一个简单的maven项目，实现场景为：访问百度（https://www.baidu.com）--点击搜索框中的“camera”图标--点击“本地上传图片”--输入文件名--点击“打开”按钮。

首先，在pom.xml中引用项目所需要的依赖包；

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
  <modelVersion>4.0.0</modelVersion>

  <groupId>com.wiley</groupId>
  <artifactId>sikuliDemo</artifactId>
  <version>0.0.1-SNAPSHOT</version>
  <packaging>jar</packaging>

  <properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
  </properties>

  
  <dependencies>
  	<dependency>
  		<groupId>org.seleniumhq.selenium</groupId>
  		<artifactId>selenium-java</artifactId>
  		<version>2.53.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.wiley.sikuli</groupId>
  		<artifactId>sikuli-script</artifactId>
  		<version>1.0.1</version>
  	</dependency>
  </dependencies>
  <build>
		<plugins>
			<plugin>
				<groupId>org.apache.maven.plugins</groupId>
				<artifactId>maven-surefire-plugin</artifactId>
				<executions>
					<execution>
						<id>surefire-it</id>
						<phase>integration-test</phase>
						<goals>
							<goal>test</goal>
						</goals>
						<configuration>
							<skip>false</skip>
						</configuration>
					</execution>
				</executions>
			</plugin>
			<plugin>
				<artifactId>maven-compiler-plugin</artifactId>
				<version>3.3</version>
				<configuration>
					<source>1.7</source>
					<target>1.7</target>
				</configuration>
			</plugin>
		</plugins>
	</build>
</project>

其次，项目目录以及编写代码实现

package com.wiley.sikuli;

import org.openqa.selenium.WebDriver;
import org.openqa.selenium.firefox.FirefoxDriver;
import org.sikuli.script.FindFailed;
import org.sikuli.script.Pattern;
import org.sikuli.script.Screen;

public class OnlinePainting {

	public static void main(String[] args) throws FindFailed, InterruptedException {
		WebDriver driver = new FirefoxDriver();
		driver.manage().window().maximize();
		driver.get("https://www.baidu.com");
		Screen screen = new Screen();
		/**
		 * 1、图片在根目录下
		 */
		screen.click("camera.png");
		
		/**
		 * 2、自定义图片位置
		 */
		Pattern upload = new Pattern("E:/workspace/sikuliDemo/pic/upload.png");
		screen.click(upload);
		
		screen.type("filename.png", "E:\\test\\upload.png");
		
		screen.click("openButton.png");
		
		Thread.sleep(3000);
		driver.quit();
	}
}

注意点：第一次编译的时候会提示找不到图片对应的dir目录，重启电脑可以解决此问题，具体原因不是很清楚。。。

参考：http://www.softwaretestinghelp.com/sikuli-tutorial-part-1/、http://www.softwaretestinghelp.com/sikuli-tutorial-part-2/