Web Functional/Regression Test Tools

 

Web Functional/Regression Test Tools

SafariWatir - Ruby gem that adds Watir support for Safari on the Mac (the originial Watir is for Windows); open source by Dave Hoover and others. For OS X running Safari.

Celerity - An open source JRuby wrapper around HtmlUnit. Runs as a headless Java browser - speeding up web testing; Java threads enablle running tests in parallel; can run in background. JavaScript support. Provides simple API for programmatic navigation thu web apps. Intended to be API compatible with Watir. For any platform.

Webrat - Ruby-based utility to enable quick development of web app acceptance tests. Open source by Bryan Helmkamp. Leverages the DOM to run tests similarly to in-browser test tools like Watir or Selenium without the associated performance hit and browser dependency. Best for web apps that do NOT utilize Javascript; apps using Javascript in-browser tools may be more appropriate.

CubicTest - An open source graphical Eclipse plug-in for writing functional web tests in Selenium and Watir. Makes web tests faster and easier to write, and provides abstractions to make tests more robust and reusable. Tests are stored in XML, directly mapped from the CubicTest domain model to XML via XStream. Tests can at any time be exported to Selenium Core tables (a popular test format) or Watir test cases. Supports recording; maven.

Selenium Grid - An open source web functional testing tool that can transparently distribute your tests on multiple machines to enable running tests in parallel, cutting down the time required for running in-browser test suites. This enables speed-up of in-browser web testing. Selenium tests interact with a 'Selenium Hub' instead of Selenium Remote Control. The Hub allocates Selenium Remote Controls to each test. The Hub is also in charge of routing the Selenium requests from the tests to the appropriate Remote Control as well as keeping track of testing sessions. Requires Java 5+ JDK, Ant 1.7.x

Mechanize - Open source; Ruby library for automating interaction with websites; automatically stores and sends cookies, follows redirects, can follow links, and submit forms. Form fields can be populated and submitted. Also keeps track of the sites visited. It is a Ruby version of Andy Lester's Perl 'Mechanize' Note: does not handle javascript.

Automation Anywhere - Tool from Tethys Solutions using 'SMART' Automation Technology offers over 180+ powerful actions for web automation. Works with any website, including complex websites using java, javascript, AJAX, Flash or iFrames. Agent-less remote deployment allows automated task to be run over various machines on the network. An advanced Web Recorder ensures accurate re-runs taking into account website changes.Also includes an editor with Point & Click wizards to automate tasks in minutes.includes link checking.

StoryTestIQ - StoryTestIQ (STIQ) is a test framework used to create Automated Acceptance Tests. It's a mashup of Selenium and FitNesse: its "wiki-ized" Selenium with widgets and features that make it easier to write and organize Selenium tests.

Web2Test -Automated test tool from itCampus Software for testing of web-based applications and portals. Runs under Windows and Linux and supports Firefox, Internet Explorer, Mozilla and Seamonkey. Provides a scripting interface in Jython and Groovy. Test scripts are browser and platform independent; supports data driven and distributed testing.

Watij -Web Application Testing in Java, an open source pure Java API. Based on the simplicity of the Watir open source web test frameworkand enhanced by the capabilities of Java; automates functional testing of web apps through a real browser. Provides a BeanShell Desktop console; For MS IE on Windows.

TestMaker -Free open source utility maintained by PushToTest.com and Frank Cohen, for functional testing as well as performance and scalability testing. Features test authoring of Web applications, Rich Internet Applications (RIA) using Ajax, Service Oriented Architecture, and Business Process Management environments. Integrates Selenium, soapUI, TestGen4Web, and HTMLUnit to make test development faster/easier. Repurposes tests from these tools into tests, and business service monitors with no coding. Repurposes unit tests written in Java, Jython, JRuby, Groovy, and other dynamic scripting languages. Runs on any platform.

AutoMate - Automation platform from Network Automation, includes capability to simulates GUI activity via the browser.Inc with robust automated testing capabilities. Capabilities include support for HTTPS; Microsoft Excel Integration; a test run Event Database, native Terminal Emulation support. Tasks can be developed via drag-and-drop without writing code. Runs on Windows platforms.

Automation Anywhere -Functional test automation tool from Tethys Solutions, LLC, includesweb test automation capabilities - includes a web recorder that understands web controls; web page data extraction capabilities.For Win platforms

Gomez RealityCheck XF -Provides functional testing for Web 2.0 applications; a solution for cross-browser, functional QA testing of traditional, Ajax-enabled, and other Rich Internet Applications. Enables easy creation and loading of scripts of business transactions recorded using Selenium.

iMacros for Firefox -Free Firefox add-on to record and automate web interactions. Can use variables inside the macros, and import data from CSV files. Includes user agent switcher, PDF download and Flash, ad and image blocking functions. The recorded macros can be combined and controlled with Javascript, so complex tasks can be scripted.The EXTRACT command enables reading of data from a website and exporting it to CSV files. Full Unicode support and works with all languages including multi-byte languages such as Chinese. STOPWATCH command enables capturing of web page response times

Avignon Acceptance Testing System - Open source acceptance test system that allows writing of executable tests in a language that the user can define. It uses XML to define the syntax of the language but, if the user chooses to extend the language, allows the semantics of the tests to be user-defined. Includes modules for testing web applications through either IE or FireFox, and modules for testing Swing and .NET WinForm applications also..

InCisif.Net -Web test tool from InCisif Software for client side functional testing of web apps under MSIE, using C# or VB.NET. Use InCisif Assistant to record user interactions with web application. Write, edit, execute and debug using MS Visual Studio or Visual Basic and C# Express.

Sahi -Free open-source web test tool, written in java and javascript, by Narayan Raman; capabilities include an Accessor Viewer for identifying html elements for scripting, editable scripts (javascript), simple APIs, ant support for playback of suites of tests, multi threaded playback, HTTP and HTTPS support, AJAX support, logging/reports,suites can run in multiple threads thus reducing the test execution time.

Solstice Integra Suite -Automation tool from Solstice Software. Contains Solstice Integra Test Automation, which offers a set of out-of-the-box test automation and management features for testing within integration and SOA environments. Solstice Integra Test Automation can be used alone or in conjunction with one or more of pluggable Platform Libraries that are tailored to optimize validation of today's leading ESB and SOA platforms. Solstice Integra Platform Libraries include TIBCO, WebSphere, webMethods, J2EE and BEA. Includes unit testing, record-and-replay, message tracing, and simulation capabilities.

Vermont HighTest Plus -Regression-testing tool from Vermont Creative Software for browser-based applications; also tests stand-alone; direct integration into Internet Explorer.Integrated Debugger allows stepping through tests one line at a time to examine the value of variables in real-time.

WebFT -Web-centric functional testing solution from Radview, supports both established and emerging web technologies. Provides a visual environment for creating Agendas (scripts) that include test recording, editing, debugging, verification and reporting features.

Floyd -A Java library for automated testing of web applications; provides full control of standard web browsers such as Firefox and MSIE. Interaction with the browser and any loaded web pages is achieved via calls to Floyd's Java API. Has two main components: a normal browser embedded into the web application and controlled via its public interface, and an embedded servlet container/web server. Can be used with any unit test library,

Imprimatur -Free web functional testing tool by Tony Locke, written in Java as a command-lineapplication. Tests are described in a simple XML file; along with standard GET, POST and DELETE methods, handles HTTP authentication and file uploads. Responses can be validated using regular expressions.

WET -Open source web testing tool that drives MSIE directly; from Qantom Software Pvt. Ltd. Has many features like multiple parameter based object identification for more reliable object recognition, support for XML Based Object Repository and more. Scripting in Ruby; written in Ruby.

SOASTA Concerto -A suite of visual tools for automated web functional and load testing from SOASTA, Inc.Available as services on the web. Drag and drop visual interface that also allows access to underlying message complexity. Task-specific visual editors support creation of targets, messages, test cases, and test compositions. Works with Firefox and MSIE, Win and OSX.

Regression Tester - Web test tool from Info-Pack.com allows testing of functionality of any page or formReports are fully customizable.

Yawet -Visual web test tool from InforMatrix GmbH enables graphical creation of web app tests. Create, run and debug functional and regression tests for web applications. Can verify HTML, XML, and PDF'ability to do report generation, reusable step libraires and parameterization. Freeware; download jar file and start by double-click or with command javaw -jar yawet.jar

vTest -Web functional and regression test tool from Verisium Inc.Includes record and playback capabilities and scripting utilizing JavaScript. For Windows platforms.

SWExplorerAutomation - Low cost web tool from Webius creates an automation API for any Web application which uses HTML and DHTML and works with MSIE. The Web application becomes programmatically accessible from any .NET language. The SWExplorerAutomation API provides access to Web application controls and content. The API is generated using SWExplorerAutomation Visual Designer, which helps create programmable objects from Web page content. Features include script recording and VB/C# code generation.

LISA for Web Apps -Automated web application testing tool from iTKO, Inc. Browser-based test record and playback. Point-and-click capture and reuse of a test case against any web application using any browser type. No test coding or scripting. Supports active sessions, SSL, authentication and magic strings.

Squish for Web -Cross platform automated testing framework from Froglogic GmbH for HTML-based Web and Web 2.0/Ajax applications running in any of several browsers. Record or create/modify scripts using Tcl, Python, JavaScript. Automatic identification of GUI objects of the AUT; inspect AUT's objects, properties and methods on run-time using the Squish Spy. Can be run via a GUI front-end or via command line tools. Can execute tests in a debugger allowing setting breakpoints and stepping through test scripts.

Funkload - Web functional testing and load testing tool written in Python and distributed as free software under the GNU GPL. Emulates a web browser (single-threaded) using webunit;https support; produces detailed reports in ReST, HTML, or PDF.Functional tests are pure Python scripts using the pyUnit framework.

WebCorder -Free GUI web testing tool from Crimson Solutions, developed in VB.Designed for end users who are doing web based software testing, as a simple tool to record test scenarios, and play them back and generate log files. The user may also check for text or images on the screen or save screenshots.

Watir -'Web Application Testing in Ruby', a free open-source tool, drives MSIE browser and checks results. Uses Ruby, a full featured object-oriented scripting language. Does not work with ActiveX plugin components, Java Applets, Macromedia Flash, or other plugin applications. Note: additional tools are availableto extend some capabilities - see the Alternative Tools for Web Testing' page at the OpenQA site for more info.

FireWatir -Open source web testing tool has a similar API to Watir, though accesses the DOM by invoking JavaScript by using the JSSh XPI to telnet into the browser. While Watir works with MSIE, FireWatir is compatible with Firefox 1.5 and above.FireWatir allows Watir scripts written for IE to work with Firefox as well, usually requiring either no change or very small changes to existing scripts. It is planned for FireWatir and Watir to be merged. The wiki includes info on compatibility issues between Watir and Firewatir.

WatiN -'Web Application Testing in .Net', a free open-source tool, drives MSIE browser and checks results. Uses C#.Automates all major HTML elements, find elements by multiple attributes, supports AJAX website testing, supports frames (cross domain) and iframes,supports popup dialogs like alert, confirm, login etc.,supports HTML dialogs (modal and modeless), and has a basic (extensible) logging mechanism Also available is a WatiN Test Recorder

Selenium -Free open-source tool, originially from Thoughtworks. Records web apps on Firefox; scripts recorded in 'Selenese' or any of 6 languages. Run against Internet Explorer, Mozilla and Firefox on Windows, Linux and Mac. For browser compatability testing and system functional testing.

PesterCat -Low cost web functional testing tool from PesterCat LLC.Features include recording and playback of HTTP web requests, XML format for saved scripts, HTTP response validations, perform backend database validations or call procedures, use variables and variable setters to make scripts dynamic, automate test scripts with Ant tasks to run scripts and generate reports. Requires Java JRE; for Linux, Mac OSX, and Windows.

IeUnit -IeUnit is an open-source simple framework to test logical behaviors of web pages, released under IBM's Common Public License.It helps users to create, organize and execute functional unit tests. Includes a test runner with GUI interface. Implemented in JavaScript for the Windows XP platform with Internet Explorer.

QEngine Web Test Studio -Automated testing tool from AdventNet for functional testing of web applications and web services. For Linux anx Windows. Records and plays in IE, Mozilla, and Firefox browsers.

AppPerfect DevSuite -Suite of testing, tuning, and monitoring products from AppPerfect Corp. that includes a web functional testing module. Records browser interaction by element instead of screen co-ordinates. Supports handling dynamic content created by JavaScript; supports ASP, JSP, HTML, cookies, SSL. For Windows and MSIE; integrates with a variety of IDE's.

JStudio SiteWalker -Test tool from Jarsch Software Studio allows capture/replay recording;fail definitions can be specified for each step of the automated workflow via JavaScript. JavaScript's Document Object Model enables full access to all document elements. Test data from any database or Excel spreadsheet can be mapped to enter values automatically into HTML form controls. HTML-based test result reports can be generated. Shareware for Windows/MSIE.

Test Complete Enterprise -Automated test tool from AutomatedQA Corp. for testing of web applicatons as well as Windows, .NET, and Java applications.Includes capabilities for automated functional, unit, regression, manual, data-driven, object-driven, distributed and HTTP load, stress and scalability testing. RequiresWindows and MSIE.

actiWate -Java-based Web application testing environment from Actimind Inc. Advanced framework for writing test scripts in Java (similar to open-source frameworks like HttpUnit, HtmlUnit etc. but with extended API), and Test Writing Assistant - Web browser plug-in module to assist the test writing process. Freeware.

WebInject -Open source tool in PERL for automated testing of web applications and services. Can be used to unit test any individual component with an HTTP interface (JSP, ASP, CGI, PHP, servlets, HTML forms, etc.)or it can be used to create a suite of HTTP level functional or regression tests.

jWebUnit -Open source Java framework that facilitates creation of acceptance tests for web applications. Provides a high-level API for navigating a web application combined with a set of assertions to verify the application's correctness including navigation via links, form entry and submission, validation of table contents, and other typical business web application features. Utilizes HttpUnit behind the scenes. The simple navigation methods and ready-to-use assertions allow for more rapid test creation than using only JUnit and HttpUnit.

SimpleTest -Open source unit testing framework which aims to be a complete PHP developer test solution. Includes all of the typical functions that would be expected from JUnit and the PHPUnit ports, but also adds mock objects; has some JWebUnit functionality as well. This includes web page navigation, cookie testing and form submission.

WinTask -Macro recorder from TaskWare, automates repetitive tasks for Web site testing (and standard Windows applications), with its HTML objects recognition. Includes capability to expand scope of macros by editing and adding loops, branchingstatements, etc. (300+ commands); ensure robustness of scripts with Synchronization commands. Includes a WinTask Scheduler.

Canoo WebTest -Free Java Open Source tool for automatic functional testing of web applications. XML-based test script code is editable with user's preferred XML editor; until recordingcapabilities are added, scripts have to be developed manually. Can group tests into a testsuite that again can be part of a bigger testsuite. Test results are reported in either plain text or XML format for later presentation via XSLT. Standard reporting XSLT stylesheets included, and can be adapted to any reporting style or requirements.

TestSmith - Functional/Regression test tool from Quality Forge. Includes an Intelligent, HTML/DOM-Aware and Object Mode Recording Engine, and a Data-Driven, Adaptable and Multi-Threaded Playback Engine. Handles Applets, Flash, Active-X controls, animated bitmaps, etc. Controls are recorded as individual objects independent of screen positions or resolution; playback window/size can be different than in capture. Special validation points, such as bitmap or text matching, can be inserted during a recording, but all recorded items are validated and logged 'on the fly'. Fuzzy matching capabilities. Editable scripts can be recorded in SmithSript language or in Java, C++ or C++/MFC.

TestAgent -Capture/playback tool for user acceptance testing from Strenuus, LLC. Key features besides capture/playback include automatically detecting and capturing standard and custom content errors. Reports information needed to troubleshoot problems. Enables 'Persistent Acceptance Testing' that activates tests each time a web application is used.

MITS.GUI - Unique test automation tool from Omsphere LLC; has an intelligent state machine engine that makes real-time decisionsfor navigating through the GUI portion of an application. It cantest thousands of test scenarios without use of any scripts. Allows creation of completely new test scenarios without ever having performed that test before, all without changing tool, testware architecture (object names, screen names, etc), or logic associated with the engine. Testers enter test data into a spreadsheet used to populate objects that appear for the particular test scenario defined.

Badboy - Tool from Bradley Software to aid in building and testing dynamic web based applications. Combines sophisticated capture/replay ability with performance testing and regression features. Free for most uses; source code avalable.

SAMIE - Free tool designed for QA engineers - 'Simple Automated Module For Internet Explorer'. Perl module that allows a user to automate use of IE via Perl scripts; Written in ActivePerl, allowing inheritance of all Perl functionality including regular expressions, Perl dbi database access, many Perl cpan library functions. Uses IE's built in COM object which provides a reference to the DOM for each browser window or frame. Easy development and maintenance - no need to keep track of GUI maps for each window. For Windows.

PAMIE - Free open-source 'Python Automated Module For Internet Explorer'Allows control of an instance of MSIE and access to it's methods though OLE automation . Utilizes Collections, Methods, Events and Properties exposed by the DHTML Object Model.

PureTest - Free tool from Minq Software AB, includes an HTTP Recorder and Web Crawler. Create scenarios using the point and click interface. Includes a scenario debugger including single step, break points and response introspection. Supports HTTPS/SSL, dynamic Web applications, data driven scenarios, and parsing of response codes or parsing page content for expected or unexpected strings. Includes a Task API for building custom test tasks. The Web Crawler is useful for verifying consistency of a static web structure, reporting various metrics, broken links and the structure of the crawled web. Multi-platform - written in Java.

Solex - Web application testing tool built as a plug-in for the Eclipse IDE (an open, extensibleIDE). Records HTTP messages by acting as a Web proxy; recorded sessionscan be saved as XML and reopened later. HTTP requests and responses are fully displayed in order to inspect and customize their content. Allows the attachment of extraction or replacement rules to any HTTP message content, and assertions to responses in order to validate a scenario during its playback.

QA Wizard -Automated functional test tool for web and windows applications from Seapine Software. Advanced object binding reduces script changes when Web-based apps change. Next-generation scripting language eliminates problems created by syntax or other language errors. Includes capability for automated scripting, allowing creation of more scripts in less time. Supports unlimited set of ODBC-compatible data sources as well as MS Excel, tab/comma delimited file formats, and more. Free Demo and Test Script available. For Windows platforms.

HttpUnit -Open source Java program for accessing web sites without a browser, from SourceForge.net/Open Source Development Network, designed and implemented by Russell Gold. Ideally suited for automated unit testing of web sites when combined with a Java unit test framework such as JUnit.Emulates the relevant portions of browser behavior, including form submission, basic http authentication, cookies and automatic page redirection, and allows Java test code to examine returned pages as text, an XML DOM, or containers of forms, tables, and links. IncludesServletUnit to test servlets without a servlet container.

iOpus Internet Macros -Macro recorder utility from iOpus Inc. automates repetitious aspects of web site testing. Records any combination of browsing, form filling, clicking, script testing and information gathering; assists user during the recording with visual feedback. Power users can manually edit a recorded macro. A command line interface allows for easy integration with other test software. Works by remote controlling the browser, thus automatically supports advanced features such as SSL, HTTP-Redirects and cookies. Can handle data input from text files, databases, or XML. Can extract web data and save as CSV file or process the data via a script. For Windows and MSIE.

MaxQ -Free open-source web functional testing tool from Tigris.org,written in Java. Works as a proxy server; includes an HTTP proxy recorder to automate test script generation, and a mechanism for playing tests back from the GUI and command line. Jython is used as the scripting language, and JUnit is used as the testing library.

TestDrive-Gold - Test tool from Original Software Group Ltd. utilizes a new approach to recording/playback of web browser scripts. It analyses the underlying intentions of the script and executes it by direct communication with web page elements. IntelliScripting logic removes the reliance on specific browser window sizes, component location and mouse movements for accurate replay, and for easier script maintenance; supports hyperlinks targeted at new instances of browser. Playback can run in background while other tasks are performed on thesame machine.

Compuware TestPartner -Automated software testing tool from Compuware designed specifically to validate Windows, Java, and web-based applications. The 'TestPartner Visual Navigator' can create visual-based tests, or MS VBA can be used for customized scripting.

WebKing -Web site functional, load, and static analysis test suite from ParaSoft. Maps and tests all possible paths through a dynamic site; can enforce over 200 HTML, CSS, JavaScript, 508 compliance, WML and XHTML codingstandards or customized standards. Allows creation of rules for automatic monitoring of dynamic page content. Can run load tests based on the tool's analysis of web server log files. For Windows, Linux, Solaris.

eValid -Web functional test tool from Software Research Inc. Browser-centric view simplifies test recording and editing, and replays user activity with accuracy by combining browser-internal data, timers, event counters,and direct DOM access. Can be used for AJAX-based web development methodologies.The built-in test suite management system eV.Manager controls test suite structure, runs tests automatically, records detailed logs and pass/fail statistics, and can handle hundreds of thousands of tests.

Rational Functional Tester -IBM's (formerly Rational's) automated tool for testing of Java,.NET, and web-based applications. Enables data-driven testing, choice of scripting languages and editors. For Windows and Linux.

QuickTest Pro -Functional/regression test tool from HP (formerly Mercury); keyword-driven; includes support for testing Web, Java, ERP, etc.

QA Center Test Partner -Functional/regression tool from Compuware for testing of web, Java, and otherapplications. Handles ActiveX, HTML, DHTML, XML, Java beans, and more.

SilkTest - Functional test tool from Borland (formerly Segue) for Web, Java or traditional client/server-based applications. Features include: test creation and customization, test planning and management, direct database access and validation, recovery system for unattended testing, and IDE for developing, editing, compiling, running, and debuggingscripts, test plans, etc.