10 open-source alternatives ranked by real activity

Open-source testRigor alternatives

A curated, ranked list of the 10 best open-source alternatives to testRigor.

The best open-source alternative to testRigor is Playwright. If that doesn't suit you, other good options are Appium, Robot Framework, WebdriverIO and TestCafe.

Commercial alternatives to testRigor include Testim, mabl, Testsigma and Virtuoso QA. See all 18.

testRigor alternatives are mainly testing & QA tools, but some are also project management tools. 7 of them shipped code in the last 30 days, 10 can be self-hosted, and 10 use a permissive licence.

Last updated November 13, 2026 · ranked by GitHub stars, growth and recent commits

Playwright

A framework from Microsoft for end-to-end web testing and browser automation across Chromium, Firefox and WebKit using one API.

GitHub stars
100k
Last commit
today
Latest release
v1.65.0
Licence
Apache-2.0
Self-hosted
Yes
playwright.devPlaywright homepage screenshot

Playwright is an open-source framework for testing and automating web applications. A single API drives Chromium, Firefox and WebKit, so the same script or test can cover all three engines. It is used for end-to-end testing, for scripted browser tasks and, increasingly, as a tool that AI agents call to operate a browser.

The bundled Playwright Test runner executes tests in parallel with a fresh browser context per test, which gives isolation without the cost of launching a new browser. Locators mirror how users see the page, actions wait automatically until elements are ready, and assertions retry until they pass. Failures can be investigated with traces that capture screenshots, DOM snapshots, network requests and console output in a Trace Viewer.

Beyond the test runner there is a standalone library for scripts, a CLI aimed at coding agents, an MCP server for LLM-driven automation and a VS Code extension. The code is Apache-2.0 licensed and runs on your own machines and CI servers, with no hosted service required.

Key features

  • One API for Chromium, Firefox and WebKit
  • Auto-waiting actions and retrying assertions
  • Parallel tests with isolated browser contexts
  • Trace Viewer with DOM snapshots and network logs
  • Locators that mirror how users see pages
  • MCP server and CLI for AI agents
  • VS Code extension for authoring tests

Pricing: Free and open source under the Apache-2.0 license.

Appium

A modular, WebDriver-based automation framework for testing native, hybrid, mobile web and desktop apps across platforms, extended through drivers, clients and plugins.

GitHub stars
22k
Last commit
yesterday
Latest release
@appium/opencv@5.0.2
Licence
Apache-2.0
Self-hosted
Yes
appium.ioAppium homepage screenshot

Appium is an open-source framework for automating apps on mobile, desktop and IoT platforms. It builds on the W3C WebDriver protocol, which means tests are written against a standard interface and can drive native apps, hybrid apps, mobile web and desktop software on Android, iOS, Windows, macOS and more.

Its architecture is modular and extensible. Drivers add support for automating particular platforms, clients let you write tests in the programming language of your choice, and plugins extend the core behavior. That gives rise to a broad ecosystem of related software around the core server. Appium is installed with npm, and the documentation covers system requirements for each platform.

The team supports only the latest version, so anyone on an older major release is directed to migration guides covering the v1 to v2 and v2 to v3 transitions. Appium is written in TypeScript under the Apache-2.0 license and runs on your own machines, build servers or device farms. It is a standard choice for QA engineers and developers who need cross-platform mobile test automation.

Key features

  • Automates native, hybrid and mobile web apps
  • Desktop and IoT platform support
  • Built on the W3C WebDriver protocol
  • Drivers for individual platforms
  • Test clients in multiple languages
  • Plugin system for extending behavior

Pricing: Free and open source under the Apache-2.0 license.

Read more about AppiumWebsiteGitHub#2 testRigor alternative

Robot Framework

An open-source automation framework for acceptance testing and robotic process automation, using human-readable keyword syntax that can be extended in Python or Java.

GitHub stars
12k
Last commit
2 days ago
Latest release
v7.5.1
Licence
Apache-2.0
robotframework.orgRobot Framework homepage screenshot

Robot Framework is a generic open-source framework for test automation and robotic process automation. Test cases and tasks are written with readable, keyword-based syntax, so people who are not programmers can follow what an automated scenario does, and the same approach covers acceptance testing and RPA.

Functionality is extended through libraries written in Python, Java and other languages, and a rich ecosystem of hundreds of third-party libraries covers web, API, mobile and other automation needs. The Robot Framework Foundation supports the project, and the website provides a user guide, standard library documentation, community events, workshops and a certification program.

The framework is released under the Apache-2.0 licence, written in Python, and used without licensing fees. You install it into your own Python environment and run it locally or in CI, so there is no server to host. It suits QA teams practicing acceptance test-driven or behavior-driven development and teams automating repetitive business processes.

Key features

  • Human-readable keyword-driven syntax
  • Acceptance testing and RPA in one tool
  • Extensible with Python and Java libraries
  • Standard library of common keywords
  • Hundreds of third-party libraries
  • Reports and logs for test runs

Pricing: Free and open source under the Apache-2.0 licence, with no licensing fees.

WebdriverIO

WebdriverIO is a Node.js test automation framework for browser and mobile apps, supporting end-to-end, unit and component tests via WebDriver, BiDi and Appium.

GitHub stars
9.9k
Last commit
yesterday
Latest release
v10.2.0
Licence
MIT
webdriver.ioWebdriverIO homepage screenshot

This entry covers WebdriverIO, a modern test automation framework that drives browsers and mobile apps from Node.js. It is used for end-to-end tests as well as unit and component tests in the browser, and runs tests based on the WebDriver and WebDriver BiDi protocols and on Appium automation technology.

It works with popular test frameworks for BDD and TDD, such as Mocha, Jasmine and Cucumber, and can run tests locally or in the cloud on services including Sauce Labs, BrowserStack, TestingBot and TestMu AI, formerly LambdaTest. The project provides a developer guide, API reference, changelog and roadmap, and contributors can start in a prepared dev container using GitHub Codespaces or Gitpod.

WebdriverIO is written in TypeScript and licensed under MIT. It is installed as a development dependency in a JavaScript or TypeScript project, so there is nothing to host. Commercial support is available through a Tidelift subscription. It suits QA engineers and front-end teams who want one framework for web and mobile test automation.

Key features

  • End-to-end, unit and component testing
  • WebDriver and WebDriver BiDi support
  • Appium integration for mobile apps
  • Works with Mocha, Jasmine and Cucumber
  • Local runs or cloud device providers
  • Written in TypeScript for Node.js

Pricing: Free and open source under the MIT licence; commercial support is available through Tidelift.

TestCafe

TestCafe is a free, open-source end-to-end testing framework that runs JavaScript and TypeScript tests in real browsers.

GitHub stars
9.9k
Last commit
2 days ago
Latest release
v3.7.7
Licence
MIT
testcafe.ioTestCafe homepage screenshot

TestCafe is an end-to-end testing solution installed as a single npm package. Tests are written in JavaScript or TypeScript, either by hand or recorded in the browser, and can simulate complex page interactions and multi-window scenarios.

Tests run in any modern browser, local or remote, and can run concurrently to speed things up. A Docker image is available for CI/CD pipelines, and results can be stored as reports in several formats. Running a test is a single command such as testcafe chrome test.js.

The open-source library covers creating, running and reviewing tests. Paid products sit alongside it: TestCafe Studio, a desktop application that speeds up test creation, and subscription plans that add run logs, flaky test detection, parallelization and screenshot and video storage.

Key features

  • Installs as one npm package
  • Runs in common browsers out of the box
  • Docker image for CI/CD pipelines
  • JavaScript and TypeScript tests for complex interactions
  • Write tests by hand or record them
  • Concurrent test runs
  • Reports in several formats

Pricing: Personal is $20 /month (first 60 days free) with 3 users and 7,500 test runs. Team is $50 /month (first 60 days free) with 20 users and 50,000 test runs. Enterprise is priced by contacting the vendor.

Cucumber Js

The JavaScript implementation of Cucumber, which runs automated acceptance tests written in plain language on Node.js.

GitHub stars
5.4k
Last commit
yesterday
Latest release
v13.3.0
Licence
MIT
cucumber.ioCucumber Js homepage screenshot

Cucumber JS is the JavaScript version of Cucumber, a tool for running automated acceptance tests. The tests are specifications written in Gherkin, a set of grammar rules that gives plain text enough structure for Cucumber to read. Because the text is readable by anyone on a team, the project presents it as a way to improve communication, collaboration and trust.

Each specification is a feature file made of scenarios, and each scenario is a list of steps. Step definitions written in JavaScript connect those steps to the code under test. A run reports success or failure for every scenario. The repository's example has a feature file in a features folder and steps in features/support/steps.js, started with the cucumber-js command.

The package is published on npm as @cucumber/cucumber and runs on maintained versions of Node.js. The documentation also covers configuration profiles, formatters, parallel running, sharding across machines, retrying flaky scenarios, rerunning only failures and a JavaScript API for running programmatically. The code is MIT licensed.

Key features

  • Runs automated tests written in plain language
  • Installs from npm as @cucumber/cucumber
  • Gherkin gives plain text a structure Cucumber can read
  • Step definitions connect Gherkin steps to code
  • Reports success or failure for each scenario
  • Parallel running, sharding and rerunning failures
  • Formatters, filtering and a programmatic JavaScript API
  • Transpiling support, for example from TypeScript

Gauge

A free, open-source test automation framework for acceptance testing, with specifications written in Markdown.

GitHub stars
3.2k
Last commit
4 days ago
Latest release
v1.6.43
Licence
Apache-2.0
gauge.orgGauge homepage screenshot

Gauge is a free and open source test automation framework built for acceptance testing. Tests are written as specifications in Markdown, and the project says that reusing specifications and refactoring support reduce duplication and keep the suite readable and easier to maintain.

It works with several languages (JavaScript, C#, Java, Python and Ruby) and with various CI/CD tools and automation drivers, so teams do not need to learn a new language. A plugin architecture covers IDEs, drivers, data sources, test execution events and further languages. Taiko is promoted as a companion for browser automation in JavaScript tests.

When a test fails, Gauge takes a screenshot, and reports are produced in XML, JSON and HTML. Parallel execution is supported out of the box, and data-driven testing keeps data sets outside the test scripts so one specification can run against many sets of data.

Key features

  • Tests written in Markdown
  • Works with multiple languages and CI/CD tools
  • Plugin architecture and ecosystem
  • Screenshot captured on test failure
  • XML, JSON and HTML reports
  • Built-in parallel test execution
  • Data-driven testing with external data sets
Read more about GaugeWebsiteGitHub#7 testRigor alternative

Nightwatch

An integrated end-to-end testing framework written in Node.js using the W3C Webdriver API.

GitHub stars
12k
Last commit
5 mo ago
Latest release
v3.16.0
Licence
MIT
nightwatchjs.orgNightwatch homepage screenshot

Nightwatch is an end-to-end testing framework built with Node.js that uses the W3C WebDriver API. It supports testing across web and native mobile applications, including real desktop browsers, mobile web, and native iOS and Android apps.

The framework provides debugging tools such as a built-in HTML reporter with test statuses and HTTP logs, DOM history before and after commands, and a REPL interface for pausing and debugging. It also offers default parallelization, cloud grid support, and the ability to handle complex gestures and interactions.

Key features

  • Supports web, mobile web, and native mobile testing
  • Built-in HTML reporter with test statuses and HTTP logs
  • DOM history before and after every command
  • REPL interface for pausing and debugging
  • Default parallelization and orchestration
  • Cloud grid support with third-party grids like BrowserStack

Shortest

Natural-language end-to-end testing framework built on Playwright that uses the Anthropic Claude API to run tests written in plain English.

GitHub stars
5.7k
Last commit
3 mo ago
Latest release
v0.4.9
Licence
MIT
shortest.comShortest homepage screenshot

Shortest is an AI-powered end-to-end testing framework in which tests are written in natural language. Test execution is handled by the Anthropic Claude API, and the browser automation underneath is Playwright. It is released under the MIT license and maintained by the Antiwork team.

The project adds integrations for common testing hurdles, including GitHub login with two-factor authentication and email validation with Mailosaur. A shortest init command streamlines setup in a new or existing project by installing the package as a development dependency, creating a default shortest.config.ts file, and generating a .env.local file.

Shortest is written in TypeScript and works in Next.js and other JavaScript projects. It suits development teams who want to describe user flows in plain language rather than maintain brittle selectors, and who accept the cost and variability of calling a language model API during test runs.

Key features

  • Tests written in plain English
  • AI-driven execution with the Claude API
  • Built on Playwright
  • GitHub login with 2FA support
  • Email validation through Mailosaur
  • Setup command that generates config files

Pricing: Standard costs $10 per user per month after a 14-day free trial; Enterprise is quoted through sales.

Magnitude

Magnitude is an open-source, vision-first browser agent that controls web pages from natural language and includes a test runner with visual assertions.

GitHub stars
4.1k
Last commit
9 mo ago
Latest release
magnitude-core@0.3.1
Licence
Apache-2.0
magnitude.runMagnitude homepage screenshot

Magnitude is a browser agent that uses vision AI so you can control a browser with natural language. It navigates by looking at the interface and planning actions, interacts with precise mouse and keyboard actions, extracts structured data, and verifies results with a built-in test runner that supports visual assertions.

Rather than drawing numbered boxes around page elements, which the authors say generalizes poorly on complex modern sites, it has a visually grounded model give pixel coordinates, making it independent of the page's DOM structure and extendable to desktop apps or virtual machines. It can be used to automate web tasks, integrate apps that have no APIs, extract data, test web apps or build other browser agents. The README reports a 94% score on the WebVoyager benchmark.

Magnitude needs a large visually grounded model; Claude Sonnet 4 is recommended and Qwen-2.5VL 72B is also compatible. A setup command creates a project with an example script, and the test runner adds a tests directory with a configuration file and example test. It is written in TypeScript and licensed under Apache-2.0.

Key features

  • Natural-language browser control
  • Vision-first element targeting by coordinates
  • Structured data extraction
  • Test runner with visual assertions
  • Setup command with example script
  • Works with Claude and Qwen vision models

Pricing: Free and open source under the Apache-2.0 license; requires access to a vision-capable model.

Commercial testRigor alternatives

Hosted, closed-source products that compete with testRigor. Showing 12 of 18.

See every testRigor alternative on its tool page

testRigor alternatives: questions

What is the best open-source alternative to testRigor?
Playwright is the top-ranked open-source alternative to testRigor on Enlisted: A framework from Microsoft for end-to-end web testing and browser automation across Chromium, Firefox and WebKit using one API. Other strong options are Appium, Robot Framework, WebdriverIO and TestCafe.
What are the best commercial alternatives to testRigor?
Testim, mabl, Testsigma, Virtuoso QA and Functionize are among the hosted, closed-source alternatives to testRigor listed on Enlisted, which lists 18 in total. Compare their pricing and features on each tool page.
Are these testRigor alternatives free?
All 10 are open source, so the code is free to use under its licence, and all of them can be self-hosted on your own server or computer.
How is this list of testRigor alternatives ranked?
By a score built from GitHub stars, star growth over the last 30 days and how recently the code changed. 7 of these projects shipped code in the last 30 days. Data is refreshed daily, and nobody can pay to move up.

People also look for alternatives to…

View all