Open-source testRigor alternatives

Playwright is an open-source framework for testing and automating web applications. A single API drives Chromium, Firefox and WebKit, so the same script or test can cover all three engines. It is used for end-to-end testing, for scripted browser tasks and, increasingly, as a tool that AI agents call to operate a browser.

The bundled Playwright Test runner executes tests in parallel with a fresh browser context per test, which gives isolation without the cost of launching a new browser. Locators mirror how users see the page, actions wait automatically until elements are ready, and assertions retry until they pass. Failures can be investigated with traces that capture screenshots, DOM snapshots, network requests and console output in a Trace Viewer.

Beyond the test runner there is a standalone library for scripts, a CLI aimed at coding agents, an MCP server for LLM-driven automation and a VS Code extension. The code is Apache-2.0 licensed and runs on your own machines and CI servers, with no hosted service required.

Robot Framework is a generic open-source framework for test automation and robotic process automation. Test cases and tasks are written with readable, keyword-based syntax, so people who are not programmers can follow what an automated scenario does, and the same approach covers acceptance testing and RPA.

Functionality is extended through libraries written in Python, Java and other languages, and a rich ecosystem of hundreds of third-party libraries covers web, API, mobile and other automation needs. The Robot Framework Foundation supports the project, and the website provides a user guide, standard library documentation, community events, workshops and a certification program.

The framework is released under the Apache-2.0 licence, written in Python, and used without licensing fees. You install it into your own Python environment and run it locally or in CI, so there is no server to host. It suits QA teams practicing acceptance test-driven or behavior-driven development and teams automating repetitive business processes.

Shortest is an AI-powered end-to-end testing framework in which tests are written in natural language. Test execution is handled by the Anthropic Claude API, and the browser automation underneath is Playwright. It is released under the MIT license and maintained by the Antiwork team.

The project adds integrations for common testing hurdles, including GitHub login with two-factor authentication and email validation with Mailosaur. A shortest init command streamlines setup in a new or existing project by installing the package as a development dependency, creating a default shortest.config.ts file, and generating a .env.local file.

Shortest is written in TypeScript and works in Next.js and other JavaScript projects. It suits development teams who want to describe user flows in plain language rather than maintain brittle selectors, and who accept the cost and variability of calling a language model API during test runs.

Magnitude is a browser agent that uses vision AI so you can control a browser with natural language. It navigates by looking at the interface and planning actions, interacts with precise mouse and keyboard actions, extracts structured data, and verifies results with a built-in test runner that supports visual assertions.

Rather than drawing numbered boxes around page elements, which the authors say generalizes poorly on complex modern sites, it has a visually grounded model give pixel coordinates, making it independent of the page's DOM structure and extendable to desktop apps or virtual machines. It can be used to automate web tasks, integrate apps that have no APIs, extract data, test web apps or build other browser agents. The README reports a 94% score on the WebVoyager benchmark.

Magnitude needs a large visually grounded model; Claude Sonnet 4 is recommended and Qwen-2.5VL 72B is also compatible. A setup command creates a project with an example script, and the test runner adds a tests directory with a configuration file and example test. It is written in TypeScript and licensed under Apache-2.0.