#1
A framework from Microsoft for end-to-end web testing and browser automation across Chromium, Firefox and WebKit using one API.
- GitHub stars
- 100k
- Last commit
- today
- Latest release
- v1.65.0
- Licence
- Apache-2.0
- Self-hosted
- Yes
playwright.dev
Playwright is an open-source framework for testing and automating web applications. A single API drives Chromium, Firefox and WebKit, so the same script or test can cover all three engines. It is used for end-to-end testing, for scripted browser tasks and, increasingly, as a tool that AI agents call to operate a browser.
The bundled Playwright Test runner executes tests in parallel with a fresh browser context per test, which gives isolation without the cost of launching a new browser. Locators mirror how users see the page, actions wait automatically until elements are ready, and assertions retry until they pass. Failures can be investigated with traces that capture screenshots, DOM snapshots, network requests and console output in a Trace Viewer.
Beyond the test runner there is a standalone library for scripts, a CLI aimed at coding agents, an MCP server for LLM-driven automation and a VS Code extension. The code is Apache-2.0 licensed and runs on your own machines and CI servers, with no hosted service required.
Key features
- One API for Chromium, Firefox and WebKit
- Auto-waiting actions and retrying assertions
- Parallel tests with isolated browser contexts
- Trace Viewer with DOM snapshots and network logs
- Locators that mirror how users see pages
- MCP server and CLI for AI agents
- VS Code extension for authoring tests
Pricing: Free and open source under the Apache-2.0 license.
#2
Jest is a JavaScript testing framework with snapshots, mocking and code coverage that aims to work with little configuration.
- GitHub stars
- 45k
- Last commit
- yesterday
- Latest release
- v30.5.2
- Licence
- MIT
jestjs.io
Jest is a JavaScript testing framework that describes its focus as simplicity. It works with projects using Babel, TypeScript, Node, React, Angular, Vue and more, and aims to run without configuration on most JavaScript projects. Tests are run in parallel, each in its own process.
The toolkit covers assertions, mock functions, snapshot tests and code coverage in one place. Snapshots can sit beside the tests or inline, and coverage is switched on with a single flag. Jest is supported through Open Collective and is part of the OpenJS Foundation, and the site shows version 30.5 as current alongside the documentation for many earlier versions.
Key features
- Works with common JavaScript toolchains
- Config-free setup on most projects
- Snapshot tests kept beside tests or inline
- Tests parallelised in separate processes
- Code coverage via a flag
- Mocking through a custom module resolver
- Previously failed tests run first
#3
A modular, WebDriver-based automation framework for testing native, hybrid, mobile web and desktop apps across platforms, extended through drivers, clients and plugins.
- GitHub stars
- 22k
- Last commit
- yesterday
- Latest release
- @appium/opencv@5.0.2
- Licence
- Apache-2.0
- Self-hosted
- Yes
appium.io
Appium is an open-source framework for automating apps on mobile, desktop and IoT platforms. It builds on the W3C WebDriver protocol, which means tests are written against a standard interface and can drive native apps, hybrid apps, mobile web and desktop software on Android, iOS, Windows, macOS and more.
Its architecture is modular and extensible. Drivers add support for automating particular platforms, clients let you write tests in the programming language of your choice, and plugins extend the core behavior. That gives rise to a broad ecosystem of related software around the core server. Appium is installed with npm, and the documentation covers system requirements for each platform.
The team supports only the latest version, so anyone on an older major release is directed to migration guides covering the v1 to v2 and v2 to v3 transitions. Appium is written in TypeScript under the Apache-2.0 license and runs on your own machines, build servers or device farms. It is a standard choice for QA engineers and developers who need cross-platform mobile test automation.
Key features
- Automates native, hybrid and mobile web apps
- Desktop and IoT platform support
- Built on the W3C WebDriver protocol
- Drivers for individual platforms
- Test clients in multiple languages
- Plugin system for extending behavior
Pricing: Free and open source under the Apache-2.0 license.
#4
An open-source automation framework for acceptance testing and robotic process automation, using human-readable keyword syntax that can be extended in Python or Java.
- GitHub stars
- 12k
- Last commit
- 2 days ago
- Latest release
- v7.5.1
- Licence
- Apache-2.0
robotframework.org
Robot Framework is a generic open-source framework for test automation and robotic process automation. Test cases and tasks are written with readable, keyword-based syntax, so people who are not programmers can follow what an automated scenario does, and the same approach covers acceptance testing and RPA.
Functionality is extended through libraries written in Python, Java and other languages, and a rich ecosystem of hundreds of third-party libraries covers web, API, mobile and other automation needs. The Robot Framework Foundation supports the project, and the website provides a user guide, standard library documentation, community events, workshops and a certification program.
The framework is released under the Apache-2.0 licence, written in Python, and used without licensing fees. You install it into your own Python environment and run it locally or in CI, so there is no server to host. It suits QA teams practicing acceptance test-driven or behavior-driven development and teams automating repetitive business processes.
Key features
- Human-readable keyword-driven syntax
- Acceptance testing and RPA in one tool
- Extensible with Python and Java libraries
- Standard library of common keywords
- Hundreds of third-party libraries
- Reports and logs for test runs
Pricing: Free and open source under the Apache-2.0 licence, with no licensing fees.
#5
WebdriverIO is a Node.js test automation framework for browser and mobile apps, supporting end-to-end, unit and component tests via WebDriver, BiDi and Appium.
- GitHub stars
- 9.9k
- Last commit
- yesterday
- Latest release
- v10.2.0
- Licence
- MIT
webdriver.io
This entry covers WebdriverIO, a modern test automation framework that drives browsers and mobile apps from Node.js. It is used for end-to-end tests as well as unit and component tests in the browser, and runs tests based on the WebDriver and WebDriver BiDi protocols and on Appium automation technology.
It works with popular test frameworks for BDD and TDD, such as Mocha, Jasmine and Cucumber, and can run tests locally or in the cloud on services including Sauce Labs, BrowserStack, TestingBot and TestMu AI, formerly LambdaTest. The project provides a developer guide, API reference, changelog and roadmap, and contributors can start in a prepared dev container using GitHub Codespaces or Gitpod.
WebdriverIO is written in TypeScript and licensed under MIT. It is installed as a development dependency in a JavaScript or TypeScript project, so there is nothing to host. Commercial support is available through a Tidelift subscription. It suits QA engineers and front-end teams who want one framework for web and mobile test automation.
Key features
- End-to-end, unit and component testing
- WebDriver and WebDriver BiDi support
- Appium integration for mobile apps
- Works with Mocha, Jasmine and Cucumber
- Local runs or cloud device providers
- Written in TypeScript for Node.js
Pricing: Free and open source under the MIT licence; commercial support is available through Tidelift.
#6
TestCafe is a free, open-source end-to-end testing framework that runs JavaScript and TypeScript tests in real browsers.
- GitHub stars
- 9.9k
- Last commit
- 2 days ago
- Latest release
- v3.7.7
- Licence
- MIT
testcafe.io
TestCafe is an end-to-end testing solution installed as a single npm package. Tests are written in JavaScript or TypeScript, either by hand or recorded in the browser, and can simulate complex page interactions and multi-window scenarios.
Tests run in any modern browser, local or remote, and can run concurrently to speed things up. A Docker image is available for CI/CD pipelines, and results can be stored as reports in several formats. Running a test is a single command such as testcafe chrome test.js.
The open-source library covers creating, running and reviewing tests. Paid products sit alongside it: TestCafe Studio, a desktop application that speeds up test creation, and subscription plans that add run logs, flaky test detection, parallelization and screenshot and video storage.
Key features
- Installs as one npm package
- Runs in common browsers out of the box
- Docker image for CI/CD pipelines
- JavaScript and TypeScript tests for complex interactions
- Write tests by hand or record them
- Concurrent test runs
- Reports in several formats
Pricing: Personal is $20 /month (first 60 days free) with 3 users and 7,500 test runs. Team is $50 /month (first 60 days free) with 20 users and 50,000 test runs. Enterprise is priced by contacting the vendor.
#7
An integrated end-to-end testing framework written in Node.js using the W3C Webdriver API.
- GitHub stars
- 12k
- Last commit
- 5 mo ago
- Latest release
- v3.16.0
- Licence
- MIT
nightwatchjs.org
Nightwatch is an end-to-end testing framework built with Node.js that uses the W3C WebDriver API. It supports testing across web and native mobile applications, including real desktop browsers, mobile web, and native iOS and Android apps.
The framework provides debugging tools such as a built-in HTML reporter with test statuses and HTTP logs, DOM history before and after commands, and a REPL interface for pausing and debugging. It also offers default parallelization, cloud grid support, and the ability to handle complex gestures and interactions.
Key features
- Supports web, mobile web, and native mobile testing
- Built-in HTML reporter with test statuses and HTTP logs
- DOM history before and after every command
- REPL interface for pausing and debugging
- Default parallelization and orchestration
- Cloud grid support with third-party grids like BrowserStack
#8
Natural-language end-to-end testing framework built on Playwright that uses the Anthropic Claude API to run tests written in plain English.
- GitHub stars
- 5.7k
- Last commit
- 3 mo ago
- Latest release
- v0.4.9
- Licence
- MIT
shortest.com
Shortest is an AI-powered end-to-end testing framework in which tests are written in natural language. Test execution is handled by the Anthropic Claude API, and the browser automation underneath is Playwright. It is released under the MIT license and maintained by the Antiwork team.
The project adds integrations for common testing hurdles, including GitHub login with two-factor authentication and email validation with Mailosaur. A shortest init command streamlines setup in a new or existing project by installing the package as a development dependency, creating a default shortest.config.ts file, and generating a .env.local file.
Shortest is written in TypeScript and works in Next.js and other JavaScript projects. It suits development teams who want to describe user flows in plain language rather than maintain brittle selectors, and who accept the cost and variability of calling a language model API during test runs.
Key features
- Tests written in plain English
- AI-driven execution with the Claude API
- Built on Playwright
- GitHub login with 2FA support
- Email validation through Mailosaur
- Setup command that generates config files
Pricing: Standard costs $10 per user per month after a 14-day free trial; Enterprise is quoted through sales.
#9
Magnitude is an open-source, vision-first browser agent that controls web pages from natural language and includes a test runner with visual assertions.
- GitHub stars
- 4.1k
- Last commit
- 9 mo ago
- Latest release
- magnitude-core@0.3.1
- Licence
- Apache-2.0
magnitude.run
Magnitude is a browser agent that uses vision AI so you can control a browser with natural language. It navigates by looking at the interface and planning actions, interacts with precise mouse and keyboard actions, extracts structured data, and verifies results with a built-in test runner that supports visual assertions.
Rather than drawing numbered boxes around page elements, which the authors say generalizes poorly on complex modern sites, it has a visually grounded model give pixel coordinates, making it independent of the page's DOM structure and extendable to desktop apps or virtual machines. It can be used to automate web tasks, integrate apps that have no APIs, extract data, test web apps or build other browser agents. The README reports a 94% score on the WebVoyager benchmark.
Magnitude needs a large visually grounded model; Claude Sonnet 4 is recommended and Qwen-2.5VL 72B is also compatible. A setup command creates a project with an example script, and the test runner adds a tests directory with a configuration file and example test. It is written in TypeScript and licensed under Apache-2.0.
Key features
- Natural-language browser control
- Vision-first element targeting by coordinates
- Structured data extraction
- Test runner with visual assertions
- Setup command with example script
- Works with Claude and Qwen vision models
Pricing: Free and open source under the Apache-2.0 license; requires access to a vision-capable model.
#10
Crusher is a low-code testing framework built on Playwright, with a Chromium-based recorder, an SDK and a dashboard, offered as a cloud service or self-hosted.
- GitHub stars
- 588
- Last commit
- 1 yr ago
- Latest release
- v0.5.10
- Licence
- MIT
- Self-hosted
- Yes
- Hosted version
- Available
Crusher is a testing framework for web apps that takes a low-code approach. You create tests by browsing your website with a recorder based on Chromium and adding assertions where needed, or you write test files in code using Playwright APIs. The project is built on Playwright and positions itself as an alternative to Selenium, Cypress and Puppeteer.
Tests run in the major browsers, including Chromium, Firefox and Safari, and can be run locally, on every commit with checks on pull requests, or periodically to monitor production and send alerts. A central dashboard shows how an app is doing overall. Getting started is a single npx command in a git repository.
You can use Crusher cloud with zero configuration or self-host with Docker or Kubernetes. The README states that Crusher is in beta at version 0.5, and that the repository is MIT licensed except for an enterprise directory where applicable.
Key features
- Recorder-based test creation in a Chromium browser
- Code files with Playwright APIs for more control
- Runs in all major browsers
- Run tests on every commit and pull request
- Scheduled production monitoring with notifications
- Central reporting dashboard
- Start with one npx command
mabl alternatives: questions
- What is the best open-source alternative to mabl?
- Playwright is the top-ranked open-source alternative to mabl on Enlisted: A framework from Microsoft for end-to-end web testing and browser automation across Chromium, Firefox and WebKit using one API. Other strong options are Jest, Appium, Robot Framework and WebdriverIO.
- What are the best commercial alternatives to mabl?
- Virtuoso QA, Functionize, QA Wolf, Testsigma and Testim are among the hosted, closed-source alternatives to mabl listed on Enlisted, which lists 28 in total. Compare their pricing and features on each tool page.
- Are these mabl alternatives free?
- All 10 are open source, so the code is free to use under its licence, and all of them can be self-hosted on your own server or computer. 1 also offers a paid or managed cloud version if you'd rather not host it yourself.
- How is this list of mabl alternatives ranked?
- By a score built from GitHub stars, star growth over the last 30 days and how recently the code changed. 6 of these projects shipped code in the last 30 days. Data is refreshed daily, and nobody can pay to move up.