#1
A framework from Microsoft for end-to-end web testing and browser automation across Chromium, Firefox and WebKit using one API.
- GitHub stars
- 100k
- Last commit
- today
- Latest release
- v1.65.0
- Licence
- Apache-2.0
- Self-hosted
- Yes
playwright.dev
Playwright is an open-source framework for testing and automating web applications. A single API drives Chromium, Firefox and WebKit, so the same script or test can cover all three engines. It is used for end-to-end testing, for scripted browser tasks and, increasingly, as a tool that AI agents call to operate a browser.
The bundled Playwright Test runner executes tests in parallel with a fresh browser context per test, which gives isolation without the cost of launching a new browser. Locators mirror how users see the page, actions wait automatically until elements are ready, and assertions retry until they pass. Failures can be investigated with traces that capture screenshots, DOM snapshots, network requests and console output in a Trace Viewer.
Beyond the test runner there is a standalone library for scripts, a CLI aimed at coding agents, an MCP server for LLM-driven automation and a VS Code extension. The code is Apache-2.0 licensed and runs on your own machines and CI servers, with no hosted service required.
Key features
- One API for Chromium, Firefox and WebKit
- Auto-waiting actions and retrying assertions
- Parallel tests with isolated browser contexts
- Trace Viewer with DOM snapshots and network logs
- Locators that mirror how users see pages
- MCP server and CLI for AI agents
- VS Code extension for authoring tests
Pricing: Free and open source under the Apache-2.0 license.
#2
Jest is a JavaScript testing framework with snapshots, mocking and code coverage that aims to work with little configuration.
- GitHub stars
- 45k
- Last commit
- yesterday
- Latest release
- v30.5.2
- Licence
- MIT
jestjs.io
Jest is a JavaScript testing framework that describes its focus as simplicity. It works with projects using Babel, TypeScript, Node, React, Angular, Vue and more, and aims to run without configuration on most JavaScript projects. Tests are run in parallel, each in its own process.
The toolkit covers assertions, mock functions, snapshot tests and code coverage in one place. Snapshots can sit beside the tests or inline, and coverage is switched on with a single flag. Jest is supported through Open Collective and is part of the OpenJS Foundation, and the site shows version 30.5 as current alongside the documentation for many earlier versions.
Key features
- Works with common JavaScript toolchains
- Config-free setup on most projects
- Snapshot tests kept beside tests or inline
- Tests parallelised in separate processes
- Code coverage via a flag
- Mocking through a custom module resolver
- Previously failed tests run first
#3
A modular, WebDriver-based automation framework for testing native, hybrid, mobile web and desktop apps across platforms, extended through drivers, clients and plugins.
- GitHub stars
- 22k
- Last commit
- yesterday
- Latest release
- @appium/opencv@5.0.2
- Licence
- Apache-2.0
- Self-hosted
- Yes
appium.io
Appium is an open-source framework for automating apps on mobile, desktop and IoT platforms. It builds on the W3C WebDriver protocol, which means tests are written against a standard interface and can drive native apps, hybrid apps, mobile web and desktop software on Android, iOS, Windows, macOS and more.
Its architecture is modular and extensible. Drivers add support for automating particular platforms, clients let you write tests in the programming language of your choice, and plugins extend the core behavior. That gives rise to a broad ecosystem of related software around the core server. Appium is installed with npm, and the documentation covers system requirements for each platform.
The team supports only the latest version, so anyone on an older major release is directed to migration guides covering the v1 to v2 and v2 to v3 transitions. Appium is written in TypeScript under the Apache-2.0 license and runs on your own machines, build servers or device farms. It is a standard choice for QA engineers and developers who need cross-platform mobile test automation.
Key features
- Automates native, hybrid and mobile web apps
- Desktop and IoT platform support
- Built on the W3C WebDriver protocol
- Drivers for individual platforms
- Test clients in multiple languages
- Plugin system for extending behavior
Pricing: Free and open source under the Apache-2.0 license.
#4
Mocha is a JavaScript test framework for Node.js and the browser, with many reporters, test interfaces and support for asynchronous tests.
- GitHub stars
- 23k
- Last commit
- 2 days ago
- Latest release
- v12.0.3
- Licence
- MIT
mochajs.org
Mocha is a JavaScript test framework that runs on Node.js and in the browser. Its documentation covers writing asynchronous tests, hooks, timeouts and retries, and running tests from the command line or a browser page.
Tests run serially, which the project says allows flexible and accurate reporting and maps uncaught exceptions to the right test case. Several test interfaces are supported, with BDD as the default, and the output can be shaped by a long list of reporters such as Spec, Dot, JSON, Markdown and Nyan.
The docs also describe a parallel mode, global fixtures, root hook plugins, TypeScript use and editor plugins. The project is MIT-licensed and sits under the OpenJS Foundation, with Discord and GitHub as community channels.
Key features
- Selective running of tests
- Choice of built-in reporters
- Several test interfaces with BDD as default
- Hooks, parallel mode and global fixtures
- Runs from the CLI, in browsers and with editor plugins
#5
An open-source automation framework for acceptance testing and robotic process automation, using human-readable keyword syntax that can be extended in Python or Java.
- GitHub stars
- 12k
- Last commit
- 2 days ago
- Latest release
- v7.5.1
- Licence
- Apache-2.0
robotframework.org
Robot Framework is a generic open-source framework for test automation and robotic process automation. Test cases and tasks are written with readable, keyword-based syntax, so people who are not programmers can follow what an automated scenario does, and the same approach covers acceptance testing and RPA.
Functionality is extended through libraries written in Python, Java and other languages, and a rich ecosystem of hundreds of third-party libraries covers web, API, mobile and other automation needs. The Robot Framework Foundation supports the project, and the website provides a user guide, standard library documentation, community events, workshops and a certification program.
The framework is released under the Apache-2.0 licence, written in Python, and used without licensing fees. You install it into your own Python environment and run it locally or in CI, so there is no server to host. It suits QA teams practicing acceptance test-driven or behavior-driven development and teams automating repetitive business processes.
Key features
- Human-readable keyword-driven syntax
- Acceptance testing and RPA in one tool
- Extensible with Python and Java libraries
- Standard library of common keywords
- Hundreds of third-party libraries
- Reports and logs for test runs
Pricing: Free and open source under the Apache-2.0 licence, with no licensing fees.
#6
WebdriverIO is a Node.js test automation framework for browser and mobile apps, supporting end-to-end, unit and component tests via WebDriver, BiDi and Appium.
- GitHub stars
- 9.9k
- Last commit
- yesterday
- Latest release
- v10.2.0
- Licence
- MIT
webdriver.io
This entry covers WebdriverIO, a modern test automation framework that drives browsers and mobile apps from Node.js. It is used for end-to-end tests as well as unit and component tests in the browser, and runs tests based on the WebDriver and WebDriver BiDi protocols and on Appium automation technology.
It works with popular test frameworks for BDD and TDD, such as Mocha, Jasmine and Cucumber, and can run tests locally or in the cloud on services including Sauce Labs, BrowserStack, TestingBot and TestMu AI, formerly LambdaTest. The project provides a developer guide, API reference, changelog and roadmap, and contributors can start in a prepared dev container using GitHub Codespaces or Gitpod.
WebdriverIO is written in TypeScript and licensed under MIT. It is installed as a development dependency in a JavaScript or TypeScript project, so there is nothing to host. Commercial support is available through a Tidelift subscription. It suits QA engineers and front-end teams who want one framework for web and mobile test automation.
Key features
- End-to-end, unit and component testing
- WebDriver and WebDriver BiDi support
- Appium integration for mobile apps
- Works with Mocha, Jasmine and Cucumber
- Local runs or cloud device providers
- Written in TypeScript for Node.js
Pricing: Free and open source under the MIT licence; commercial support is available through Tidelift.
#7
An open-source framework for test automation that brings API checks, mocks, performance tests and UI automation together under one readable syntax.
- GitHub stars
- 9k
- Last commit
- today
- Latest release
- v2.1.4
- Licence
- MIT
docs.karatelabs.io
Karate is an open-source tool that unifies API testing, mocks, performance testing and UI automation in one framework with a single readable syntax. Tests are written as feature files, so people who are not Java developers can read and write them, and the project is written in Java.
Its documentation highlights the match keyword for validating complete responses, headers and arrays, parallel execution of features, scenarios and example rows, reusable flows by calling one feature from another, and test doubles that stand up HTTP, gRPC and message-queue mocks from a feature file. Karate v2 adds virtual threads, a single-binary CLI, JavaScript debugging and soft assertions. There are extensions for VS Code and IntelliJ, plus Karate Agent and Karate Xplorer products.
Tests can be run through JUnit, the command line or CI/CD pipelines. Karate is licensed under MIT, and topics mention BDD, Cucumber, contract testing, load testing and WebDriver. It suits QA engineers and developers who want one tool for API-level and UI-level checks.
Key features
- API testing in readable feature files
- Built-in HTTP, gRPC and queue mocks
- Performance testing from the same tests
- UI automation with a browser driver
- Parallel test execution
- JUnit, CLI and CI/CD runners
- VS Code and IntelliJ extensions
Pricing: The open-source framework is free. Pro is $64 per user per month ($640 per user per year) and IDE Plus is $100 per user per year; Enterprise is custom. Everything runs self-hosted.
#8
TestCafe is a free, open-source end-to-end testing framework that runs JavaScript and TypeScript tests in real browsers.
- GitHub stars
- 9.9k
- Last commit
- 2 days ago
- Latest release
- v3.7.7
- Licence
- MIT
testcafe.io
TestCafe is an end-to-end testing solution installed as a single npm package. Tests are written in JavaScript or TypeScript, either by hand or recorded in the browser, and can simulate complex page interactions and multi-window scenarios.
Tests run in any modern browser, local or remote, and can run concurrently to speed things up. A Docker image is available for CI/CD pipelines, and results can be stored as reports in several formats. Running a test is a single command such as testcafe chrome test.js.
The open-source library covers creating, running and reviewing tests. Paid products sit alongside it: TestCafe Studio, a desktop application that speeds up test creation, and subscription plans that add run logs, flaky test detection, parallelization and screenshot and video storage.
Key features
- Installs as one npm package
- Runs in common browsers out of the box
- Docker image for CI/CD pipelines
- JavaScript and TypeScript tests for complex interactions
- Write tests by hand or record them
- Concurrent test runs
- Reports in several formats
Pricing: Personal is $20 /month (first 60 days free) with 3 users and 7,500 test runs. Team is $50 /month (first 60 days free) with 20 users and 50,000 test runs. Enterprise is priced by contacting the vendor.
#9
The JavaScript implementation of Cucumber, which runs automated acceptance tests written in plain language on Node.js.
- GitHub stars
- 5.4k
- Last commit
- yesterday
- Latest release
- v13.3.0
- Licence
- MIT
cucumber.io
Cucumber JS is the JavaScript version of Cucumber, a tool for running automated acceptance tests. The tests are specifications written in Gherkin, a set of grammar rules that gives plain text enough structure for Cucumber to read. Because the text is readable by anyone on a team, the project presents it as a way to improve communication, collaboration and trust.
Each specification is a feature file made of scenarios, and each scenario is a list of steps. Step definitions written in JavaScript connect those steps to the code under test. A run reports success or failure for every scenario. The repository's example has a feature file in a features folder and steps in features/support/steps.js, started with the cucumber-js command.
The package is published on npm as @cucumber/cucumber and runs on maintained versions of Node.js. The documentation also covers configuration profiles, formatters, parallel running, sharding across machines, retrying flaky scenarios, rerunning only failures and a JavaScript API for running programmatically. The code is MIT licensed.
Key features
- Runs automated tests written in plain language
- Installs from npm as @cucumber/cucumber
- Gherkin gives plain text a structure Cucumber can read
- Step definitions connect Gherkin steps to code
- Reports success or failure for each scenario
- Parallel running, sharding and rerunning failures
- Formatters, filtering and a programmatic JavaScript API
- Transpiling support, for example from TypeScript
#10
A free, open-source test automation framework for acceptance testing, with specifications written in Markdown.
- GitHub stars
- 3.2k
- Last commit
- 4 days ago
- Latest release
- v1.6.43
- Licence
- Apache-2.0
gauge.org
Gauge is a free and open source test automation framework built for acceptance testing. Tests are written as specifications in Markdown, and the project says that reusing specifications and refactoring support reduce duplication and keep the suite readable and easier to maintain.
It works with several languages (JavaScript, C#, Java, Python and Ruby) and with various CI/CD tools and automation drivers, so teams do not need to learn a new language. A plugin architecture covers IDEs, drivers, data sources, test execution events and further languages. Taiko is promoted as a companion for browser automation in JavaScript tests.
When a test fails, Gauge takes a screenshot, and reports are produced in XML, JSON and HTML. Parallel execution is supported out of the box, and data-driven testing keeps data sets outside the test scripts so one specification can run against many sets of data.
Key features
- Tests written in Markdown
- Works with multiple languages and CI/CD tools
- Plugin architecture and ecosystem
- Screenshot captured on test failure
- XML, JSON and HTML reports
- Built-in parallel test execution
- Data-driven testing with external data sets
2 more Katalon alternatives
Katalon alternatives: questions
- What is the best open-source alternative to Katalon?
- Playwright is the top-ranked open-source alternative to Katalon on Enlisted: A framework from Microsoft for end-to-end web testing and browser automation across Chromium, Firefox and WebKit using one API. Other strong options are Jest, Appium, Mocha and Robot Framework.
- What are the best commercial alternatives to Katalon?
- Applitools, BrowserStack, Sauce Labs, TestRail and mabl are among the hosted, closed-source alternatives to Katalon listed on Enlisted, which lists 29 in total. Compare their pricing and features on each tool page.
- Are these Katalon alternatives free?
- All 12 are open source, so the code is free to use under its licence, and all of them can be self-hosted on your own server or computer. 1 also offers a paid or managed cloud version if you'd rather not host it yourself.
- How is this list of Katalon alternatives ranked?
- By a score built from GitHub stars, star growth over the last 30 days and how recently the code changed. 10 of these projects shipped code in the last 30 days. Data is refreshed daily, and nobody can pay to move up.