About Pa11y CI
Pa11y CI is an accessibility test runner built on Pa11y and designed for continuous integration environments. Automated testing of your application can help prevent accessibility issues from reaching production, and Pa11y CI runs those checks against a list of URLs or a sitemap and reports the issues it finds.
It is provided as the pa11y-ci command-line tool, installed globally with npm. A JSON configuration file named .pa11yci lists the URLs to visit, and paths provided on the command line can be relative, absolute or glob patterns. A defaults section sets configuration used for each test, with extra options for concurrency of parallel tests and for running in an isolated incognito browser context. A different configuration file can be selected with a command-line parameter.
It requires a stable, even-numbered Node.js release of version 20 or above. Version 4 uses Pa11y 9 with a more recent Puppeteer, which resolves a Chrome path problem that version 3 had on newer Ubuntu releases. Pa11y CI is licensed under LGPL-3.0.
Key features
- Accessibility checks for URL lists
- Sitemap-based testing
- JSON configuration file
- Parallel test concurrency
- Incognito browser context option
- Designed for CI pipelines
Good fit for
- Blocking accessibility regressions in CI
- Auditing every page of a site from its sitemap
Pa11y CI: questions and answers
- What is Pa11y CI used for?
- Pa11y CI is a command-line accessibility test runner for continuous integration that checks a list of URLs or a sitemap and reports issues. It is a good fit for blocking accessibility regressions in CI and auditing every page of a site from its sitemap.
- Is Pa11y CI open source?
- Yes. Pa11y CI is open source under the LGPL-3.0 licence. Its source code is on GitHub at pa11y/pa11y-ci and is written mainly in JavaScript.
- Is Pa11y CI free?
- Yes. Pa11y CI is open source, so the software itself is free to use.
- What are some alternatives to Pa11y CI?
- Similar open-source tools in the Testing & QA category include Tox, QA Wolf CLI and Taiko. SaaS products in the same category include Codecov, Coveralls and desplega.ai.
- Is Pa11y CI actively maintained?
- Yes. The most recent commit to Pa11y CI was on 1 November 2026, and the latest release is 5.0.0, published on 5 October 2026. The project has 647 stars on GitHub, with 8 added in the last 30 days.
Open-source alternatives to Pa11y CI
See all
Tox
Testing & QA
Command line driven CI frontend and development task automation tool.
MITvs Zoom★ 4k
QA Wolf CLI
Testing & QA
QA Wolf from anywhere — your terminal, your CI, your AI agent.
Apache-2.0★ 3.5k
Taiko
Testing & QA
A node.js library for testing modern web applications
MITvs Ghost Inspector★ 3.7k
pytest-testmon
Testing & QA
Selects tests affected by changed files. Executes the right tests first. Continuous test r
MIT★ 1ka11y.css
Testing & QA
This CSS file intends to warn developers about possible risks and mistakes that exist in H
MIT★ 1.6k
Xcov
Testing & QA
Nice code coverage reporting without hassle
MITvs Codecov★ 573
SaaS alternatives to Pa11y CI
See all
Codecov
Testing & QA
Code coverage reporting and test analytics that comments on pull requests
SaaS
Coveralls
Testing & QA
Hosted code coverage tracking that reports on commits and pull requests
SaaS
desplega.ai
Testing & QA
No-code AI platform that automates end-to-end QA test creation, running and maintenance
SaaS
PageAudit
Testing & QA
Continuous WCAG accessibility monitoring for web agencies that crawls client sites daily and points to code fixes
SaaS
Acceslab
Testing & QA
AI-powered WCAG scanner that checks website accessibility and produces compliance reports
SaaS
BrowserStack
Testing & QA
Cloud platform for testing websites and mobile apps on real browsers and devices
SaaS

