7,363 open-source and SaaS tools, with GitHub stats refreshed every day.

CTX

Open source

Tool that tests candidate AI coding-agent configurations against real tasks in your repository and applies the cheapest reliable one as a reviewable change.

stevesolun.github.io
CTX homepage screenshot
GitHub stars
587
Last commit
1 mo ago
Repository age
6 months
Version
v1.0.21
Licence
MIT
Self-hosted
Yes

About CTX

CTX Fit analyzes a code repository, runs promising AI coding-agent configurations against real tasks in it, and produces the winning setup as a reviewable change. You can apply it directly to your working tree or open it as a pull request. It is aimed at developers and teams who use coding agents such as Claude Code and want evidence about which setup is cheapest while still working reliably, rather than choosing by guesswork.

The winner is picked by a fixed rule rather than a score: candidates below a reliability floor are discarded, the remaining ones are ranked by attributable cost, and ties go to the simpler configuration. If nothing beats your current setup, the tool says so. A language model may explain a result but never decides it. The scope is comparing capability configurations within one coding-agent harness, not comparing different agents with each other.

Verification uses repository-native commands for Python, JavaScript and TypeScript, Go, Rust and Make, and treats the chosen test command as the authority. Final verification runs in an isolated home without network access, so dependencies must already be available. The README is explicit that this is evidence for normal development and does not prove that hostile code cannot fool its own test runner. The project is written in Python and MIT licensed.

Key features

  • Benchmarks AI coding setups on your own repository
  • Fixed rule: reliability first, then cost
  • Applies winner to working tree or as a pull request
  • Verifies with repository-native test commands
  • Runs final checks in an isolated, offline environment
  • Supports Python, JS/TS, Go, Rust and Make projects

Good fit for

  • →Choosing a cost-effective coding agent configuration
  • →Auditing whether an agent setup works on a codebase
Built with
Python
Tags
ai-coding
claude-code
agents
developer-tools
benchmarking
automation
cost-optimization
python

CTX: questions and answers

What is CTX used for?
CTX is a tool that tests candidate AI coding-agent configurations against real tasks in your repository and applies the cheapest reliable one as a reviewable change. It is a good fit for choosing a cost-effective coding agent configuration and auditing whether an agent setup works on a codebase.
Is CTX open source?
Yes. CTX is open source under the MIT licence. Its source code is on GitHub at stevesolun/ctx and is written mainly in Python.
Is CTX free?
Yes. CTX is open source, so the software itself is free to use.
What are some alternatives to CTX?
Similar open-source tools in the Developer Tools category include kitty, Apprise and Docs MCP Server. SaaS products in the same category include AgenKit, Contextkit and Deska.
Is CTX actively maintained?
Yes. The most recent commit to CTX was on 31 August 2026, and the latest release is v1.0.21, published on 15 August 2026. The project has 587 stars on GitHub.

Open-source alternatives to CTX

See all

SaaS alternatives to CTX

See all