Overview
Commit-0 is a from scratch AI coding challenge. Can you create a library from commit 0?
The benchmark consists of 54 core Python libraries. The challenge is to rebuild these libraries and pass their unit tests. All libraries have:
- Significant test coverage
- Detailed specification and documentation
- Lint and type checking
Commit-0 is an interactive environment that makes it easy to design and test new agents. You can:
- Efficiently run tests in isolated environments
- Distribute testing and development across cloud systems
- Track and log all changes made throughout.
To install run:
pip install commit0
Architecture
