Commit0

Distributed Mode

Commit0 is a command-line tool that allows you to run unit-tests on a variety of libraries in isolated environments.

The defaul tool uses modal as a distributed test runner.

pip install modal
modal token new

To get started, run the setup command with the dataset split that youare interested in working with. We'll start with the lite split.

commit0 setup lite

This will clone a set of skeleton libraries in your repos/ directory. Commiting changes to branches in this directory is how you send changes to the test runner.

Next to run tests you can run the standard test command. This command will run a reference unit test for the simpy repo.

commit0 test simpy tests/test_event.py::test_succeed --reference

To run a test in your codebase you can run with no args. This one will fail.

commit0 test simpy tests/test_event.py::test_succeed

To run a test in your codebase with a specific branch you can commit to the branch and call with the --branch command.

commit0 test simpy tests/test_event.py::test_succeed --branch my_branch

Local Mode

To run in local mode you first be sure that you have docker tools installed. On Debian systems:

apt install docker

To get started, run the setup command with the dataset split that you are interested in working with. We'll start with the lite split.

commit0 setup lite

This will install a clone the code for subset of libraries to your repos/ directory.

Next run the build command which will configure Docker containers for each of the libraries with isolated virtual environments. The command uses the uv library for efficient builds.

commit0 build

The main operation you can do with these enviroments is to run tests. Here we run a test in the simpy library.

commit0 test simpy tests/test_event.py::test_succeed

See distributed setup for more commands.