> For the complete documentation index, see [llms.txt](https://stackpi-intelligent.gitbook.io/stackpi-intelligent/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://stackpi-intelligent.gitbook.io/stackpi-intelligent/alpha-codium/usage/evaluation.md).

# Evaluation

To evaluate the solutions, run:

Copy

Copy

```
python -m alpha_codium.evaluate_dataset\
--dataset_name /path/to/dataset\
--split_name test\
--database_solution_path /path/to/output/dir/dataset_output.json
```