# GRADING NEEDS NOTHING FROM THIS FILE. # Every published number reproduces from the cached generations using the Python standard library # alone, on CPython 3.12.x. Verified on 3.12.3. `pip install -r` is not a prerequisite for # `make reproduce`; it is only needed to REBUILD a benchmark from its source dataset. # # python3 -m venv .venv && . .venv/bin/activate && pip install -r harness/requirements.txt # --- benchmark construction only (tools/) --- pyarrow==23.0.1 # reads the CodeSearchNet parquet directly datasets==4.8.4 # MBPP; pinned because the CSN streaming reader in this version aborts huggingface-hub==1.10.1 fsspec==2026.2.0 numpy==1.26.4 pandas==3.0.2 requests==2.33.1 # --- also required by tools/resolve_licenses.py, NOT installable via pip --- # GitHub CLI `gh`, authenticated (`gh auth login`). Verified with gh 2.45.0. # Used only to resolve repository licences at a commit; the built benchmark needs neither gh nor # a network connection.