connordilgren's picture
Add model card
c54a7b7 verified
|
Raw History Blame Contribute Delete
2.1 kB
metadata
license: mit
base_model: meta-llama/Llama-3.2-1B-Instruct
language:
  - en
tags:
  - latent-reasoning
  - interpretability
  - reasoning
  - multimode_coconut
  - prosqa

Multi-mode Coconut · llama32-1b · ProsQA

This is the Multi-mode Coconut checkpoint trained on ProsQA with base model meta-llama/Llama-3.2-1B-Instruct, from the paper Are Latent Reasoning Models Easily Interpretable? (Dilgren & Wiegreffe, 2026).

Files

This repository contains a single raw PyTorch checkpoint, checkpoint_10 — the state dict as saved by the training framework. It is not a from_pretrained-style model; it is loaded by the paper's evaluation code, which builds the base model and applies this checkpoint.

Usage

The evaluation code in the repository loads this checkpoint from the local path configured in model_paths.yaml. Download it to the expected location with:

hf download connordilgren/llama32-1b-prosqa-multimode-coconut checkpoint_10 --local-dir checkpoints/llama32-1b_prosqa_multimode

This places the file at checkpoints/llama32-1b_prosqa_multimode/checkpoint_10, which is the path referenced for this model (llama → prosqa → multimode_coconut) in model_paths.yaml. See the repository README for full setup and evaluation instructions.

Citation

@misc{dilgren2026latentreasoningmodelseasily,
      title={Are Latent Reasoning Models Easily Interpretable?},
      author={Connor Dilgren and Sarah Wiegreffe},
      year={2026},
      eprint={2604.04902},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2604.04902},
}