How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="runtime-contracts/qwen3-8b-knapsack-lora-stateless-seed1337")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("runtime-contracts/qwen3-8b-knapsack-lora-stateless-seed1337", device_map="auto")
Quick Links

qwen3-8b-knapsack-lora-stateless-seed1337

Supplementary release for the paper Evaluating Agents Across Runtime Contracts: When Mismatch Costs Efficiency or Quality (IAEval 2026, the NeurIPS 2026 Workshop on Evaluation of Interactive Agents). This is one of six LoRA adapters (persistent/stateless training regime x 3 seeds) fine-tuned on the Opaque Knapsack agentic task.

  • Base model: Qwen/Qwen3-8B
  • Training regime: stateless (trained with a stateless Python interpreter runtime (interpreter state is reset every agent turn))
  • Seed: 1337

Training configuration

Fine-tuned with Axolotl 0.13.2, LoRA adapter, 4-bit NF4 quantized base:

Hyperparameter Value
lora_r 64
lora_alpha 128
lora_dropout 0.05
lora_target_modules q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
learning_rate 1e-4
lr_scheduler cosine
optimizer adamw_torch
epochs 3.0
micro_batch_size 1
gradient_accumulation_steps 16
sequence_len 16384
sample_packing false
seed 1337
training data paired traces for the "stateless" regime (see paper Appendix for pairing/filtering procedure)

Provenance

Released alongside the paper Evaluating Agents Across Runtime Contracts: When Mismatch Costs Efficiency or Quality (IAEval 2026, the NeurIPS 2026 Workshop on Evaluation of Interactive Agents), to reproduce its reported results.

License

Apache License 2.0. The base model (Qwen3-8B) is also released under Apache 2.0.

Downloads last month
23
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for runtime-contracts/qwen3-8b-knapsack-lora-stateless-seed1337

Finetuned
Qwen/Qwen3-8B
Adapter
(2267)
this model

Collection including runtime-contracts/qwen3-8b-knapsack-lora-stateless-seed1337