Text Generation
Transformers
recurrent_qwen
recurrent-depth
latent-reasoning
qwen2.5
research
custom_code
Instructions to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper
- SGLang
How to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with Docker Model Runner:
docker model run hf.co/mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper
Download verification_spec.json from mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper: direct link, hf CLI and curl.
- Browser
- Download file 616 Bytes
-
https://huggingface.co/mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper/resolve/main/verification_spec.json
- Command line
-
hf download hf://mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper/verification_spec.json
-
curl -L -o verification_spec.json https://huggingface.co/mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper/resolve/main/verification_spec.json
616 Bytes
| { | |
| "expected_correct_by_depth": { | |
| "1": 8 | |
| }, | |
| "source_data": "outputs/stage5/stage5_natural_surface_receipts_20260709_210151/data/robust_relay_fronted_d1_12.jsonl", | |
| "source_receipt": "outputs/stage5/stage5_natural_surface_followups_2_3_20260710/active/step_2000/step_2000_robust_relay_fronted_d1_12_active_rows_sample.jsonl", | |
| "identity_check": true, | |
| "verification_data": "hf_release/verification_assets/recurrent-qwen2.5-0.5b-natural-keeper.jsonl", | |
| "verification_data_sha256": "81e598aab8cc77cdde5dc5484a66eb2804f3759640ce92244fcf897b648231dd", | |
| "row_count": 8, | |
| "rows_by_depth": { | |
| "1": 8 | |
| } | |
| } | |