Text Generation
Transformers
recurrent_qwen
recurrent-depth
latent-reasoning
qwen2.5
research
custom_code
Instructions to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper
- SGLang
How to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper with Docker Model Runner:
docker model run hf.co/mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper
Download conversion_receipt.json from mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper: direct link, hf CLI and curl.
- Browser
- Download file 1.67 kB
-
https://huggingface.co/mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper/resolve/main/conversion_receipt.json
- Command line
-
hf download hf://mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper/conversion_receipt.json
-
curl -L -o conversion_receipt.json https://huggingface.co/mshapiro123/recurrent-qwen2.5-0.5b-natural-keeper/resolve/main/conversion_receipt.json
1.67 kB
| { | |
| "schema_version": 1, | |
| "kind": "paper_one_hf_checkpoint_conversion", | |
| "status": "green", | |
| "created_at_utc": "2026-08-16T04:39:04.122744Z", | |
| "repo_name": "recurrent-qwen2.5-0.5b-natural-keeper", | |
| "checkpoint_kind": "full_block_delta", | |
| "source_checkpoint": "/content/drive/MyDrive/recurrent-qwen-svgd-backups/natural_surface_backup_20260709_180835/checkpoints/stage5_natural_surface_transfer_rung0_fixed_prompt_20260709_133812/unfrozen_recurrent_step_2000.pt", | |
| "source_checkpoint_sha256_expected": "0f657b653078ba403cbc666410e7598ca20c836d5bd6e19a0e85a186a82c5d2f", | |
| "source_checkpoint_sha256": "0f657b653078ba403cbc666410e7598ca20c836d5bd6e19a0e85a186a82c5d2f", | |
| "source_phase": "unfrozen_recurrent", | |
| "source_step": 2000, | |
| "source_tensor_count": 152, | |
| "source_total_parameters": 182163457, | |
| "excluded_checkpoint_tensors": { | |
| "bridge.proj.bias": { | |
| "shape": [ | |
| 896 | |
| ], | |
| "parameters": 896 | |
| }, | |
| "bridge.proj.weight": { | |
| "shape": [ | |
| 896, | |
| 1792 | |
| ], | |
| "parameters": 1605632 | |
| } | |
| }, | |
| "excluded_checkpoint_parameters": 1606528, | |
| "exclusion_reason": "Receipt-bound legacy concat projection bypassed by split-mode forward execution", | |
| "safetensors_file": "recurrent_delta.safetensors", | |
| "safetensors_sha256": "a15147dc4338c2ba21b3dc4ec440824516344153fe16bd95ac33e3d726c6d1c0", | |
| "tensor_count": 150, | |
| "total_parameters": 180556929, | |
| "lora_parameters": 0, | |
| "bridge_parameters": 1608321, | |
| "dtype_tensor_counts": { | |
| "bfloat16": 144, | |
| "float32": 6 | |
| }, | |
| "key_transform": "exclude manifest-listed inactive compatibility tensors; base_model.* -> backbone.*; all other release keys unchanged" | |
| } | |