Transformers
Safetensors
llama
speculative-decoding
eagle3
specforge
sglang
qwen3
draft-model
sharegpt
sliding-window-512
text-generation-inference
Instructions to use huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-sw512-epoch2-step60000 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-sw512-epoch2-step60000 with Transformers:
# Load model directly from transformers import AutoTokenizer, LlamaForCausalLMEagle3 tokenizer = AutoTokenizer.from_pretrained("huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-sw512-epoch2-step60000") model = LlamaForCausalLMEagle3.from_pretrained("huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-sw512-epoch2-step60000", device_map="auto") - Notebooks
- Google Colab
- Kaggle