Transformers
Safetensors
llama
speculative-decoding
eagle3
specforge
sglang
qwen3
draft-model
sharegpt
text-generation-inference
Instructions to use huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-epoch3-step70000 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-epoch3-step70000 with Transformers:
# Load model directly from transformers import AutoTokenizer, LlamaForCausalLMEagle3 tokenizer = AutoTokenizer.from_pretrained("huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-epoch3-step70000") model = LlamaForCausalLMEagle3.from_pretrained("huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-epoch3-step70000", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Welcome to the community
The community tab is the place to discuss and collaborate with the HF community!