Transformers
Safetensors
llama
speculative-decoding
eagle3
specforge
sglang
qwen3
draft-model
sharegpt
text-generation-inference
Instructions to use huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-epoch3-step70000 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-epoch3-step70000 with Transformers:
# Load model directly from transformers import AutoTokenizer, LlamaForCausalLMEagle3 tokenizer = AutoTokenizer.from_pretrained("huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-epoch3-step70000") model = LlamaForCausalLMEagle3.from_pretrained("huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-epoch3-step70000", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 134 Bytes
1f4381d | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:90070d36b34ff53360cdb9fa41287d3f70d1ac0c826182608b88d480711a0549
size 405442400
|