Transformers
Safetensors
llama
speculative-decoding
eagle3
specforge
sglang
qwen3
draft-model
sharegpt
sliding-window-512
text-generation-inference
Instructions to use huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-sw512-epoch2-step60000 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-sw512-epoch2-step60000 with Transformers:
# Load model directly from transformers import AutoTokenizer, LlamaForCausalLMEagle3 tokenizer = AutoTokenizer.from_pretrained("huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-sw512-epoch2-step60000") model = LlamaForCausalLMEagle3.from_pretrained("huluhuluu/qwen3-4b-instruct-2507-eagle3-sharegpt-sw512-epoch2-step60000", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 129 Bytes
e80dbe2 | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:8ff1abcac122963865bc9e96c667ee2dad7b48c6600c95b3e1d541a570c16ce0
size 4311
|