Upload folder using huggingface_hub

README.md

@@ -0,0 +1,32 @@
+# Qwen3-8B Speculators (DFlash & FLM)
+
+Speculator models for the [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) target model.
+
+## Architectures
+
+| Model File | `mlp_type` | Draft Layers | Style |
+|------------|------------|--------------|-------|
+| `dflash_5layer_mix.pt` | `dflash` | 5 | DFlash-style |
+| `flm_5layer_uni.pt` | `flm` | 5 | FLM-style |
+
+## Training Data
+
+These models were trained on the **regenerated dataset** (DFlash-style) derived from Qwen3-8B's own responses to the following sources:
+- **Nemotron Post-Training V2**
+- **CodeAlpaca**
+- **ShareGPT**
+- **UltraChat-200K**
+
+Specifically:
+- **dflash_5layer_mix**: Uses a mixture of datasets and a custom Tau schedule (30% pure noise, 20% grid-aligned, 50% uniform).
+- **flm_5layer_uni**: Uses a uniform Tau schedule and standard dataset mixture.
+
+## Details
+
+- **Target Model**: Qwen/Qwen3-8B
+- **Sequence Length**: 2048
+- **Batch Size**: 5
+- **Draft Layers**: 5 (despite some folder naming suggesting 4, internal config confirms 5)
+
+---
+*Trained at Princeton AILab.*

dflash_5layer_mix.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ee7163f01d0cee06fd8cb45b1c4e3eec1c12a83cd3162068dedf5dc04db0de88
-size 6387243259
+oid sha256:7f9bcf259f407d11f50e15854ee1fe02e69380ddf6ff71861f82ae82f273bf5e
+size 2129081431

flm_5layer_uni.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:51fecc3ee07bd4bd45f62907d8192e555791e235c4ba13b6471e07cb768e05f6
-size 903348224
+oid sha256:e9888244ddb7899a30fa4ee577e76dfa2000e9cf8a4a24b0934081bd7b26b6f5
+size 2213173569