Create README.md

README.md

@@ -0,0 +1,70 @@
+# install
+
+pip install git+https://github.com/sgl-project/sglang.git@refs/pull/16818/head#subdirectory=python
+
+# serve
+
+```
+python -m sglang.launch_server     --model-path Qwen/Qwen3-8B     --speculative-algorithm DFLASH     --speculative-draft-model-path Tengyunw/Qwen3-8B-DFlash     --tp-size 1     --dtype bfloat16     --attention-backend fa3     --mem-fraction-static 0.75     --trust-remote-code
+```
+
+# performance
+
+## DFLASH Bench Report
+
+## Settings
+- dataset: `math500`
+- max_new_tokens: `2048`
+- attention_backends: `fa3, flashinfer`
+- tp_size: `1`
+- concurrencies: `1, 4, 8, 16, 32`
+- questions_per_concurrency: `base=128`
+- device_sm: `90`
+- is_blackwell: `False`
+- skip_baseline: `False`
+- drop_first_batch: `true`
+
+## Backend: `fa3`
+
+### Baseline output tok/s
+| conc | 1 | 4 | 8 | 16 | 32 |
+| --- | --- | --- | --- | --- | --- |
+| value | 146.15 | 557.57 | 1,073.81 | 1,995.19 | 3,522.30 |
+
+### DFLASH output tok/s
+| conc | 1 | 4 | 8 | 16 | 32 |
+| --- | --- | --- | --- | --- | --- |
+| value | 507.64 | 1,820.02 | 3,335.61 | 5,365.14 | 6,985.11 |
+
+### Speedup (DFLASH / baseline)
+| conc | 1 | 4 | 8 | 16 | 32 |
+| --- | --- | --- | --- | --- | --- |
+| value | 3.474 | 3.264 | 3.106 | 2.689 | 1.983 |
+
+### DFLASH acceptance length
+| conc | 1 | 4 | 8 | 16 | 32 |
+| --- | --- | --- | --- | --- | --- |
+| value | 5.758 | 5.682 | 5.665 | 5.680 | 5.696 |
+
+## Backend: `flashinfer`
+
+### Baseline output tok/s
+| conc | 1 | 4 | 8 | 16 | 32 |
+| --- | --- | --- | --- | --- | --- |
+| value | 147.22 | 563.03 | 1,079.81 | 1,991.50 | 3,414.32 |
+
+### DFLASH output tok/s
+| conc | 1 | 4 | 8 | 16 | 32 |
+| --- | --- | --- | --- | --- | --- |
+| value | 485.97 | 1,686.93 | 2,958.82 | 4,580.78 | 5,861.75 |
+
+### Speedup (DFLASH / baseline)
+| conc | 1 | 4 | 8 | 16 | 32 |
+| --- | --- | --- | --- | --- | --- |
+| value | 3.301 | 2.996 | 2.740 | 2.300 | 1.717 |
+
+### DFLASH acceptance length
+| conc | 1 | 4 | 8 | 16 | 32 |
+| --- | --- | --- | --- | --- | --- |
+| value | 5.714 | 5.669 | 5.675 | 5.688 | 5.702 |
+