6.94 GB

Ctrl+K

1 contributor

History: 5 commits

sakamakismile

Default max-num-seqs=16, fp8-KV 128K serve example, measured concurrency (~10 full-128K sessions)

48876b9 verified 5 months ago

.gitattributes

1.57 kB
LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago
Dockerfile

730 Bytes
Add USAGE.md + container bundle (Dockerfile/compose/entrypoint/run.sh) 5 months ago
LICENSE

10.6 kB
LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago
README.md

7.2 kB
Default max-num-seqs=16, fp8-KV 128K serve example, measured concurrency (~10 full-128K sessions) 5 months ago
USAGE.md

4.9 kB
Default max-num-seqs=16, fp8-KV 128K serve example, measured concurrency (~10 full-128K sessions) 5 months ago
chat_template.jinja

4.29 kB
LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago
compose.yaml

1.03 kB
Default max-num-seqs=16, fp8-KV 128K serve example, measured concurrency (~10 full-128K sessions) 5 months ago
config.json

5.09 kB
LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago
entrypoint.sh

1.26 kB
Default max-num-seqs=16, fp8-KV 128K serve example, measured concurrency (~10 full-128K sessions) 5 months ago
generation_config.json

230 Bytes
LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago
hf_quant_config.json

3.17 kB
LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago
model.safetensors

6.93 GB
xet

LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago
run.sh

1.25 kB
Add USAGE.md + container bundle (Dockerfile/compose/entrypoint/run.sh) 5 months ago
tokenizer.json

17.9 MB
xet

LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago
tokenizer_config.json

363 Bytes
LFM2.5-8B-A1B NVFP4 (modelopt W4A4) — Lna-Lab 5 months ago