card

README.md

@@ -0,0 +1,55 @@
+---
+license: apache-2.0
+base_model: Mapika/decider-0.8b
+base_model_relation: quantized
+pipeline_tag: text-classification
+library_name: halogen
+# The widget is off deliberately: these files run only on the NPU inside the
+# halogen container, so nothing on the Hub can load them.
+inference: false
+tags:
+  - halogen
+  - npu
+  - ryzen-ai
+  - xdna2
+  - strix-halo
+  - amd
+  - classifier
+  - guard
+  - router
+---
+
+# decider-0.8b for the Ryzen AI NPU
+
+[Mapika/decider-0.8b](https://huggingface.co/Mapika/decider-0.8b), a Qwen3.5-0.8B classifier, converted to run on the Ryzen AI NPU of AMD Strix Halo inside
+[halogen-flash-server](https://github.com/peonist-ai/halogen-flash-server), beside the Flash model on the GPU and behind
+the same port. Questions go to the [Discord](https://discord.gg/bcm6QknaV6).
+Bugs go to the server repository's issues.
+
+**These files run only inside the halogen-flash-server container, on the NPU.
+They will not load in transformers or any other runtime.**
+
+## What is here
+
+```
+devices/              96 MB  the NPU program for this model, and its NOTICE.md
+decider-0.8b.hnpw   2.27 GB  the weights, converted for the NPU
+tokenizer/            20 MB  the tokenizer
+```
+
+## Use it
+
+Start halogen-flash-server 0.16.0 or later with `HALOGEN_DOWNLOAD` on and
+`HALOGEN_NPU_MODELS=decider-0.8b`. The server fetches these files into
+`/models/npu/decider-0.8b/` and checks each one's size and checksum before it starts.
+Give it a text and a question with 2 to 10 options, and it returns a probability for every option from one pass: a guard, a router, a classifier beside the Flash model.
+
+The host needs the NPU driver, XRT with its NPU plugin, and the GPU's fabric
+clock held while the NPU works beside the GPU. The setup, every request shape,
+and how to run your own fine-tune of this model are in
+[docs/NPU.md](https://github.com/peonist-ai/halogen-flash-server/blob/main/docs/NPU.md).
+
+## Source and license
+
+Converted from [Mapika/decider-0.8b](https://huggingface.co/Mapika/decider-0.8b) at revision `a0a01d6f8135298f400a8c856b355793012ae971`, itself a fine-tune of Qwen/Qwen3.5-0.8B-Base. Apache-2.0, as the source.
+`devices/NOTICE.md` lists the third-party notices the NPU program carries.