hikmaai-mdeberta-v3-base-xnli-multilingual
ONNX repackaging of a multilingual zero-shot NLI model, published for the TOPICALML input control in hikma-mirsad. It scores an input prompt against operator-defined topic labels via zero-shot Natural Language Inference.
Provenance
- Base model:
MoritzLaurer/mDeBERTa-v3-base-mnli-xnli(MIT). - Exported by:
scripts/export_xnli_onnx.pyin hikma-mirsad (optimummain_export, opset 17; INT8 dynamic quant for CPU, FP16 for GPU). - License: MIT (inherited from the base model).
How TOPICALML uses it (wire contract)
Zero-shot topic classification is run as NLI: premise = the user prompt, hypothesis =
"This text is about <label>.". The gateway takes softmax over the entailment vs
contradiction logits (neutral is ignored); the entailment probability is the on-topic score.
The Go scorer (internal/topicalml/scorer.go) depends on this contract, validated at export:
- Inputs: exactly
input_ids+attention_mask(mDeBERTa-v3 hastype_vocab_size=0, so notoken_type_ids). - Output: 3 logits ordered
0=entailment,1=neutral,2=contradiction.
Sanity (premise about weapons): P(entailment | "about weapons") = 0.998, P(entailment | "about cooking") = 0.001.
Layout
| Path | Precision | Use |
|---|---|---|
onnx/int8/model_quantized.onnx |
INT8 dynamic-quant | CPU (edge/hub hot path) |
onnx/fp16/model.onnx |
FP16 | GPU (CUDA execution provider) |
onnx/fp32/model.onnx |
FP32 | source for re-quantization |
onnx/int8/tokenizer.json |
— | fast tokenizer (loaded by the gateway) |
Scope
The classifier scores topic presence, not intent: a benign text discussing a blocked topic (e.g. an essay arguing against weapons) scores on-topic. TOPICALML defaults to shadow and requires a calibrated threshold before enforcing.
Model tree for HikmaAI/hikmaai-mdeberta-v3-base-xnli-multilingual
Base model
MoritzLaurer/mDeBERTa-v3-base-mnli-xnli