Load with ๐Ÿค— Transformers (trust_remote_code)

#3
by Xunzhuo - opened
vLLM Semantic Router org

Adds the model's own inference code so AutoModel.from_pretrained(repo, trust_remote_code=True) and pipeline("decision", ...) run it locally; system_one(state=..., questions=...) takes and returns System One request and response bodies. config.json keeps every Decision key and gains model_type, architectures, auto_map and custom_pipelines; the card gains a short "Use with ๐Ÿค— Transformers" section. Weights, tokenizer and every other file are unchanged.

vLLM Semantic Router org

Parity, card and Hub smoke checks passed; merging.

Xunzhuo changed pull request status to merged

Sign up or log in to comment