How to use chaoliangUNSW/Jev-Style-2B-Decision-v3-MLX with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download chaoliangUNSW/Jev-Style-2B-Decision-v3-MLX --local-dir Jev-Style-2B-Decision-v3-MLX
How to use chaoliangUNSW/Jev-Style-2B-Decision-v3-MLX with jev-style:
# Apple silicon pip install "jev-style[mlx]"
from jev_style import JevStyle, noul, choice js = JevStyle.from_pretrained("chaoliangUNSW/Jev-Style-2B-Decision-v3-MLX") out = js.decide("I was charged twice for one order.", { "billing": noul("This message is about billing."), "team": choice("Which team should handle it?", ["billing", "shipping", "tech"]), }) print(out["answers"]["team"]["choice"])
https://huggingface.co/chaoliangUNSW/Jev-Style-2B-Decision-v3-MLX/resolve/11ce5d718e22412b38624bb863a1eee73c0a5934/figures/jevbench.svg
hf download hf://chaoliangUNSW/Jev-Style-2B-Decision-v3-MLX@11ce5d718e22412b38624bb863a1eee73c0a5934/figures/jevbench.svg
curl -L -o jevbench.svg https://huggingface.co/chaoliangUNSW/Jev-Style-2B-Decision-v3-MLX/resolve/11ce5d718e22412b38624bb863a1eee73c0a5934/figures/jevbench.svg
