How to use from the
Use from the
MLC-LLM library
# No code snippets available yet for this library.

# To use this model, check the repository files and the library's documentation.

# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js

4-bit OmniQuant quantized version of Llama-3.2-3B-Instruct-uncensored.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for numen-tech/Llama-3.2-3B-Instruct-uncensored-w4a16g128asym

Quantized
(45)
this model

Paper for numen-tech/Llama-3.2-3B-Instruct-uncensored-w4a16g128asym