Instructions to use abenzerps/Qwen-Image-2.1-Uncensored-Quantized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use abenzerps/Qwen-Image-2.1-Uncensored-Quantized with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download abenzerps/Qwen-Image-2.1-Uncensored-Quantized --local-dir Qwen-Image-2.1-Uncensored-Quantized
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
FP8 support added.
Browse files- README.md +1 -0
- qwen-image-2.1-UC-fp8.safetensors +3 -0
README.md
CHANGED
|
@@ -31,6 +31,7 @@ GGUF quantizations of [Qwen/Qwen-Image-2.1](https://huggingface.co/Qwen/Qwen-Ima
|
|
| 31 |
| **Quantization** | **File** | **Size** |
|
| 32 |
| --- | --- | ---: |
|
| 33 |
| BF16 | [**qwen-image-2.1-UC-BF16.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-BF16.gguf) | 14.23 GB |
|
|
|
|
| 34 |
| Q8_0 | [**qwen-image-2.1-UC-Q8_0.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-Q8_0.gguf) | 7.59 GB |
|
| 35 |
| Q6_K | [**qwen-image-2.1-UC-Q6_K.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-Q6_K.gguf) | 5.88 GB |
|
| 36 |
| Q5_K_M | [**qwen-image-2.1-UC-Q5_K_M.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-Q5_K_M.gguf) | 5.22 GB |
|
|
|
|
| 31 |
| **Quantization** | **File** | **Size** |
|
| 32 |
| --- | --- | ---: |
|
| 33 |
| BF16 | [**qwen-image-2.1-UC-BF16.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-BF16.gguf) | 14.23 GB |
|
| 34 |
+
| FP8 | [**qwen-image-2.1-UC-fp8.safetensors**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-fp8.safetensors) | 6.63 GB |
|
| 35 |
| Q8_0 | [**qwen-image-2.1-UC-Q8_0.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-Q8_0.gguf) | 7.59 GB |
|
| 36 |
| Q6_K | [**qwen-image-2.1-UC-Q6_K.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-Q6_K.gguf) | 5.88 GB |
|
| 37 |
| Q5_K_M | [**qwen-image-2.1-UC-Q5_K_M.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-Uncensored-GGUF/blob/main/qwen-image-2.1-UC-Q5_K_M.gguf) | 5.22 GB |
|
qwen-image-2.1-UC-fp8.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6ff3cb225b7dfeadbfdbae78daee0b126f5dd2481b94ae0a48c7a98de4b15fc3
|
| 3 |
+
size 7116769044
|