Hugging Face's logo

hellmans
/
Qwen3-8B-Uncensor-v2-GGUF

Transformers
GGUF
English
conversational
Model card Files
xet
 Community
hellmans mradermacher commited on
Commit
2ca5e91
·
0 Parent(s):

Duplicate from mradermacher/Qwen3-8B-Uncensor-v2-GGUF

Browse files

Co-authored-by: team mradermacher <mradermacher@users.noreply.huggingface.co>

Files changed (14) hide show
  1. .gitattributes +47 -0
  2. Qwen3-8B-Uncensor-v2.IQ4_XS.gguf +3 -0
  3. Qwen3-8B-Uncensor-v2.Q2_K.gguf +3 -0
  4. Qwen3-8B-Uncensor-v2.Q3_K_L.gguf +3 -0
  5. Qwen3-8B-Uncensor-v2.Q3_K_M.gguf +3 -0
  6. Qwen3-8B-Uncensor-v2.Q3_K_S.gguf +3 -0
  7. Qwen3-8B-Uncensor-v2.Q4_K_M.gguf +3 -0
  8. Qwen3-8B-Uncensor-v2.Q4_K_S.gguf +3 -0
  9. Qwen3-8B-Uncensor-v2.Q5_K_M.gguf +3 -0
  10. Qwen3-8B-Uncensor-v2.Q5_K_S.gguf +3 -0
  11. Qwen3-8B-Uncensor-v2.Q6_K.gguf +3 -0
  12. Qwen3-8B-Uncensor-v2.Q8_0.gguf +3 -0
  13. Qwen3-8B-Uncensor-v2.f16.gguf +3 -0
  14. README.md +69 -0
.gitattributes ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen3-8B-Uncensor-v2.f16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen3-8B-Uncensor-v2.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen3-8B-Uncensor-v2.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen3-8B-Uncensor-v2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen3-8B-Uncensor-v2.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen3-8B-Uncensor-v2.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen3-8B-Uncensor-v2.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen3-8B-Uncensor-v2.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen3-8B-Uncensor-v2.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen3-8B-Uncensor-v2.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen3-8B-Uncensor-v2.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen3-8B-Uncensor-v2.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-8B-Uncensor-v2.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5298f1f07665f95d282d5796c30929a1525ca304d8e3d798c35a583780f07f60
3
+ size 4593296672
Qwen3-8B-Uncensor-v2.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d84a909a7399aec29f0393e5842937ca7fa34d3607db290e90aee745774581e
3
+ size 3281732896
Qwen3-8B-Uncensor-v2.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:881587c0d68fed594d5b4e0e8c1bb91dbf3ec03ce5367161d44b06c302a17a32
3
+ size 4431394080
Qwen3-8B-Uncensor-v2.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:909d23c34f2b85e42c4f54021a1aca50df4e94b21dc84e839be68d2935fc7044
3
+ size 4124161312
Qwen3-8B-Uncensor-v2.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af7ca043c406cc1c646dfd61bd2ffca388bde6be5d78ceb55e087be8bd8c05b5
3
+ size 3769611552
Qwen3-8B-Uncensor-v2.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da4ab579079a342c5796e11b3e98626d77c9ecc252f104733d0d167cab8ed6a4
3
+ size 5027783968
Qwen3-8B-Uncensor-v2.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd34b2abdb6a42084dd8d362eab3dc51f1f84c1779a5be764747cbc4e4d6e192
3
+ size 4802012448
Qwen3-8B-Uncensor-v2.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8fb0e0635b90b9919e9fb526245d8d86ebdbf2ffb518ace0fc0e19d4d2d2972
3
+ size 5851112736
Qwen3-8B-Uncensor-v2.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:133c12f7302656e591d43ef0729c05b09e54f78cd170a53fc42b5603fff336f0
3
+ size 5720761632
Qwen3-8B-Uncensor-v2.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1297aa01268817c8fefaad453d908caef6375a92f7285d78c2b8b85010148be
3
+ size 6725899552
Qwen3-8B-Uncensor-v2.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5554c9f08f17e06f6c10313247fd0c823724ced9c7fd68412beb59f9ff18a99
3
+ size 8709518624
Qwen3-8B-Uncensor-v2.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a111f8ca89a43b28737bd5ecefc79f003822932e60e042813f71868a3e6b3db
3
+ size 16388044064
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: braindao/Qwen3-8B-Uncensored
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ mradermacher:
7
+ readme_rev: 1
8
+ quantized_by: mradermacher
9
+ tags: []
10
+ ---
11
+ ## About
12
+
13
+ <!-- ### quantize_version: 2 -->
14
+ <!-- ### output_tensor_quantised: 1 -->
15
+ <!-- ### convert_type: hf -->
16
+ <!-- ### vocab_type: -->
17
+ <!-- ### tags: -->
18
+ static quants of https://huggingface.co/braindao/Qwen3-8B-Uncensored
19
+
20
+ <!-- provided-files -->
21
+
22
+ ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-8B-Uncensor-v2-GGUF).***
23
+
24
+ weighted/imatrix quants are available at https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-i1-GGUF
25
+ ## Usage
26
+
27
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
28
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
29
+ more details, including on how to concatenate multi-part files.
30
+
31
+ ## Provided Quants
32
+
33
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
34
+
35
+ | Link | Type | Size/GB | Notes |
36
+ |:-----|:-----|--------:|:------|
37
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q2_K.gguf) | Q2_K | 3.4 | |
38
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q3_K_S.gguf) | Q3_K_S | 3.9 | |
39
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q3_K_M.gguf) | Q3_K_M | 4.2 | lower quality |
40
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q3_K_L.gguf) | Q3_K_L | 4.5 | |
41
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.IQ4_XS.gguf) | IQ4_XS | 4.7 | |
42
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q4_K_S.gguf) | Q4_K_S | 4.9 | fast, recommended |
43
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q4_K_M.gguf) | Q4_K_M | 5.1 | fast, recommended |
44
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q5_K_S.gguf) | Q5_K_S | 5.8 | |
45
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q5_K_M.gguf) | Q5_K_M | 6.0 | |
46
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q6_K.gguf) | Q6_K | 6.8 | very good quality |
47
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.Q8_0.gguf) | Q8_0 | 8.8 | fast, best quality |
48
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-8B-Uncensor-v2-GGUF/resolve/main/Qwen3-8B-Uncensor-v2.f16.gguf) | f16 | 16.5 | 16 bpw, overkill |
49
+
50
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
51
+ types (lower is better):
52
+
53
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
54
+
55
+ And here are Artefact2's thoughts on the matter:
56
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
57
+
58
+ ## FAQ / Model Request
59
+
60
+ See https://huggingface.co/mradermacher/model_requests for some answers to
61
+ questions you might have and/or if you want some other model quantized.
62
+
63
+ ## Thanks
64
+
65
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
66
+ me use its servers and providing upgrades to my workstation to enable
67
+ this work in my free time.
68
+
69
+ <!-- end -->