Hugging Face's logo

featherless-ai-quants
/
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
 Community
m8than commited on
Commit
a2ac67b
·
verified ·
1 Parent(s): 6fddedc

Upload folder using huggingface_hub

Browse files
Files changed (26) hide show
  1. .gitattributes +24 -0
  2. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-IQ4_XS.gguf +3 -0
  3. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q2_K.gguf +3 -0
  4. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_L.gguf +3 -0
  5. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_M.gguf +3 -0
  6. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_S.gguf +3 -0
  7. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_M.gguf +3 -0
  8. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_S.gguf +3 -0
  9. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_M.gguf +3 -0
  10. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_S.gguf +3 -0
  11. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00001-of-00006.gguf +3 -0
  12. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00002-of-00006.gguf +3 -0
  13. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00003-of-00006.gguf +3 -0
  14. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00004-of-00006.gguf +3 -0
  15. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00005-of-00006.gguf +3 -0
  16. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00006-of-00006.gguf +3 -0
  17. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00001-of-00008.gguf +3 -0
  18. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00002-of-00008.gguf +3 -0
  19. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00003-of-00008.gguf +3 -0
  20. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00004-of-00008.gguf +3 -0
  21. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00005-of-00008.gguf +3 -0
  22. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00006-of-00008.gguf +3 -0
  23. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00007-of-00008.gguf +3 -0
  24. FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00008-of-00008.gguf +3 -0
  25. README.md +47 -0
  26. featherless-quants.png +3 -0
.gitattributes CHANGED
@@ -33,3 +33,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
46
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
47
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
48
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
49
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
50
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
51
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
52
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
53
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
54
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
55
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
56
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
57
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
58
+ FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
59
+ featherless-quants.png filter=lfs diff=lfs merge=lfs -text
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f8f34adb7b36af2a2bd8672369bb2810da52cd32e42dde0cdf38df2e0d7054a
3
+ size 17870100448
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b05608754c86624067638d0b71913ac7ccd117e5f5600786cdf80805260c2502
3
+ size 12313098208
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c2fd4453e52e3c085c34978f79eb70d34019a137deadd477be92b3f6a717acb
3
+ size 17247078368
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c2a319f1690fcebdb1ccd53eb4b1f7d211eb7b60f2c76019726526f1bfc4eaa
3
+ size 15935047648
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70d6de26f6bd548579f8ec5297b747749036ef14600c8f6fe6876c7508a26b42
3
+ size 14392330208
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b977ea16fb398b0e11301564e9819f0b828a68ce3267170284d6a91b459e9e7b
3
+ size 19851335648
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc0f42f46719579054b651b8b934c05e1f94b7e86f80f725667a9cb860429bef
3
+ size 18784409568
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7abb08f313b1083dee4acc97aaec1d48fc22a4921c8198e2b7ed44a5c956a8e3
3
+ size 23262156768
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:086f2017556798ffd29174f234ebe7fe429ce3343db22c6bf0fe122406a51cc6
3
+ size 22638254048
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48f39d65172f60cfd5ebdaf91496e51923e5325198e04e39f189524d7d7b40bc
3
+ size 4999816448
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4dad95414f9faf4f40f71fb7839cf35eec6c4efb41d7990e00a93b8fa2209d2
3
+ size 4916658400
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:571ea56b2bd33a2296f4498bb4aee7b4138aa5e34ce13dec8eab902e58c2a591
3
+ size 4968338144
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20c23fbf64a7e3fba118193d245e1d98379963b7f4c321a073466516a5315d1f
3
+ size 4916658400
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4df9563479200c448fabc66b2553b2eea3ba6c53f8aec4bbd935bbbb606c90b
3
+ size 4916658400
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5dddc4a226196ba53d7017331a9037ca12c00f1817a436a140a7089871f8c7b3
3
+ size 2168025088
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:836c604f6a4660d727e4fc498da0684a0b0a3ab1ab3e2a441432ba4c4d653b41
3
+ size 4919610624
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f409aa2b220dcc048d2c7d1dee6f9d381eff669137b0cc43ababaab9b1b1bf51
3
+ size 4997470752
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a23da497212dee839b5967731e70dbed4ad1f870381420d7d66075eede9d102
3
+ size 4997450240
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ea313bdef6ff519543f6d2fa2c43aeb9839f3309dd30dd70eba2326bff2926b
3
+ size 4880513760
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1529fb02477910426064907dddd5c77b15dabf973d203b46b52ef40e198c926
3
+ size 4964002080
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:724720ddc67f883696228385738b99c3141f956c2c3902803fcdf928516bf23e
3
+ size 4880513760
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55f8aeb86b8e32d505dd19cdf48d0a4e224afc99b6f4e11a4d16a790674176ce
3
+ size 4964002048
FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0c7bb8d6b6d41251ce4d5ec57d8befc8a3c281123ec90c29cb9d2114b4ae157
3
+ size 217322144
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview
3
+ pipeline_tag: text-generation
4
+ quantized_by: featherless-ai-quants
5
+ ---
6
+
7
+ # FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview GGUF Quantizations 🚀
8
+
9
+ ![Featherless AI Quants](./featherless-quants.png)
10
+
11
+ *Optimized GGUF quantization files for enhanced model performance*
12
+
13
+ > Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
14
+ ---
15
+
16
+ ## Available Quantizations 📊
17
+
18
+ | Quantization Type | File | Size |
19
+ |-------------------|------|------|
20
+ | IQ4_XS | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-IQ4_XS.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-IQ4_XS.gguf) | 17042.26 MB |
21
+ | Q2_K | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q2_K.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q2_K.gguf) | 11742.69 MB |
22
+ | Q3_K_L | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_L.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_L.gguf) | 16448.10 MB |
23
+ | Q3_K_M | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_M.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_M.gguf) | 15196.85 MB |
24
+ | Q3_K_S | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_S.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_S.gguf) | 13725.60 MB |
25
+ | Q4_K_M | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_M.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_M.gguf) | 18931.71 MB |
26
+ | Q4_K_S | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_S.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_S.gguf) | 17914.21 MB |
27
+ | Q5_K_M | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_M.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_M.gguf) | 22184.52 MB |
28
+ | Q5_K_S | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_S.gguf](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/blob/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_S.gguf) | 21589.52 MB |
29
+ | Q6_K | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/tree/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q6_K) | 25640.64 MB (folder) |
30
+ | Q8_0 | [FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0](https://huggingface.co/featherless-ai-quants/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF/tree/main/FuseAI-FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-Q8_0) | 33207.78 MB (folder) |
31
+
32
+
33
+ ---
34
+
35
+ ## ⚡ Powered by [Featherless AI](https://featherless.ai)
36
+
37
+ ### Key Features
38
+
39
+ - 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
40
+ - 🛠️ **Zero Infrastructure** - No server setup or maintenance required
41
+ - 📚 **Vast Compatibility** - Support for 2400+ models and counting
42
+ - 💎 **Affordable Pricing** - Starting at just $10/month
43
+
44
+ ---
45
+
46
+ **Links:**
47
+ [Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
featherless-quants.png ADDED

Git LFS Details

  • SHA256: 2e1b4d66c8306c7b0614089381fdf86ea4efb02dffb78d22767a084cb8b88d6b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.61 MB