Mirror 5 GGUF quantizations from syvai/hviske-v5-tiny (CC BY-NC 4.0)

.gitattributes

@@ -35,3 +35,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 hviske-v5-tiny-f16.gguf filter=lfs diff=lfs merge=lfs -text
 hviske-v5-tiny-q4_k.gguf filter=lfs diff=lfs merge=lfs -text
+hviske-v5-tiny-q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+hviske-v5-tiny-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
+hviske-v5-tiny-q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -11,7 +11,7 @@ language:
 
 # hviske-v5-tiny GGUF (mirror)
 
-This is an **unmodified mirror** of the GGUF conversions of
+This is an **unmodified mirror** of all 5 GGUF conversions of
 [`syvai/hviske-v5-tiny`](https://huggingface.co/syvai/hviske-v5-tiny), created by
 [syvai](https://huggingface.co/syvai). All credit for the model belongs to them.
 
@@ -34,8 +34,14 @@ paid version and no commercial use.
 
 | File | Size | Notes |
 | --- | --- | --- |
-| `hviske-v5-tiny-f16.gguf` | 527 MB | primary |
-| `hviske-v5-tiny-q4_k.gguf` | 160 MB | smallest |
+| `hviske-v5-tiny-f16.gguf` | 503 MB | primary, full precision, largest and slowest |
+| `hviske-v5-tiny-q8_0.gguf` | 268 MB | about half the size of f16 |
+| `hviske-v5-tiny-q6_k.gguf` | 232 MB | smaller than q8_0 |
+| `hviske-v5-tiny-q5_0.gguf` | 181 MB | smaller than q6_k |
+| `hviske-v5-tiny-q4_k.gguf` | 153 MB | smallest and fastest |
+
+The model card of the original repository reports the same Danish WER (10.51) for every
+one of these, so the choice is a size and speed trade-off rather than an accuracy one.
 
 `hviske-v5-tiny-f16.gguf` is the default Codictate uses.
 

hviske-v5-tiny-q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3301e8d10cc0a0ce3ffb519a6441404fd25aa47fb7d8f66de056f33b6a7df49
+size 190292704

hviske-v5-tiny-q6_k.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4cdbe9397f17e3bb63ba45e12567f07286332e0b8e9b5ce0c370a16afa6a5792
+size 243307232

hviske-v5-tiny-q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2b1191aaba12dcd81901d6933b2a9e592d89372da271fe2887ba3e87e2344efa
+size 281273056