Hugging Face's logo

ForeverBlue
/
PrismQuant-Llama-3.1-8B

Text Generation
prismquant
quantization
gptq
w4a4kv4
custom-code
Model card Files
xet
 Community
1
ForeverBlue commited on
Commit
aa4f44e
·
verified ·
1 Parent(s): 842af7a

Complete PrismQuant k=8 rotation factors for public loading

Browse files
Files changed (32) hide show
  1. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_00.pt +3 -0
  2. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_01.pt +3 -0
  3. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_02.pt +3 -0
  4. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_03.pt +3 -0
  5. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_04.pt +3 -0
  6. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_05.pt +3 -0
  7. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_06.pt +3 -0
  8. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_07.pt +3 -0
  9. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_08.pt +3 -0
  10. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_09.pt +3 -0
  11. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_10.pt +3 -0
  12. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_11.pt +3 -0
  13. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_12.pt +3 -0
  14. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_13.pt +3 -0
  15. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_14.pt +3 -0
  16. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_15.pt +3 -0
  17. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_16.pt +3 -0
  18. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_17.pt +3 -0
  19. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_18.pt +3 -0
  20. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_19.pt +3 -0
  21. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_20.pt +3 -0
  22. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_21.pt +3 -0
  23. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_22.pt +3 -0
  24. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_23.pt +3 -0
  25. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_24.pt +3 -0
  26. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_25.pt +3 -0
  27. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_26.pt +3 -0
  28. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_27.pt +3 -0
  29. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_28.pt +3 -0
  30. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_29.pt +3 -0
  31. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_30.pt +3 -0
  32. rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_31.pt +3 -0
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_00.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1bedf5bafe246329132dccb67d5426979ed2f448103bef8ba91fc35e37c8b6d4
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_01.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af80f93981f5964eb8c0cac546cbed8c24f749b8b91f29b91a515e0323bcaf36
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_02.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd78a30bbf35ec171d1aeae0a7326e7075a41ef85f7066d36b969f249350284a
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_03.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcf911efead9196449d5945aeda5031fb744ce47082d430a0f5a9a586e79168a
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_04.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fd7f6de48fc910fa554912c01961a73e953316d53ecd9d6ec2f59b3e43325d2
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_05.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9c6127da67dab3981aa6f74c8fa288f111f9b9251833bd1af1c141c3353c5e5
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_06.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1050818195682bddf58fe23ef4d81c3a892269ef8598a7a393d4e3eaf3b62152
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_07.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2b2ae6686ead03c7becf5f91b646c22ce186a059ceaa679d270f3066d00cdc3
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_08.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c27eedc7715c13918735d279b1626e3708627b914997c6a76eff798e0e7d5f3f
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_09.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:924167304e24145afa9a1a903f6a43c8fdf65a307da33c4ae5883315736f2e14
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_10.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a11a6da97379918fe86ccdf488147656f33cceff22f4e915c0098be353d67c8
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_11.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c7a06ddfc2c869210d0a49e05598ef8a62b038b1d9e61c30e0747f610969fa3
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_12.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aaed12875d2afd0b7cd12521482c7dd834eb4d8a3a96fc7fe8a3c64ddce49796
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_13.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4c27528fe1bf9fc5254094ac0f24a54a0b280506cbd455f0844597138aeed0a
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_14.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5393455632f7ac5d362c9b0291b9f9024c210f3e02eabe8ef0126b7707cdafaf
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_15.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a62dbe383188274a9e4f1ab85f15ba7239d965af4db3febac742304a131d90fa
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_16.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:116ef08acfb73d3002d74cfd08ca9a08476207456fdfc4e1e2a10e785a6af52f
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_17.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59d112f0bfdbd3b5b230a296152d4ffe496d89d2ba22b99dcc6a9f53466a281a
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_18.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58d374ccca3c6b4170ac63c723e96182eedac5f8cd98e58b2c9227ebcf10d9f1
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_19.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64e7fdbf5f9737919e2b2b77a426ed9466d9228752a06f512abd641c86548bb5
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_20.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a48de0c2760cb49176c4031e47f7160788cde33389e0e22d072ebd28f6822392
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_21.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e6078ce702c7a6ca387bde921fe26b3f9fceb54c34dbc4f91f486c7f491eb7c
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_22.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e51504a941935a6284fa19692d24842b2a63b427b4433a976cd78f3c7387e82d
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_23.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2eb28ea2fa56b8694b5e1a0fc56109258f757248e787161b55e5207cdf60c4a6
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_24.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cedca8fa26f174a2216e4932ef447d0bea24c9312c0bbd4b3b493e89cdab190
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_25.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efc3134bf48036920272d81b6f3521954665502d570bdab43bee5f29e4041519
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_26.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c5372a7286a2f9634ef3c21bd09f860509bf3a1a76c917c53641f8a1f48dbbc
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_27.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:518777804997355f800fcc462394a291730fd3edd0947ed40bb8ff16b8433484
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_28.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52a15fecc4bf1d293cc7ee2d51c226da4d32e7605e627d147d602cd0a9550c8a
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_29.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40781b32f00d2a53ed39377b9798fed8ad6298b4d0d89371ca3a26e18ef467e7
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_30.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5c55af8415db9451a0ecea98ac8d3401a4042b69af0414d97d56f396a97f95c
3
+ size 690935
rotations/llama31_8b/e11_calibration/factors/nar_b128_k8/down_layer_31.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8590fec82796666c714ba4933443bdebc251b7a46f7c5559825433e0acacd2ee
3
+ size 690935