Hugging Face's logo

amd
/
DeepSeek-R1-Distill-Llama-8B_rai_1.7.1_npu_16K

Text Generation
ONNX
English
amd
ryzenai
npu_16K
conversational
Model card Files
xet
 Community
AMD Upload Bot commited on
Commit
d8c3190
·
1 Parent(s): cbf8540

Add model files

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +9 -0
  2. README.md +48 -0
  3. cache/Token_rms_norm_20_16_0_0.const +3 -0
  4. cache/Token_rms_norm_20_16_0_1.const +3 -0
  5. cache/Token_rms_norm_20_16_0_10.const +3 -0
  6. cache/Token_rms_norm_20_16_0_100.const +3 -0
  7. cache/Token_rms_norm_20_16_0_1000.const +3 -0
  8. cache/Token_rms_norm_20_16_0_1001.const +3 -0
  9. cache/Token_rms_norm_20_16_0_1002.const +3 -0
  10. cache/Token_rms_norm_20_16_0_1003.const +3 -0
  11. cache/Token_rms_norm_20_16_0_1004.const +3 -0
  12. cache/Token_rms_norm_20_16_0_1005.const +3 -0
  13. cache/Token_rms_norm_20_16_0_1006.const +3 -0
  14. cache/Token_rms_norm_20_16_0_1007.const +3 -0
  15. cache/Token_rms_norm_20_16_0_1008.const +3 -0
  16. cache/Token_rms_norm_20_16_0_1009.const +3 -0
  17. cache/Token_rms_norm_20_16_0_101.const +3 -0
  18. cache/Token_rms_norm_20_16_0_1010.const +3 -0
  19. cache/Token_rms_norm_20_16_0_1011.const +3 -0
  20. cache/Token_rms_norm_20_16_0_1012.const +3 -0
  21. cache/Token_rms_norm_20_16_0_1013.const +3 -0
  22. cache/Token_rms_norm_20_16_0_1014.const +3 -0
  23. cache/Token_rms_norm_20_16_0_1015.const +3 -0
  24. cache/Token_rms_norm_20_16_0_1016.const +3 -0
  25. cache/Token_rms_norm_20_16_0_1017.const +3 -0
  26. cache/Token_rms_norm_20_16_0_1018.const +3 -0
  27. cache/Token_rms_norm_20_16_0_1019.const +3 -0
  28. cache/Token_rms_norm_20_16_0_102.const +3 -0
  29. cache/Token_rms_norm_20_16_0_1020.const +3 -0
  30. cache/Token_rms_norm_20_16_0_1021.const +3 -0
  31. cache/Token_rms_norm_20_16_0_1022.const +3 -0
  32. cache/Token_rms_norm_20_16_0_1023.const +3 -0
  33. cache/Token_rms_norm_20_16_0_1024.const +3 -0
  34. cache/Token_rms_norm_20_16_0_1025.const +3 -0
  35. cache/Token_rms_norm_20_16_0_1026.const +3 -0
  36. cache/Token_rms_norm_20_16_0_1027.const +3 -0
  37. cache/Token_rms_norm_20_16_0_1028.const +3 -0
  38. cache/Token_rms_norm_20_16_0_1029.const +3 -0
  39. cache/Token_rms_norm_20_16_0_103.const +3 -0
  40. cache/Token_rms_norm_20_16_0_104.const +3 -0
  41. cache/Token_rms_norm_20_16_0_105.const +3 -0
  42. cache/Token_rms_norm_20_16_0_106.const +3 -0
  43. cache/Token_rms_norm_20_16_0_107.const +3 -0
  44. cache/Token_rms_norm_20_16_0_108.const +3 -0
  45. cache/Token_rms_norm_20_16_0_109.const +3 -0
  46. cache/Token_rms_norm_20_16_0_11.const +3 -0
  47. cache/Token_rms_norm_20_16_0_110.const +3 -0
  48. cache/Token_rms_norm_20_16_0_111.const +3 -0
  49. cache/Token_rms_norm_20_16_0_112.const +3 -0
  50. cache/Token_rms_norm_20_16_0_113.const +3 -0
.gitattributes CHANGED
@@ -33,3 +33,12 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.const filter=lfs diff=lfs merge=lfs -text
37
+ *.fconst filter=lfs diff=lfs merge=lfs -text
38
+ *.ctrlpkt filter=lfs diff=lfs merge=lfs -text
39
+ *.meta filter=lfs diff=lfs merge=lfs -text
40
+ *.onnx.data filter=lfs diff=lfs merge=lfs -text
41
+ dd_metastate_Llm_Token_Token_rms_norm_20_16_0.state filter=lfs diff=lfs merge=lfs -text
42
+ model.onnx.data filter=lfs diff=lfs merge=lfs -text
43
+ optimized_model.onnx.data filter=lfs diff=lfs merge=lfs -text
44
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - amd
8
+ - ryzenai
9
+ - onnx
10
+ - npu_16K
11
+ ---
12
+
13
+ # DeepSeek-R1-Distill-Llama-8B_rai_1.7.1_npu_16K
14
+
15
+ - ## Introduction
16
+
17
+ This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment (Token Fusion 16K context).
18
+
19
+ - ## Quantization Strategy
20
+ - AWQ / Group 128 / Asymmetric / BFP16 activations / UINT4 Weights
21
+
22
+ - ## Quick Start
23
+
24
+ For quickstart, refer to [Ryzen AI documentation](https://ryzenai.docs.amd.com/en/latest/hybrid_oga.html)
25
+
26
+ #### Evaluation scores
27
+
28
+ _Benchmark scores not yet available for this model._
29
+
30
+ #### License
31
+
32
+ Modifications copyright(c) 2025 Advanced Micro Devices,Inc. All rights reserved.
33
+
34
+ MIT License
35
+
36
+ Copyright (c) 2025 Advanced Micro Devices, Inc
37
+
38
+ Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal
39
+ in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
40
+ copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
41
+ The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
42
+
43
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
44
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
45
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
46
+ SOFTWARE.
47
+
48
+
cache/Token_rms_norm_20_16_0_0.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5faaf1bd6de302226824af6e2043ad350a0daee389938460858e4bae6682dbfd
3
+ size 8192
cache/Token_rms_norm_20_16_0_1.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cef8d6a1190c51a38a1fdef86caa06c0ece529849a210dd7a5c0187bff485fb3
3
+ size 2
cache/Token_rms_norm_20_16_0_10.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf826480d4e2e98f536bed122e14d2f51e565d4a1617346534e41a8b29b3b2c7
3
+ size 4194304
cache/Token_rms_norm_20_16_0_100.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af88c2682f5a248dc02ff60bab8096b12f48f056323eca3eae9327ef9f4bf85b
3
+ size 131072
cache/Token_rms_norm_20_16_0_1000.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4b20ae536586d03c76c21aff9fb2f5ea759ef725f57dddae4810978d639ce01
3
+ size 524288
cache/Token_rms_norm_20_16_0_1001.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:254d3870425c4db27d67208689353f7a608952139594c01461205c0d695d04a7
3
+ size 131072
cache/Token_rms_norm_20_16_0_1002.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6ba45818356fda8008a33165e085740dbeab0672967abf180655f7b16e90db8
3
+ size 4194304
cache/Token_rms_norm_20_16_0_1003.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad7facb2586fc6e966c004d7d1d16b024f5805ff7cb47c7a85dabd8b48892ca7
3
+ size 4096
cache/Token_rms_norm_20_16_0_1004.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4adcfa703619caeac69f90bacacc7b4f12e9dd02536193586241fca804f36908
3
+ size 131072
cache/Token_rms_norm_20_16_0_1005.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a58f61f117909b1fe9226e3b02802270ca5fc19afbc507190313d8763c946cc8
3
+ size 32768
cache/Token_rms_norm_20_16_0_1006.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbbec577b8efa2540d1ea2cdc9d7489a6828fc82a049a2d263f9960129c58530
3
+ size 16777216
cache/Token_rms_norm_20_16_0_1007.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fe7b59af6de3b665b67788cc2f99892ab827efae3a467342b3bb4e3bc8e5bfe
3
+ size 16384
cache/Token_rms_norm_20_16_0_1008.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ab1734e4b7f93f8e23b7a713fdaecdd24cd21a0002864f394506dab496cdaf7
3
+ size 524288
cache/Token_rms_norm_20_16_0_1009.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28ace574e6afd55a068c81571316c5a9278603bc870cb58da1b6b4d3386139f0
3
+ size 131072
cache/Token_rms_norm_20_16_0_101.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58d914962489b77d61a66190ade5ca437914c3adc00b8fafdf6f58e8beb9cc06
3
+ size 32768
cache/Token_rms_norm_20_16_0_1010.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12548aa2455621ad110bab3c0200bedcb39d85ab1052e97de599024d2cbf9961
3
+ size 8192
cache/Token_rms_norm_20_16_0_1011.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cef8d6a1190c51a38a1fdef86caa06c0ece529849a210dd7a5c0187bff485fb3
3
+ size 2
cache/Token_rms_norm_20_16_0_1012.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6420fd83f1b673f6bd755d0fe540cd8dbcc71e0488459f4589ab04ec747ecba7
3
+ size 29360128
cache/Token_rms_norm_20_16_0_1013.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:438e04fa95595cac0b5e270bd90b6e77eaae4ed85781bfd1c11cc51d6fb3b8cd
3
+ size 1835008
cache/Token_rms_norm_20_16_0_1014.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1183c1dd6ff9733d9e55e063eebbf99536b13b4a3a50032764c40d0f9035451a
3
+ size 229376
cache/Token_rms_norm_20_16_0_1015.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f81904a9b06c58572a0e5769b3b4ffb99e7bd4be88ee8c2b64a804f483d9dc6
3
+ size 57344
cache/Token_rms_norm_20_16_0_1016.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1533ae0c96c646da5a1863ef5676ec3ab2a1e2854868aff4b1848a5495ed6fc0
3
+ size 29360128
cache/Token_rms_norm_20_16_0_1017.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50edd2e286c59707f092cd67607f94d5b0d07c31b8c93ffa29267ba6a5d1a392
3
+ size 1835008
cache/Token_rms_norm_20_16_0_1018.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ddebec06cb7a247f1b1ae03a075f558cefad61bc9d3c8ae54776d9dc7e92be1
3
+ size 229376
cache/Token_rms_norm_20_16_0_1019.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f81904a9b06c58572a0e5769b3b4ffb99e7bd4be88ee8c2b64a804f483d9dc6
3
+ size 57344
cache/Token_rms_norm_20_16_0_102.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0e0d30e51dd00d186f96b11ec41743dd3ea94e939e0a2d87d7cc11372a16b99
3
+ size 16777216
cache/Token_rms_norm_20_16_0_1020.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2ab5a9569d54f07be686247b8c65f44985ebb3f84a5aba106caec5684b63acd
3
+ size 58720256
cache/Token_rms_norm_20_16_0_1021.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fe7b59af6de3b665b67788cc2f99892ab827efae3a467342b3bb4e3bc8e5bfe
3
+ size 16384
cache/Token_rms_norm_20_16_0_1022.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9772f75f3e6656067947f00c09807a0a545710925ab3d32e7b8d7da95808b84
3
+ size 1835008
cache/Token_rms_norm_20_16_0_1023.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36b6f43bb9a1820fcf3f8886fd72e77dc18a58fde52ea85d72da21784406a2e6
3
+ size 458752
cache/Token_rms_norm_20_16_0_1024.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98a18c0cb54fa5c51b1da995301d5519321e74367865bb737b53932e8c886698
3
+ size 8192
cache/Token_rms_norm_20_16_0_1025.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cef8d6a1190c51a38a1fdef86caa06c0ece529849a210dd7a5c0187bff485fb3
3
+ size 2
cache/Token_rms_norm_20_16_0_1026.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad553a7b346767d85a34a30545c18244fa63815cc2a9c38d236a21f62074f3a2
3
+ size 525336576
cache/Token_rms_norm_20_16_0_1027.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95558825c834519fd320c52bb9075261ffe8a1e53979c690ae2358f4768b3d74
3
+ size 513024
cache/Token_rms_norm_20_16_0_1028.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2176ecd238e20ff4b5d1c1aa7ad900cb5334bc5c69d3fe2fd0a43a8b18bb58a2
3
+ size 16416768
cache/Token_rms_norm_20_16_0_1029.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50398a137d0acc7d7c4717ec83d033542fd4cb343e5ca800150f244909c3624f
3
+ size 4104192
cache/Token_rms_norm_20_16_0_103.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fe7b59af6de3b665b67788cc2f99892ab827efae3a467342b3bb4e3bc8e5bfe
3
+ size 16384
cache/Token_rms_norm_20_16_0_104.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b88bb782990e86db18ac0a99a1c61c1a7e8010c9215297b760d6b4befe4d4431
3
+ size 524288
cache/Token_rms_norm_20_16_0_105.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e506b937dbdf9450fa98d294021e8ed1b88be326dd7a0d545d5116099c4af346
3
+ size 131072
cache/Token_rms_norm_20_16_0_106.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:981efa5628b770bb17a7650fc12233bd1d8c3599189c11140a78147bff42d9d3
3
+ size 4194304
cache/Token_rms_norm_20_16_0_107.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad7facb2586fc6e966c004d7d1d16b024f5805ff7cb47c7a85dabd8b48892ca7
3
+ size 4096
cache/Token_rms_norm_20_16_0_108.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8d07980650aa18b0a6b9d48e230a2156289b172033d3a88176cda33a107544c
3
+ size 131072
cache/Token_rms_norm_20_16_0_109.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f439a36bfba81569f1e842be0e73ca5efdda63cdca43e4bc5d4d086a64c6a34f
3
+ size 32768
cache/Token_rms_norm_20_16_0_11.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad7facb2586fc6e966c004d7d1d16b024f5805ff7cb47c7a85dabd8b48892ca7
3
+ size 4096
cache/Token_rms_norm_20_16_0_110.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9f63a59cf89ffe47611f3a4debf5ce6e8ee90830c6ae0d7417426ad2cef8729
3
+ size 16777216
cache/Token_rms_norm_20_16_0_111.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fe7b59af6de3b665b67788cc2f99892ab827efae3a467342b3bb4e3bc8e5bfe
3
+ size 16384
cache/Token_rms_norm_20_16_0_112.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e0094b9e751c1763a34f48343f77da140fcbb0d02b8c729c0d0831f552bfebf
3
+ size 524288
cache/Token_rms_norm_20_16_0_113.const ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f121d0a432e4a4ba723a9becd742c95c451e78cc864e37526abdcb32b90cb11
3
+ size 131072