OPEA
/

DeepSeek-R1-Distill-Qwen-32B-int4-gptq-sym-inc

4-bit precision

Model card Files Files and versions

cicdatopea commited on Feb 28, 2025

Commit

826d1dd

·

verified ·

1 Parent(s): 188fb5f

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -186,12 +186,12 @@ Here is the sample command to generate the model.
 ```bash
 auto-round  \
---model  \
 --device 0 \
 --bits 4 \
 --iter 200 \
 --disable_eval \
---format 'auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"
 ~~~

 ```bash
 auto-round  \
+--model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B \
 --device 0 \
 --bits 4 \
 --iter 200 \
 --disable_eval \
+--format 'auto_gptq,auto_round,auto_awq' \
 --output_dir "./tmp_autoround"
 ~~~