Request for scripts/launch.sh and steps to reproduce Gemma quantization results

#1
by gxx - opened

Thank you for sharing this project! I am very interested in your quantization work on Gemma and would like to reproduce your quantization results.

In the instructions, I saw the command scripts/launch.sh gemma4 . However, I couldn't find the scripts/launch.sh script in the repository, I'm unsure of its exact configuration.

Could you please share the scripts/launch.sh file or provide detailed instructions on how to run the quantization script for Gemma?

Any guidance or extra details on parameters (e.g., dataset used, group size, calibration settings) would be greatly appreciated!

Thanks in advance for your help!

Sign up or log in to comment