Somes stupid questions about Lora Training
#25
by KeMiliUs - opened
Can I train loras on Anima-2.9B-int8convrot? and if i train lora on Anima 2.9B preview it will have good compatibility on Anima-2.9B convrot Checkpoint?
I've never try it, but I think int8 is for inference only. Alternatively, some tools can load the bf16 model in fp8 instead, which does the same thing.