Kim-VL instruct微调输出乱码 #63
Description
训练数据是中文问答形式的，8bit加载模型，fp16 lora微调，大概200个迭代就开始说疯话，即使用训练数据测试输出也不对，就像“penoroloreanrochhondrondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondondododendodendodendodendodoyondondondondondodondodendyondondondoyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyondyond”这样，请问这大概率是什么原因引起的呢，用的4090，fp16加载不懂所以用的8bit