Try quantization for the evaluation network

[kirillbobyrev]

• https://arxiv.org/abs/2402.17764
• https://arxiv.org/abs/2406.02528
• https://github.com/microsoft/unilm/blob/master/bitnet/The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ.pdf
• https://github.com/ridgerchu/matmulfreellm