It seems to have a different architecture from DeepSeek V4.

[DDDMUC]

I have a couple of questions:

1. Which variant are you using - HC or mHC?
2. From my understanding, DeepSeek V4 uses HCA and CSA instead of MLA. Does this implementation actually use MLA, or is it HCA&CSA and the README just needs to be updated?