Memmap preferences format

[Jayant1234]

Are the preferences sequence in memmap files supposed to contain the prompt as well? i.e prompt + pref_1 , prompt+pref_2?
While another file tells the prompt length so that we can glean prompt from the preferences?
OR
prompts are stored somewhere else?

[lucidrains]

they both contain the prompt, and the prompt_len is also stored

[Jayant1234]

Thanks for the clarification! Also huge respect for making this Repo!