3.5.2 breaks local docs, causing hallucinations when asked about local doc.

[AthanImmortal]

Bug Report

As of 3.5.2, models asked about a local doc will produce hallucinations for even simple questions. They still appear to reference the local doc, but make up answers.

Steps to Reproduce

I made an example document with a short story to illustrate the problem - Midwest.docx

1. Load Midwest.docx into local docs
2. Load Nous Hermes 2 Mistral DPO with default settings
3. Ask it "Can you list the characters."

Expected Behavior

Working behaviour from 3.4.2 -

In 3.4.2 the same model would reply with:
The characters in the Midwest data set are:
Ryan
Elaine
Brandon
Cheryl
Henry

You could also follow up with a question like "What does Henry do for a living?"
In the Midwest data set, Henry is described as having worked as a stock trader in the city before returning to Willowbrook.

Broken behaviour from 3.5.2

Your Environment

• GPT4All version: 3.5.2
• Operating System: Linux Mint 22
• Chat model used (if applicable): Nous Hermes 2 Mistral DPO
  Same happens with Llama 3 8B Instruct which previously worked.

[manyoso]

#3302 fixes

[AthanImmortal]

Fixed as of 3.5.3, thank you to Jared Van Bortel and Adam Treat from Nomic AI for the fixes.