Recommendations for persisting chat history locally #5860
-
Any recommendations for persisting chat history locally - which database is the best option, Sqlite, DuckDb or something else? Let's say we keep the most recent 20 messages + the System_Msg in ChatHistory and save the rest to the history-database - most likely the context needed for answering user-queries would be available in ChatHistory, but say it isn't then we could search/retrieve info from the persisted chat-history - does this sound like a reasonable approach or is there a better way to handle these scenarios? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
This makes sense as a approach may of the SQL options you described would work. |
Beta Was this translation helpful? Give feedback.
This makes sense as a approach may of the SQL options you described would work.