Split messages into multiple intents

[svenseeberg]

Questions/messages can contain multiple intents/ideas that might influence the search and therefore not yield good results. We could use an LLM first to split the incoming message into multiple search queries that can be used to retrieve relevant pages:

The lists of documents should then probably be merged and sorted by scores. We should probably use a JSON response for this. Instead of simply using the last message to derive search terms, we can use the last N user messages to derive a search term, see #126 . This would get us most of the way towards #229

[svenseeberg]

Alternative: break down the initial question/message into multiple questions and let the RAG answer each one individually.