We need to also consider you will need to send some contextual info to the LLM too
e.g. the user searched, clicked on some tools, and want to ask a question about these tools > they should be able to just ask in the chat bot window > you send me the info where the user is so that I can properly answer based on context