User Story: Chatbot Response Time

[givecoffee]

As a user, I would want the chatbot to respond within a couple of seconds, rather than 10-15 as it is in some use cases.

Criteria to meet this:

• Add response time monitoring/logging
• Implement caching for repeated queries
• FastAPI backend tested for bottlenecks (DB queries, API calls, or embedding)
• Document the baseline stats vs. the target latency

Visualization: