Can we use/test it with local llm models running through llama.cpp/ollama ?

[Greatz08]

I am interested to test it with local llm models instead of just limited proprietary options as recently released open weights models be it small models or big are performing greatly in agentic task too and i believe many would like to test this project with open weight models, so do let me know if it is possible or not and if not then it would be great if you could change the architecture of project in such a way where it can use great open source project like litellm (https://github.com/BerriAI/litellm/) which can assist people in using many open weights or proprietary llm's easily with the help of it.

Btw thank you very much for this great project devs :-))

[zaidrabeh]

Have you found a solution to use it with local LLM ?
Or is it already supporting local LLM use, such as ollama ?