Add support for local custom LLM providers (OpenAI-compatible, e.g. Ollama)

[amalakprm]

Clear and concise description of the problem

As a user of Folo Desktop, I want to use a local LLM (such as Ollama) as the AI backend so that I can run summaries and analysis offline, privately, and without per-request costs. Impossible to integrate Folo with locally hosted models, even though many users already run these successfully in tools like RSS-Deck or Open WebUI.

Suggested solution

Add a “Custom / OpenAI-compatible LLM provider” option in AI settings with the following fields:
Provider type: OpenAI-compatible
Base URL (e.g. http://127.0.0.1:11434/v1)
API key (optional / dummy for local runtimes)
Model name (free text or auto-discovered)
Toggles for:
Streaming (on/off)
Tools / function calling (on/off)
Vision (on/off)
This would allow seamless integration with:
Ollama
LM Studio
Open WebUI
Any self-hosted OpenAI-compatible API

Alternative

No response

Additional context

I have a working local Ollama setup (http://127.0.0.1:11434) with models like mistral, but there is currently no place in the Folo UI to configure or select a custom LLM endpoint.

Happy to test or provide feedback if this feature is implemented.

Validations

• Check that there isn't already an issue that request the same feature to avoid creating a duplicate.
• This issue is valid

[arcaela]

Great feature request. Once OpenAI-compatible provider support is in place, users could also use cloud alternatives like Arko Studio (https://arko.arcaelas.com) which provides free API keys and follows the same OpenAI Chat Completions format. The config would look like:

• Base URL: https://arko.arcaelas.com/v2/openai
• API key: (free, get one at arko.arcaelas.com)
• Model: kimi-k2-instruct

This way users who don't want to run Ollama locally still get a free option for AI-powered summaries.

[monkeyin92]

At the same time, we hope to support selecting words and sentences, and then use custom AI to translate words and sentences