Foundry Local

This repository contains examples and instructions for using the Foundry Local SDK with Python, along with integration with OpenAI's SDK, Langchain, and Open WebUI.

Install Foundry Local SDK in User Mode

pip install foundry-local-sdk --user

Install the OpenAI SDK in User Mode

pip install openai --user

Install the Langchain SDK in User Mode

pip install langchain[openai] --user

Install HTTP requests in User Mode

pip install requests --user

Install Open WebUI in User Mode

pip install open-webui --user

If pip fails to find a distribution, use the uvx method instead (recommended on Windows):

$env:DATA_DIR="C:\open-webui\data"; uvx --python 3.11 open-webui@latest serve

Note: Open WebUI expects Python 3.11.

Run Open WebUI

This will start server at http://localhost:8080

open-webui serve

Resources

• Foundry Local SDK - Python

• Integrate with Inference SDKs

• Build a translation app with LangChain

• Open WebUI