Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
-
Updated
Apr 22, 2026 - TypeScript
#
private-llm
Here are 11 public repositories matching this topic...
The Privacy Firewall for LLMs
privacy mcp claude anonymization pdf-processing pseudonymization pdf-redaction private-llm model-context-protocol mcp-server pdf-pseudonymization
-
Updated
Aug 11, 2025 - Python
Multi-model LLM serving for NVIDIA DGX Spark with vLLM, web UI, and tool calling
-
Updated
Jan 24, 2026 - Python
Verify claims using AI agents that debate using scraped evidence and local language models.
python scraping beautifulsoup autonomous-agents local-inference qwen lm-studio langgraph private-llm agentic-ai claim-verification phi-4-mini evidence-based-ai
-
Updated
Jun 1, 2025 - Python
AI tool to help users research using local LLMs and automated web search.
python google gemma streamlit lm-studio langgraph private-llm tavily-api privacy-first-ai tavily-search next-gen-ai google-gemma-3-1b instruction-tuned-llm gguf-model-support
-
Updated
Jun 9, 2025 - Python
Create a Small LLM using EleutherAI/gpt-neo-2.7B - Fine Tune It for a Specalized Purpouse and Leverage as a Co-Pilot
-
Updated
May 23, 2024 - HTML
Bot for IRC and Discord with LocalLLM and LLM support
-
Updated
Dec 27, 2025 - Python
Private Retrieval-Augmented Generation (RAG) runtime enabling offline document intelligence using local embeddings and Ollama-hosted LLMs.
offline-first private privacy-preserving rag llm generative-ai local-llm retrieval-augmented-generation local-ai offline-llm offline-ai rag-chatbot private-ai private-llm laptop-llm
-
Updated
Mar 1, 2026 - Python
Lead Enterprise Architect | Specialized in Sovereign AI, Zero-Trust Frameworks & DORA/PSD2 Compliance for Tier-2 Banks. Operating under strict NDA protocols.
sca gdpr regtech psd2 zero-trust mtls air-gapped enterprise-security audit-trails nis2 mistral-ai private-llm secure-deployment self-hosted-ai sovereign-ai financial-infrastructure dora-compliance nist-800-207 b2b-fintech
-
Updated
Apr 26, 2026
A complete, production-grade GitHub repository ecosystem engineered for founders, CISOs, and technical operators who cannot afford to be misread. Thirteen interconnected documents covering legal entity, threat modelling methodology, architecture doctrine, service catalogue, case studies, and engagement protocols .
self-hosted secops cybersecurity access-control system-architecture zero-trust digital-sovereignty security-by-design ai-governance enterprise-automation private-llm ai-infrastructure sovereign-ai automation-empire executive-strategy hardened-systems high-trust-systems
-
Updated
Apr 26, 2026 - HTML
Sovereign AI Infrastructure: A Hardened-by-Design approach to private LLM deployment. Engineered for Fiscal Efficiency and zero-trust security.
devsecops zero-trust finops pulumi cloud-cost-optimization private-llm sovereign-ai hardened-by-design
-
Updated
Feb 9, 2026 - Python
Improve this page
Add a description, image, and links to the private-llm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the private-llm topic, visit your repo's landing page and select "manage topics."