|
| 1 | +--- |
| 2 | +title: "Deploy Mistral 7B Instruct with Open WebUI through the Linode Marketplace" |
| 3 | +description: "This guide includes instructions on how to deploy Open WebUI with Mistral 7B Instruct self-hosted LLM on an Akamai Compute Instance." |
| 4 | +published: 2026-01-26 |
| 5 | +modified: 2026-01-26 |
| 6 | +keywords: ['mistral', 'mistral-7b-instruct', 'open-webui', 'vllm', 'ai', 'llm', 'llm-inference', 'mistral-7b'] |
| 7 | +tags: ["marketplace", "linode platform", "cloud manager", "ai", "llm-inference", "llm"] |
| 8 | +aliases: ['/products/tools/marketplace/guides/mistral7b-instruct-with-openwebui/'] |
| 9 | +external_resources: |
| 10 | +- '[Open WebUI Documentation](https://docs.openwebui.com/getting-started/)' |
| 11 | +- '[Minstral Documentation](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3)' |
| 12 | +authors: ["Akamai"] |
| 13 | +contributors: ["Akamai"] |
| 14 | +license: '[CC BY-ND 4.0](https://creativecommons.org/licenses/by-nd/4.0)' |
| 15 | +marketplace_app_id: 1980062 |
| 16 | +marketplace_app_name: "Mistral 7B Instruct with Open WebUI" |
| 17 | +--- |
| 18 | + |
| 19 | +Open WebUI is an open-source, self-hosted web interface for interacting with and managing Large Language Models (LLMs). It supports multiple AI backends, multi-user access, and extensible integrations, enabling secure and customizable deployment for local or remote model inference. |
| 20 | + |
| 21 | +The Marketplace application deployed in this guide uses Mistral-7B-Instruct-v0.3 as an instruction-tuned, open-weight LLM model optimized for prompt following, reasoning, and conversational tasks. It is designed for efficient inference and integrates well with self-hosted platforms like Open WebUI for general-purpose assistance, coding, and knowledge-based workflows. |
| 22 | + |
| 23 | +## Deploying a Marketplace App |
| 24 | + |
| 25 | +{{% content "deploy-marketplace-apps-shortguide" %}} |
| 26 | + |
| 27 | +{{% content "marketplace-verify-standard-shortguide" %}} |
| 28 | + |
| 29 | +{{< note title="Estimated deployment time" >}} |
| 30 | +Open WebUI with Mistral 7B Instruct should be fully installed within 5-10 minutes after the Compute Instance has finished provisioning. |
| 31 | +{{< /note >}} |
| 32 | + |
| 33 | +## Configuration Options |
| 34 | + |
| 35 | +- **Recommended plan:** RTX4000 Ada x1 Small |
| 36 | + |
| 37 | +{{< note type="warning" >}} |
| 38 | +This Marketplace App only works with Akamai GPU instances. If you choose a plan other than GPUs, the provisioning will fail, and a notice will appear in the LISH console. |
| 39 | +{{< /note >}} |
| 40 | + |
| 41 | +### Open WebUI Options |
| 42 | + |
| 43 | +- **Linode API Token** *(required)*: Your API token is used to deploy additional Compute Instances as part of this cluster. At a minimum, this token must have Read/Write access to *Linodes*. If you do not yet have an API token, see [Get an API Access Token](/docs/products/platform/accounts/guides/manage-api-tokens/) to create one. |
| 44 | + |
| 45 | +- **Email address (for the Let's Encrypt SSL certificate)** *(required)*: Your email is used for Let's Encrypt renewal notices. This allows you to visit Open WebUI securely through a browser. |
| 46 | + |
| 47 | +- **Open WebUI admin name.** *(required)*: This is the name associated with your login and is required by Open WebUI during initial enrollment. |
| 48 | + |
| 49 | +- **Open WebUI admin email.** *(required)*: This is the email used to login into Open WebUI. |
| 50 | + |
| 51 | +{{% content "marketplace-required-limited-user-fields-shortguide" %}} |
| 52 | + |
| 53 | +{{% content "marketplace-special-character-limitations-shortguide" %}} |
| 54 | + |
| 55 | +## Getting Started After Deployment |
| 56 | + |
| 57 | +### Accessing Open WebUI Frontend |
| 58 | + |
| 59 | +Once your app has finished deploying, you can log into Open WebUI using your browser. |
| 60 | + |
| 61 | +1. Log into the instance as your limited sudo user, replacing `{{< placeholder "USER" >}}` with the sudo username you created, and `{{< placeholder "IP_ADDRESS" >}}` with the instance's IPv4 address: |
| 62 | + |
| 63 | + ```command |
| 64 | + ssh {{< placeholder "USER" >}}@{{< placeholder "IP_ADDRESS" >}} |
| 65 | + ``` |
| 66 | + |
| 67 | +2. Upon logging into the instance, a banner appears containing the **App URL**. Open your browser and paste the link to direct you to the login for Open WebUI. |
| 68 | + |
| 69 | + |
| 70 | +  |
| 71 | + |
| 72 | +3. Return to your terminal, and open the `.credentials` file with the following command. Replace `{{< placeholder "USER" >}}` with your sudo username: |
| 73 | + |
| 74 | + ```command |
| 75 | + sudo cat /home/{{< placeholder "USER" >}}/.credentials |
| 76 | + ``` |
| 77 | + |
| 78 | +4. In the `.credentials` file, locate the Open WebUI login email and password. Go back to the Open WebUI login page, and paste the credentials to log in. When you successfully login, you should see the following page. |
| 79 | + |
| 80 | + |
| 81 | +  |
| 82 | + |
| 83 | +Once you hit the "Okay, Let's Go!" button, you can start to use the chat feature in Open WebUI. |
| 84 | + |
| 85 | + |
0 commit comments