Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Commit f72cc2a

Browse files
committed
chatbox guide
1 parent 6c6ec99 commit f72cc2a

File tree

2 files changed

+44
-4
lines changed

2 files changed

+44
-4
lines changed

docs/docs/examples/chatbox.md

Lines changed: 44 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,10 +2,50 @@
22
title: Nitro with Chatbox
33
---
44

5-
:::info COMING SOON
6-
:::
5+
This guide demonstrates how to integrate Nitro with Chatbox, showcasing the compatibility of Nitro with various platforms.
76

8-
<!--
97
## What is Chatbox?
8+
Chatbox is a versatile desktop client that supports multiple cutting-edge Large Language Models (LLMs). It is available for Windows, Mac, and Linux operating systems.
109

11-
## How to use Nitro as backend -->
10+
For more information, please visit the [Chatbox official GitHub page](https://github.com/Bin-Huang/chatbox).
11+
12+
13+
## Downloading and Installing Chatbox
14+
15+
To download and install Chatbox, follow the instructions available at this [link](https://github.com/Bin-Huang/chatbox#download).
16+
17+
## Using Nitro as a Backend
18+
19+
1. Start Nitro server
20+
21+
Open your command line tool and enter:
22+
```
23+
nitro
24+
```
25+
26+
> Ensure you are using the latest version of [Nitro](new/install.md)
27+
28+
2. Run the Model
29+
30+
To load the model, use the following command:
31+
32+
```
33+
curl http://localhost:3928/inferences/llamacpp/loadmodel \
34+
-H 'Content-Type: application/json' \
35+
-d '{
36+
"llama_model_path": "model/llama-2-7b-chat.Q5_K_M.gguf",
37+
"ctx_len": 512,
38+
"ngl": 100,
39+
}'
40+
```
41+
42+
3. Config chatbox
43+
Adjust the `settings` in Chatbox to connect with Nitro. Change your settings to match the configuration shown in the image below:
44+
45+
![Settings](img/chatbox.PNG)
46+
47+
4. Chat with the Model
48+
49+
Once the setup is complete, you can start chatting with the model using Chatbox. All functions of Chatbox are now enabled with Nitro as the backend.
50+
51+
## Video demo

docs/docs/examples/img/chatbox.PNG

66 KB
Loading

0 commit comments

Comments
 (0)