Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Commit 07f6ac1

Browse files
committed
add Jan inter
1 parent 27e9547 commit 07f6ac1

File tree

5 files changed

+40
-56
lines changed

5 files changed

+40
-56
lines changed

docs/docs/demos/chatbox-vid.mdx

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,4 +2,23 @@
22
title: Run local chatbox under 1 minute on MacOS with Nitro
33
---
44

5-
<iframe width="675" height="380" src="https://www.youtube.com/embed/_AQXQDjw7Y8" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
5+
<iframe width="675" height="380" src="https://www.youtube.com/embed/apfI13ijvjc" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
6+
7+
## Links
8+
9+
- [Download Nitro](https://github.com/janhq/nitro/releases)
10+
- [Download Chatbox](https://github.com/Bin-Huang/chatbox)
11+
12+
## Commands
13+
14+
```bash title="Load model"
15+
curl http://localhost:3928/inferences/llamacpp/loadmodel \
16+
-H 'Content-Type: application/json' \
17+
-d '{
18+
"llama_model_path": "model/llama-2-7b-chat.Q5_K_M.gguf",
19+
"ctx_len": 512,
20+
"ngl": 100,
21+
}'
22+
```
23+
24+
For more information, please refer to the [Nitro with Chatbox](examples/chatbox.md) documentation.

docs/docs/examples/chatbox.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,4 +60,4 @@ Once the setup is complete, you can start chatting with the model using Chatbox.
6060

6161
## Futher Usage
6262

63-
For convenient usage, you can utilize [Jan](https://jan.ai/), as it is integrated with Nitro.
63+
For convenient usage, you can utilize [Jan](https://jan.ai/), as it is integrated with Nitro.

docs/docs/examples/jan.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
---
2+
title: Nitro with Jan
3+
---
4+
5+
You can effortlessly utilize Nitro through [Jan](https://jan.ai/), as it is fully integrated with all its functions. With Jan, using Nitro becomes straightforward without the need for any coding.
6+
7+
8+
<iframe width="675" height="380" src="https://www.youtube.com/embed/hw9w8_54OIc" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
9+
10+
## What is Jan?
11+
12+
Jan is a ChatGPT-alternative that runs on your own computer, with a local API server.
13+
14+
Jan uses open-source AI models, stores data in open file formats, is highly customizable via extensions.
15+
16+
For additional details, please consult the [Jan Documenation](https://jan.ai/docs).
17+
18+
> [Download Jan](https://jan.ai/)

docs/docs/examples/llm.md

Lines changed: 0 additions & 54 deletions
This file was deleted.

docs/sidebars.js

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,7 @@ const sidebars = {
5959
collapsible: false,
6060
collapsed: false,
6161
items: [
62+
"examples/jan",
6263
"examples/chatbox",
6364
"examples/openai-node",
6465
"examples/openai-python",

0 commit comments

Comments
 (0)