Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Commit 47e7724

Browse files
committed
update n_paralel default value
1 parent 9538a7c commit 47e7724

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -100,7 +100,7 @@ Table of parameters
100100
| `ngl` | Integer | The number of GPU layers to use. |
101101
| `ctx_len` | Integer | The context length for the model operations. |
102102
| `embedding` | Boolean | Whether to use embedding in the model. |
103-
| `n_parallel` | Integer | The number of parallel operations. Uses Drogon thread count if not set. |
103+
| `n_parallel` | Integer | The number of parallel operations. |
104104
| `cont_batching` | Boolean | Whether to use continuous batching. |
105105
| `user_prompt` | String | The prompt to use for the user. |
106106
| `ai_prompt` | String | The prompt to use for the AI assistant. |

docs/openapi/NitroAPI.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ openapi: 3.0.0
22
info:
33
title: Nitro API
44
description: Please see https://nitro.jan.ai/ for documentation.
5-
version: "0.1.8"
5+
version: "0.1.19"
66
contact:
77
name: Nitro Discord
88
url: https://github.com/janhq/nitro
@@ -231,8 +231,8 @@ components:
231231
description: Whether to use continuous batching.
232232
n_parallel:
233233
type: integer
234-
default: Automatically set to Dragon threads
235-
example: 4
234+
default: 1
235+
example: 1
236236
nullable: true
237237
description: The number of parallel operations. Only set when enable continuous batching.
238238
cpu_threads:

0 commit comments

Comments
 (0)