Skip to content

Commit ef543ff

Browse files
authored
Add local LLM setup guide for AiSysRev
Added a setup guide for using local LLMs with AiSysRev, specifically for MacOS with LM Studio.
1 parent c4788f6 commit ef543ff

1 file changed

Lines changed: 14 additions & 0 deletions

File tree

docs/local_models.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
> [!WARNING]
2+
> This setup guide is work in progress (WIP)
3+
4+
# Using local LLMs with AiSysRev
5+
6+
AISysRev supports local LLMs. This setup guide is intended to help setting up a local LLM and calling it successfully via the UI. Please note, that reaching an adequate paper screening output a powerful machine should be used.
7+
8+
## MacOS - LM Studio
9+
10+
1. Download and setup LM Studio
11+
2. Start the local LLM
12+
3. In AISysDev, put the following into local provider base URL:
13+
14+
TODO

0 commit comments

Comments
 (0)