You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
Copy file name to clipboardExpand all lines: README.md
+19-12Lines changed: 19 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -23,6 +23,23 @@
23
23
24
24
## Documentation
25
25
26
+
## About Nitro
27
+
28
+
Nitro is a light-weight integration layer (and soon to be inference engine) for cutting edge inference engine, make deployment of AI models easier than ever before!
29
+
30
+
The binary of nitro after zipped is only ~3mb in size with none to minimal dependencies (if you use a GPU need CUDA for example) make it desirable for any edge/server deployment 👍.
31
+
32
+
### Repo Structure
33
+
34
+
```
35
+
.
36
+
├── controllers
37
+
├── docs
38
+
├── llama.cpp -> Upstream llama C++
39
+
├── nitro_deps -> Dependencies of the Nitro project as a sub-project
0 commit comments