Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions .dockerignore
Original file line number Diff line number Diff line change
Expand Up @@ -2,3 +2,23 @@ docs/
scripts
*.egg-info
.local
.github/
.vscode/
__pycache__/
*.pyc
*.pyo
*.pyd
*.db
*.sqlite
*.log
*.egg
*.egg-info
*.whl
*.tar.gz
*.zip
*.tar
*.gz
*.bz2
.buildcache
.pytest_cache
.git
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -8,3 +8,4 @@ pyrightconfig.json
.data
*.ipynb
.coverage*
.buildcache/
7 changes: 6 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
# Scratchpad

This is an experimental LLM serving system, forked and built on top of [SGLang SRT](https://github.com/sgl-project/sglang/tree/main/python/sglang/srt), and is used to support [SwissAI Model Serving](https://fmapi.swissai.cscs.ch/).
This is an experimental LLM serving system, forked and built on top of [SGLang SRT](https://github.com/sgl-project/sglang/tree/main/python/sglang/srt), and is used to support [SwissAI Model Serving](https://serving.swissai.cscs.ch/).

## Adoption

- [SwissAI](https://serving.swissai.cscs.ch/) - as the primary serving engine for LLMs.
- [HexGen-Flow](https://github.com/Relaxed-System-Lab/Hexgen-Flow) - as a LLM execution simulator for Text-to-SQL application.
39 changes: 0 additions & 39 deletions docker/Dockerfile.aarch64-cuda

This file was deleted.

17 changes: 0 additions & 17 deletions docker/build_image.sh

This file was deleted.

22 changes: 21 additions & 1 deletion docs/.gitignore
Original file line number Diff line number Diff line change
@@ -1 +1,21 @@
build/
# build output
dist/
# generated types
.astro/

# dependencies
node_modules/

# logs
npm-debug.log*
yarn-debug.log*
yarn-error.log*
pnpm-debug.log*


# environment variables
.env
.env.production

# macOS-specific files
.DS_Store
54 changes: 54 additions & 0 deletions docs/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
# Starlight Starter Kit: Basics

[![Built with Starlight](https://astro.badg.es/v2/built-with-starlight/tiny.svg)](https://starlight.astro.build)

```
npm create astro@latest -- --template starlight
```

[![Open in StackBlitz](https://developer.stackblitz.com/img/open_in_stackblitz.svg)](https://stackblitz.com/github/withastro/starlight/tree/main/examples/basics)
[![Open with CodeSandbox](https://assets.codesandbox.io/github/button-edit-lime.svg)](https://codesandbox.io/p/sandbox/github/withastro/starlight/tree/main/examples/basics)
[![Deploy to Netlify](https://www.netlify.com/img/deploy/button.svg)](https://app.netlify.com/start/deploy?repository=https://github.com/withastro/starlight&create_from_path=examples/basics)
[![Deploy with Vercel](https://vercel.com/button)](https://vercel.com/new/clone?repository-url=https%3A%2F%2Fgithub.com%2Fwithastro%2Fstarlight%2Ftree%2Fmain%2Fexamples%2Fbasics&project-name=my-starlight-docs&repository-name=my-starlight-docs)

> 🧑‍🚀 **Seasoned astronaut?** Delete this file. Have fun!

## 🚀 Project Structure

Inside of your Astro + Starlight project, you'll see the following folders and files:

```
.
├── public/
├── src/
│ ├── assets/
│ ├── content/
│ │ ├── docs/
│ └── content.config.ts
├── astro.config.mjs
├── package.json
└── tsconfig.json
```

Starlight looks for `.md` or `.mdx` files in the `src/content/docs/` directory. Each file is exposed as a route based on its file name.

Images can be added to `src/assets/` and embedded in Markdown with a relative link.

Static assets, like favicons, can be placed in the `public/` directory.

## 🧞 Commands

All commands are run from the root of the project, from a terminal:

| Command | Action |
| :------------------------ | :----------------------------------------------- |
| `npm install` | Installs dependencies |
| `npm run dev` | Starts local dev server at `localhost:4321` |
| `npm run build` | Build your production site to `./dist/` |
| `npm run preview` | Preview your build locally, before deploying |
| `npm run astro ...` | Run CLI commands like `astro add`, `astro check` |
| `npm run astro -- --help` | Get help using the Astro CLI |

## 👀 Want to learn more?

Check out [Starlight’s docs](https://starlight.astro.build/), read [the Astro documentation](https://docs.astro.build), or jump into the [Astro Discord server](https://astro.build/chat).
28 changes: 28 additions & 0 deletions docs/astro.config.mjs
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
// @ts-check
import { defineConfig } from 'astro/config';
import starlight from '@astrojs/starlight';
import starlightThemeFlexoki from 'starlight-theme-flexoki'

// https://astro.build/config
export default defineConfig({
integrations: [
starlight({
title: 'Scratchpad',
plugins: [starlightThemeFlexoki()],
social: [{ icon: 'github', label: 'GitHub', href: 'https://github.com/eth-easl/Scratchpad' }],
sidebar: [
{
label: 'Guides',
items: [
// Each item here is one entry in the navigation menu.
{ label: 'Example Guide', slug: 'guides/example' },
],
},
{
label: 'Reference',
autogenerate: { directory: 'reference' },
},
],
}),
],
});
19 changes: 0 additions & 19 deletions docs/examples/batch.py

This file was deleted.

52 changes: 0 additions & 52 deletions docs/examples/mllama_request.py

This file was deleted.

18 changes: 0 additions & 18 deletions docs/examples/router.py

This file was deleted.

38 changes: 0 additions & 38 deletions docs/examples/tool_calls.py

This file was deleted.

Loading
Loading