Sglang

[ehartford]

Requesting sglang integration
This is awesome

[HanGuo97]

Unfortunately, I’m quite bandwidth-bound to work on this, but I really like this suggestion and will keep it in mind if I ever find a chance to work on it!