Skip to main content

SGLang

SGLang is an open-source inference and serving framework for language and multimodal models.

The official site includes sections for models and ecosystem information.

The official documentation provides installation, supported models and examples for deploying an inference server.

Build
github.com
SGLang official page preview
Text excerpt from the official SGLang project README. The project contributors retain their copyright. This cropped excerpt is distributed under the Apache-2.0 license. Source · Apache-2.0 · Source notice

Related websites