Skip to main content

vLLM

vLLM is an open-source engine for serving language models and handling inference requests.

Use the official project to check supported models, installation instructions and deployment options for inference workloads.

Build
github.com
vLLM official page preview
Text excerpt from the official vLLM project README. The project contributors retain their copyright. This cropped excerpt is distributed under the Apache-2.0 license. Source · Apache-2.0 · Source notice

Related websites