Vllm

High-throughput and memory-efficient inference and serving engine for LLMs

Project website

The package has no detailed description

channel:

unstable

version:

0.16.0

set:

python314Packages

supported:

Yes

broken:

No

license:

Free

platforms:

32

Other applications from the python314Packages set