V
vLLM
Organization
vLLM is an open-source, high-throughput, and memory-efficient inference and serving engine designed for Large Language Models.
Organization
vLLM is an open-source, high-throughput, and memory-efficient inference and serving engine designed for Large Language Models.