Files
vllm/docs/features/quantization
2025-08-08 03:02:51 -07:00
..

Quantization

Quantization trades off model precision for smaller memory footprint, allowing large models to be run on a wider range of devices.

Contents: