Files
vllm/docs/features/quantization/README.md
2025-05-23 02:09:53 -07:00

524 B

title
title
Quantization

{ #quantization-index }

Quantization trades off model precision for smaller memory footprint, allowing large models to be run on a wider range of devices.

Contents: