vllm/quantization at f17aec0d6350303b46ee58d27a6fc83ddf9583b2 - vllm

Files

Reid f17aec0d63 [doc] Fold long code blocks to improve readability (#19926 )

Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

2025-06-23 05:24:23 +00:00

auto_awq.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

bitblas.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

bnb.md

[Misc] small improve (#18680 )

2025-05-25 06:05:38 -07:00

fp8.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

gguf.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

gptqmodel.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

int4.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

int8.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

modelopt.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

quantized_kvcache.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

quark.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

README.md

[Doc] Fix quantization link titles (#19478 )

2025-06-11 01:27:22 -07:00

supported_hardware.md

[Doc][Neuron] Update documentation for Neuron (#18868 )

2025-05-28 19:44:01 -07:00

torchao.md

[doc] Fold long code blocks to improve readability (#19926 )

2025-06-23 05:24:23 +00:00

README.md

title

title
Quantization

{ #quantization-index }

Quantization trades off model precision for smaller memory footprint, allowing large models to be run on a wider range of devices.

Contents: