Files
vllm/docs/source/features/compatibility_matrix.md
2025-01-29 11:38:29 +08:00

5.0 KiB

(compatibility-matrix)=

Compatibility Matrix

The tables below show mutually exclusive features and the support on some hardware.

:::{note} Check the '✗' with links to see tracking issue for unsupported feature/hardware combination. :::

Feature x Feature

:::{raw} html

<style> /* Make smaller to try to improve readability */ td { font-size: 0.8rem; text-align: center; } th { text-align: center; font-size: 0.8rem; } </style>

:::

:::{list-table} :header-rows: 1 :stub-columns: 1 :widths: auto

    • Feature
    • CP
    • APC
    • LoRA
    • prmpt adptr
    • SD
    • CUDA graph
    • pooling
    • enc-dec
    • logP
    • prmpt logP
    • async output
    • multi-step
    • mm
    • best-of
    • beam-search
    • guided dec
    • prmpt adptr
    • SD
    • CUDA graph
    • pooling
    • enc-dec
    • logP
    • prmpt logP
    • async output
    • multi-step
    • mm
    • ?
    • ?
    • ?
    • best-of
    • ?
    • beam-search
    • ?
    • ?
    • guided dec
    • ?
    • ?
    • ?
    • ?

:::

(feature-x-hardware)=

Feature x Hardware

:::{list-table} :header-rows: 1 :stub-columns: 1 :widths: auto

    • Feature
    • Volta
    • Turing
    • Ampere
    • Ada
    • Hopper
    • CPU
    • AMD
    • CP
    • APC
    • LoRA
    • prmpt adptr
    • SD
    • CUDA graph
    • pooling
    • ?
    • enc-dec
    • mm
    • logP
    • prmpt logP
    • async output
    • multi-step
    • best-of
    • beam-search
    • guided dec
    • :::