Sage Moore 0edaf752d7 [Attention][DBO] Add support for "splitting" the CommonAttentionMetadata (#21153) ...

Signed-off-by: Sage Moore <sage@neuralmagic.com>

2025-08-01 19:47:53 -07:00

..

async_engine

[Deprecation] Remove TokenizerPoolConfig (#20968)

2025-07-15 14:00:50 +00:00

basic_correctness

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

benchmarks

[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)

2025-06-12 10:30:56 -07:00

compile

[CI] Initial tests for SM100 Blackwell runner (#21877)

2025-08-01 16:18:38 -07:00

config

Deprecate --disable-log-requests and replace with --enable-log-requests (#21739)

2025-08-01 17:16:37 +01:00

core

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

cuda

[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583)

2025-06-19 22:01:16 -07:00

detokenizer

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

distributed

feat(distributed): add get_required_kvcache_layout class method to kv connector api (#20433)

2025-07-30 16:41:51 +00:00

encoder_decoder

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

engine

Fix get_kwargs for case where type hint is list[Union[str, type]] (#22016)

2025-08-01 05:26:42 -07:00

entrypoints

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

fastsafetensors_loader

[Core] Support model loader plugins (#21067)

2025-07-24 01:49:44 -07:00

kernels

[Test] Add Unit Test for Batched DeepGEMM (#21559)

2025-08-02 10:45:46 +08:00

kv_transfer

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

lora

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

metrics

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

mistral_tool_use

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

model_executor

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

models

Enable headless models for pooling in the Transformers backend (#21767)

2025-08-01 10:31:29 -07:00

mq_llm_engine

Deprecate --disable-log-requests and replace with --enable-log-requests (#21739)

2025-08-01 17:16:37 +01:00

multi_step

Adding "AMD: Multi-step Tests" to amdproduction. (#19508)

2025-06-13 17:08:51 -07:00

multimodal

feat(multimodal): Add customizable background color for RGBA to RGB conversion (#22052)

2025-08-01 06:07:33 -07:00

neuron

[Misc] Remove deprecated args in v0.10 (#21349)

2025-07-22 05:26:39 -07:00

plugins

[Model][1/N] Support multiple poolers at model level (#21227)

2025-07-21 02:22:21 -07:00

plugins_tests

[custom_op][vllm-plugin] update custom_op class to use op_registry (#19164)

2025-06-20 07:44:56 -07:00

prefix_caching

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674)

2025-07-28 05:00:47 +00:00

reasoning

Add think chunk (#21333)

2025-07-23 21:51:32 -07:00

runai_model_streamer_test

[Core] Support model loader plugins (#21067)

2025-07-24 01:49:44 -07:00

samplers

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

speculative_decoding/speculators

[Speculators][Speculative Decoding] Add Qwen Eagle3 Support (#21835)

2025-08-01 19:43:37 -07:00

standalone_tests

Migrate Glm4vImageInputs, Glm4vVideoInputs to TensorSchema (#21678)

2025-07-27 22:36:08 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tensorizer_loader

[Bugfix] Fix handling of Tensorizer arguments for LoadConfig (#20643)

2025-07-09 15:36:37 +00:00

tokenization

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

tool_use

[Model] Add Qwen3CoderToolParser (#21396)

2025-07-22 15:05:57 -07:00

tools

[Perf] Validate @config in pre-commit instead of dynamically (#20200)

2025-07-01 05:10:28 -04:00

tpu

Add lora test for tp>1 case for TPU. (#21970)

2025-08-01 18:56:08 +00:00

tracing

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

v1

[Attention][DBO] Add support for "splitting" the CommonAttentionMetadata (#21153)

2025-08-01 19:47:53 -07:00

vllm_test_utils

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

weight_loading

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

worker

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

build_cython.py

[Refactor] Refactor import utils (#20269)

2025-07-01 18:05:42 -07:00

conftest.py

[Frontend] Add LLM.reward specific to reward models (#21720)

2025-07-29 20:56:03 -07:00

test_cache_block_hashing.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_config.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_embedded_commit.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_inputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_logger.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_regression.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sampling_params.py

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

test_scalartype.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_seed_behavior.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sequence.py

[V0 Deprecation] Remove V0 Spec Decode workers (#21152)

2025-07-18 21:47:50 -07:00

test_sharded_state_loader.py

[Bugfix]: fix metadata file copy in test_sharded_state_loader (#21830)

2025-07-31 06:22:11 +00:00

test_triton_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

[BugFix] make utils.current_stream thread-safety (#21252) (#21253)

2025-07-21 09:07:36 -07:00

test_version.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_vllm_port.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

Add FlashInfer allreduce RMSNorm Quant fusion (#21069)

2025-07-31 13:58:38 -07:00