shixianc 5780121c95 [Perf] Add swap_ab to SM90 FP8 non-block CUTLASS moe grouped gemm (#20911) ...

Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>

2025-07-18 04:34:43 +00:00

..

async_engine

[Deprecation] Remove TokenizerPoolConfig (#20968)

2025-07-15 14:00:50 +00:00

basic_correctness

[CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560)

2025-07-07 22:13:44 -07:00

benchmarks

[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)

2025-06-12 10:30:56 -07:00

compile

[Misc] Refactor AllReduceFusionPass. Remove parameter (#20918)

2025-07-15 06:57:40 +00:00

config

[Bugfix] Register reducer even if transformers_modules not available (#19510)

2025-07-03 22:08:12 +00:00

core

[Bugfix][Core] Prefix caching causes incorrect outputs due to outdated ComputedBlocksTracker (#18957)

2025-06-15 21:56:37 -07:00

cuda

[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583)

2025-06-19 22:01:16 -07:00

detokenizer

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

distributed

Fix inadvertently silenced PP tests for mp, add DeepSeek V2/V3 model family to PP tests (#20831)

2025-07-16 00:14:49 -07:00

encoder_decoder

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

engine

[Deprecation] Remove nullable_kvs (#20969)

2025-07-15 17:21:50 +00:00

entrypoints

[Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820)

2025-07-17 09:10:09 +00:00

fastsafetensors_loader

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

kernels

[Perf] Add swap_ab to SM90 FP8 non-block CUTLASS moe grouped gemm (#20911)

2025-07-18 04:34:43 +00:00

kv_transfer

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

lora

[Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126)

2025-07-10 21:09:37 +01:00

metrics

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

mistral_tool_use

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

model_executor

[V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975)

2025-07-10 15:30:26 -04:00

models

[VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349)

2025-07-17 03:07:55 -07:00

mq_llm_engine

[Misc] Add type assertion of request_id for LLMEngine.add_request (#19700)

2025-06-27 22:47:36 -07:00

multi_step

Adding "AMD: Multi-step Tests" to amdproduction. (#19508)

2025-06-13 17:08:51 -07:00

multimodal

[Bugfix] Replace unavailable video url in multimodal test (#20854)

2025-07-12 05:25:39 +00:00

neuron

[Refactor] Remove duplicate ceil_div (#20023)

2025-06-25 05:19:09 +00:00

plugins

[Model] Update pooling model interface (#21058)

2025-07-17 16:05:40 +00:00

plugins_tests

[custom_op][vllm-plugin] update custom_op class to use op_registry (#19164)

2025-06-20 07:44:56 -07:00

prefix_caching

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

prompt_adapter

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[Misc] Clean up mark to fork process in BNB tests (#20692)

2025-07-10 13:59:40 +00:00

reasoning

[Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820)

2025-07-17 09:10:09 +00:00

runai_model_streamer_test

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

samplers

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

spec_decode

[CI Fix] Try fixing eagle e2e test OOM by reducing block allocation (#20213)

2025-06-29 10:31:37 +08:00

standalone_tests

[CI] Sync test dependency with test.in for torch nightly (#19632)

2025-06-26 20:55:25 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tensorizer_loader

[Bugfix] Fix handling of Tensorizer arguments for LoadConfig (#20643)

2025-07-09 15:36:37 +00:00

tokenization

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

tool_use

Update kimi-k2 tool calling docs, enable unit tests (#20821)

2025-07-11 20:16:14 +00:00

tools

[Perf] Validate @config in pre-commit instead of dynamically (#20200)

2025-07-01 05:10:28 -04:00

tpu

Use w8a8 quantized matmul Pallas kernel (#19170)

2025-07-15 03:06:33 +00:00

tracing

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

v1

[Bugfix]: Fix final_res_batch list index out of range error (#21055)

2025-07-17 00:29:09 -07:00

vllm_test_utils

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

weight_loading

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

worker

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

build_cython.py

[Refactor] Refactor import utils (#20269)

2025-07-01 18:05:42 -07:00

conftest.py

[Voxtral] Add more tests (#21010)

2025-07-15 21:11:49 -07:00

test_cache_block_hashing.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_config.py

[Core] Add update_config RPC method (#20095)

2025-07-14 00:49:18 +00:00

test_embedded_commit.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_inputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_logger.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_regression.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sampling_params.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_scalartype.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_seed_behavior.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sequence.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sharded_state_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_triton_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

[Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702)

2025-07-12 06:02:10 -07:00

test_version.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_vllm_port.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[XPU] Use spawn with XPU multiprocessing (#20649)

2025-07-09 00:34:28 -07:00