youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
306923da82535593bc508cc4e039bdec55159e9f
vllm/tests
History
Woosuk Kwon 3243158336 [V1] Move KV block hashes from Request to KVCacheManager (#12922) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
2025-02-07 19:14:10 -08:00
..
async_engine
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
basic_correctness
[MISC] Remove model input dumping when exception (#12582)
2025-02-03 13:34:16 -08:00
compile
[torch.compile] PyTorch 2.6 and nightly compatibility (#12393)
2025-02-07 01:09:07 +08:00
core
[Core] Improve hash collision avoidance in prefix caching (#12621)
2025-02-03 16:28:20 -08:00
data
[Bugfix] Fix load config when using bools (#9533)
2024-10-27 13:46:41 -04:00
distributed
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
encoder_decoder
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
engine
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
entrypoints
[Misc] Remove unnecessary detokenization in multimodal processing (#12868)
2025-02-07 06:21:17 -08:00
kernels
Add Bamba Model (#10909)
2025-02-06 15:22:42 -08:00
kv_transfer
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
lora
[V1] LoRA Support (#10957)
2025-02-06 09:32:51 -08:00
metrics
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
model_executor
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
models
Add Bamba Model (#10909)
2025-02-06 15:22:42 -08:00
mq_llm_engine
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
multi_step
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
multimodal
[Bugfix] Fix CI failures for InternVL and Mantis models (#12728)
2025-02-04 23:54:23 +08:00
neuron
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
plugins
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
plugins_tests
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
prefix_caching
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
prompt_adapter
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
prompts
[BugFix] Fix input positions for long context with sliding window (#2088)
2023-12-13 12:28:13 -08:00
quantization
[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)
2025-02-07 08:13:43 -08:00
runai_model_streamer
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
samplers
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
spec_decode
[Doc] Replace ibm-fms with ibm-ai-platform (#12709)
2025-02-04 07:05:04 +00:00
standalone_tests
make sure mistral_common not imported for non-mistral models (#12669)
2025-02-03 13:40:25 +08:00
system_messages
[V1] Implement Cascade Attention (#11635)
2025-01-01 21:56:46 +09:00
tensorizer_loader
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
tokenization
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
tool_use
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
tpu
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
tracing
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
v1
[V1] Move KV block hashes from Request to KVCacheManager (#12922)
2025-02-07 19:14:10 -08:00
vllm_test_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
weight_loading
[Misc] Update w2 scale loading for GPTQMarlinMoE (#12757)
2025-02-06 01:02:14 -08:00
worker
[AMD][ROCm] Enable DeepSeek model on ROCm (#12662)
2025-02-04 08:24:11 +00:00
__init__.py
[Small] Formatter only checks lints in changed files (#1528)
2023-10-31 15:39:38 -07:00
conftest.py
[Model] LoRA Support for Ultravox model (#11253)
2025-02-05 19:54:13 -08:00
test_cache_block_hashing.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_config.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_embedded_commit.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_inputs.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_logger.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_logits_processor.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_regression.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_sampling_params.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_scalartype.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_sequence.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_sharded_state_loader.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_utils.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
utils.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00