Or Ozeri 9d1c50a5ac [KV offload][2/N] Introduce LRU-based CPU offloading management (#20075) ...

Signed-off-by: Or Ozeri <oro@il.ibm.com>

2025-09-19 00:20:51 +00:00

..

attention

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

core

[Chore] Cleanup guided namespace, move to structured outputs config (#22772)

2025-09-18 09:20:27 +00:00

cudagraph

[Attention] FlashAttention MLA cudagraph support (#23958)

2025-09-08 22:05:26 +00:00

e2e

[CI] Revert back prepare_prompts and check_answers (#25087)

2025-09-17 11:03:16 -07:00

engine

[Chore] Cleanup guided namespace, move to structured outputs config (#22772)

2025-09-18 09:20:27 +00:00

entrypoints

[Chore] Cleanup guided namespace, move to structured outputs config (#22772)

2025-09-18 09:20:27 +00:00

executor

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

kv_connector

[Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673)

2025-09-08 21:34:37 -07:00

kv_offload

[KV offload][2/N] Introduce LRU-based CPU offloading management (#20075)

2025-09-19 00:20:51 +00:00

logits_processors

[V1] Logits processor docs (#22919)

2025-09-17 11:53:12 -07:00

metrics

[Misc] Have AsyncLLM custom_stat_loggers extend default logger list (#20952)

2025-09-04 14:25:30 -07:00

sample

[Sampler] Support returning all prompt logprobs (#23868)

2025-09-07 19:34:31 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Spec Decode] Efficient padded speculation (#24539)

2025-09-18 01:07:24 -04:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[Core] Use CpuGpuBuffer for block table tensors (#24795)

2025-09-16 19:18:06 -07:00

tracing

[V0 Deprecation] Remove V0 Tracing & Metrics tests (#25115)

2025-09-17 19:40:44 -07:00

worker

[Core] Use CpuGpuBuffer for block table tensors (#24795)

2025-09-16 19:18:06 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[BugFix] Async scheduling and PP compatibility with DP (#23770)

2025-08-29 08:17:27 -07:00

test_external_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_hybrid_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_internal_lb_dp.py

[BugFix] Fix port lookup in internal DP LB tests (#22252)

2025-08-15 11:17:11 +08:00

test_kv_sharing.py

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[V0 Deprecation] Remove AsyncLLMEngine (#25025)

2025-09-18 11:07:42 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

2025-08-18 09:52:00 +00:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00