This website requires JavaScript.
Explore
Help
Sign In
youngkingdom
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
Wiki
Activity
Files
91c9ebbb1bfc39e98aa2bd444b9569e5f2f92c9e
vllm
/
tests
/
spec_decode
History
youkaichao
e893795443
[2/N] executor pass the complete config to worker/modelrunner (
#9938
)
...
Signed-off-by: youkaichao <
youkaichao@gmail.com
> Co-authored-by: Nick Hill <
nhill@redhat.com
>
2024-11-02 07:35:05 -07:00
..
e2e
[Hardware][ROCM] using current_platform.is_rocm (
#9642
)
2024-10-28 04:07:00 +00:00
__init__.py
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (
#3103
)
2024-03-08 23:32:46 -08:00
test_batch_expansion.py
[BugFix] Fix use of per-request seed with pipeline parallel (
#6698
)
2024-07-30 10:40:08 -07:00
test_dynamic_spec_decode.py
[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. (
#6485
)
2024-07-20 23:58:58 -07:00
test_metrics.py
[Bugfix] [SpecDecode] AsyncMetricsCollector: update time since last collection (
#6578
)
2024-07-19 14:01:03 -07:00
test_multi_step_worker.py
[Spec Decode] (1/2) Remove batch expansion (
#8839
)
2024-10-01 16:04:42 -07:00
test_ngram_worker.py
[Speculative Decoding] Enabling bonus token in speculative decoding for KV cache based models (
#5765
)
2024-07-10 16:02:47 -07:00
test_scorer.py
[SpecDec] Remove Batch Expansion (2/3) (
#9298
)
2024-10-12 05:13:37 +00:00
test_spec_decode_worker.py
[Spec Decode] (1/2) Remove batch expansion (
#8839
)
2024-10-01 16:04:42 -07:00
test_utils.py
[Bugfix] Unify rank computation across regular decoding and speculative decoding (
#7899
)
2024-08-28 22:18:13 -07:00
utils.py
[2/N] executor pass the complete config to worker/modelrunner (
#9938
)
2024-11-02 07:35:05 -07:00