Cade Daniel e95cd87959 [Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

..

output_processor

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

test_computed_prefix_blocks.py

Fix auto prefix bug (#3239)

2024-03-07 16:37:28 -08:00

test_detokenization.py

[Core] [Frontend] Make detokenization optional (#3749)

2024-04-03 21:52:18 -07:00

test_stop_reason.py

[BugFix] Fix handling of stop strings and stop token ids (#3672)

2024-04-11 15:34:12 -07:00

test_stop_strings.py

[BugFix] Fix handling of stop strings and stop token ids (#3672)

2024-04-11 15:34:12 -07:00