Cade Daniel 18bfcdd05c [Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

..

spec_decode

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

__init__.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

test_model_runner.py

[Experimental] Prefix Caching Support (#1669)

2024-01-17 16:32:10 -08:00