2 Commits

Author	SHA1	Message	Date
Chauncey	b046cf792d	[Feature][V1]: suupports cached_tokens in response usage (#18149) ... Co-authored-by: simon-mo <xmo@berkeley.edu>	2025-05-23 01:41:03 -07:00
Lu Fang	082ab86f5f	[V1] Support long_prefill_token_threshold in v1 scheduler (#15419) ... Signed-off-by: Lu Fang <lufang@fb.com>	2025-03-25 14:22:26 -07:00