Yuge Zhang 24f4d1a224 Add return_token_ids parameter to OpenAI API endpoints (#22587) ...

Signed-off-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

2025-08-19 09:48:31 -07:00

..

correctness

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

tool_parsers

[Frontend] Added support for HermesToolParser for models without special tokens (#16890)

2025-08-16 17:38:42 +00:00

__init__.py

[CI/Build] [3/3] Reorganize entrypoints tests (#5966)

2024-06-30 12:58:49 +08:00

test_async_tokenization.py

Drop flaky test_healthcheck_response_time (#22539)

2025-08-08 16:56:47 -07:00

test_audio.py

[CI Failure] Use float32 for tests/entrypoints/openai/test_audio.py (#22686)

2025-08-11 20:20:42 -07:00

test_basic.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_chat_echo.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_chat_logit_bias_validation.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_chat_template.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_chat_with_tool_reasoning.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_chat.py

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

test_chunked_prompt.py

docs: remove deprecated disable-log-requests flag (#22113)

2025-08-02 00:19:48 -07:00

test_classification.py

[Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930)

2025-08-11 09:41:37 -07:00

test_cli_args.py

[Bugfix][Frontend] Fix openai CLI arg middleware (#21220)

2025-07-19 02:40:38 -07:00

test_completion_with_function_calling.py

[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named function calling when Thinking is disabled (#21573)

2025-07-27 22:43:50 -07:00

test_completion_with_prompt_embeds.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_completion.py

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

test_default_mm_loras.py

[Flaky CI] Increase timeout tolerance for test_mp_crash_detection+test_default_mm_lora_chat_completions (#23028)

2025-08-16 18:33:08 +00:00

test_embedding_dimensions.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_embedding_long_text.py

[Frontend] Add chunked processing to handle long inputs in embedding models (#22280)

2025-08-13 04:14:24 -07:00

test_embedding.py

[Model] Pooling model activation supports per request control by PoolingParams (#20538)

2025-08-05 00:37:00 -07:00

test_encoder_decoder.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_lora_adapters.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_lora_resolvers.py

[Frontend] Update OpenAI error response to upstream format (#22099)

2025-08-06 23:06:00 -07:00

test_metrics.py

[Frontend] run-batch supports V1 (#21541)

2025-07-24 20:05:55 -07:00

test_models.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oot_registration.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_openai_schema.py

Add return_token_ids parameter to OpenAI API endpoints (#22587)

2025-08-19 09:48:31 -07:00

test_optional_middleware.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_pooling.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_prompt_validation.py

[BugFix] Add support for loading prompt embeds tensors serialized on unavailable devices and sparse tensors (#22962)

2025-08-16 06:25:10 +00:00

test_rerank.py

Support token_type_ids in V1 with less code changes (#21985)

2025-08-10 22:54:59 -07:00

test_response_api_with_harmony.py

[gpt-oss] Add test for response API + harmony (but skipped) (#22554)

2025-08-11 17:47:24 -07:00

test_return_token_ids.py

Add return_token_ids parameter to OpenAI API endpoints (#22587)

2025-08-19 09:48:31 -07:00

test_return_tokens_as_ids.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00

test_root_path.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_run_batch.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_score.py

Support token_type_ids in V1 with less code changes (#21985)

2025-08-10 22:54:59 -07:00

test_serving_chat.py

[Front-end] microbatch tokenization (#19334)

2025-07-07 17:54:10 +01:00

test_serving_models.py

[Frontend] Update OpenAI error response to upstream format (#22099)

2025-08-06 23:06:00 -07:00

test_shutdown.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_skip_tokenizer.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_sleep.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_tensorizer_entrypoint.py

[CI/Build] Fix tensorizer test for load_format change (#22583)

2025-08-10 19:30:00 -07:00

test_tokenization.py

feat - add a new endpoint get_tokenizer_info to provide tokenizer/chat-template information (#20575)

2025-07-16 21:52:14 +08:00

test_transcription_validation.py

[CI] Speed up Whisper tests by reusing server (#22859)

2025-08-15 16:56:31 -04:00

test_translation_validation.py

[CI] Speed up Whisper tests by reusing server (#22859)

2025-08-15 16:56:31 -04:00

test_truncation.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_uds.py

[Frontend] Add unix domain socket support (#18097)

2025-08-08 16:23:44 -07:00

test_video.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_vision_embedding.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_vision.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00