vllm/online_serving at dba68f9159e769c2783d96577dabb3aea15ad823 - vllm

chart-helm

Update PyTorch to 2.7.0 (#16859 )

2025-04-29 19:08:04 -07:00

disaggregated_serving

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

opentelemetry

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

prometheus_grafana

[V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837 )

2025-05-28 18:54:12 +00:00

structured_outputs

[Doc] Unify structured outputs examples (#18196 )

2025-06-12 22:50:31 +00:00

api_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

cohere_rerank_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

disaggregated_prefill.sh

[Frontend][Bugfix] support prefill decode disaggregation on deepseek (#14824 )

2025-03-20 00:00:33 -07:00

gradio_openai_chatbot_webserver.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

gradio_webserver.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

jinaai_rerank_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

kv_events_subscriber.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

multi_instance_data_parallel.py

Allow AsyncLLMEngine.generate to target a specific DP rank (#19102 )

2025-06-04 08:26:47 -07:00

multi-node-serving.sh

[Misc] Adding script to setup ray for multi-node vllm deployments (#12913 )

2025-02-20 21:16:40 -08:00

openai_chat_completion_client_for_multimodal.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_chat_completion_client_with_tools_required.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_chat_completion_client_with_tools.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_chat_completion_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_chat_completion_tool_calls_with_reasoning.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_chat_completion_with_reasoning_streaming.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_chat_completion_with_reasoning.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_chat_embedding_client_for_multimodal.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_classification_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_completion_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_cross_encoder_score.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_embedding_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_embedding_matryoshka_fy.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_pooling_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_transcription_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

prompt_embed_inference_with_openai_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

ray_serve_deepseek.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

retrieval_augmented_generation_with_langchain.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

retrieval_augmented_generation_with_llamaindex.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

run_cluster.sh

[Doc] Move examples into categories (#11840 )

2025-01-08 13:09:53 +00:00

sagemaker-entrypoint.sh

[Doc] Move examples into categories (#11840 )

2025-01-08 13:09:53 +00:00

streamlit_openai_chatbot_webserver.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

utils.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00