vllm/online_serving at c20ef40fd0e8663e82911f53d00a64f53beb98aa - vllm

chart-helm

Update PyTorch to 2.7.0 (#16859 )

2025-04-29 19:08:04 -07:00

disagg_examples

[Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957 )

2025-03-29 04:01:46 -07:00

opentelemetry

Deprecate best_of Sampling Parameter in anticipation for vLLM V1 (#13997 )

2025-03-05 20:22:43 +00:00

prometheus_grafana

fix typo of grafana dashboard, with correct datasource (#13668 )

2025-02-21 18:21:05 +00:00

api_client.py

[Misc] refactor argument parsing in examples (#16635 )

2025-04-15 08:05:30 +00:00

cohere_rerank_client.py

[Misc] refactor examples (#16563 )

2025-04-14 09:59:15 +00:00

disaggregated_prefill.sh

[Frontend][Bugfix] support prefill decode disaggregation on deepseek (#14824 )

2025-03-20 00:00:33 -07:00

gradio_openai_chatbot_webserver.py

[Misc] refactor examples series (#16708 )

2025-04-16 10:16:36 +00:00

gradio_webserver.py

[Misc] refactor argument parsing in examples (#16635 )

2025-04-15 08:05:30 +00:00

jinaai_rerank_client.py

[Misc] refactor examples (#16563 )

2025-04-14 09:59:15 +00:00

kv_events_subscriber.py

[V1][Metrics] add support for kv event publishing (#16750 )

2025-04-30 07:44:45 -07:00

kv_events.sh

[V1][Metrics] add support for kv event publishing (#16750 )

2025-04-30 07:44:45 -07:00

multi-node-serving.sh

[Misc] Adding script to setup ray for multi-node vllm deployments (#12913 )

2025-02-20 21:16:40 -08:00

openai_chat_completion_client_for_multimodal.py

[Frontend] Add missing chat templates for various MLLMs (#17758 )

2025-05-07 00:10:01 -07:00

openai_chat_completion_client_with_tools_required.py

[Misc] refactor examples series (#16708 )

2025-04-16 10:16:36 +00:00

openai_chat_completion_client_with_tools.py

[Misc] refactor examples series - Chat Completion Client With Tools (#16829 )

2025-04-18 23:24:42 +00:00

openai_chat_completion_client.py

[Misc] refactor examples (#16563 )

2025-04-14 09:59:15 +00:00

openai_chat_completion_structured_outputs_structural_tag.py

[V1] Add structural_tag support using xgrammar (#17085 )

2025-04-26 14:06:37 +00:00

openai_chat_completion_structured_outputs_with_reasoning.py

[Feature][Frontend]: Deprecate --enable-reasoning (#17452 )

2025-05-01 06:46:16 -07:00

openai_chat_completion_structured_outputs.py

Simplify (and fix) passing of guided decoding backend options (#17008 )

2025-04-29 19:02:23 +00:00

openai_chat_completion_tool_calls_with_reasoning.py

[Feature][Frontend]: Deprecate --enable-reasoning (#17452 )

2025-05-01 06:46:16 -07:00

openai_chat_completion_with_reasoning_streaming.py

[Feature][Frontend]: Deprecate --enable-reasoning (#17452 )

2025-05-01 06:46:16 -07:00

openai_chat_completion_with_reasoning.py

[Feature][Frontend]: Deprecate --enable-reasoning (#17452 )

2025-05-01 06:46:16 -07:00

openai_chat_embedding_client_for_multimodal.py

[Misc] refactor examples series (#16708 )

2025-04-16 10:16:36 +00:00

openai_completion_client.py

[Misc] refactor examples series (#16708 )

2025-04-16 10:16:36 +00:00

openai_cross_encoder_score.py

[Misc] refactor examples series (#16708 )

2025-04-16 10:16:36 +00:00

openai_embedding_client.py

[Misc] refactor examples series (#16708 )

2025-04-16 10:16:36 +00:00

openai_embedding_matryoshka_fy.py

[Frontend] Using matryoshka_dimensions control the allowed output dimensions. (#16970 )

2025-04-24 07:06:28 -07:00

openai_pooling_client.py

[Misc] refactor examples series (#16708 )

2025-04-16 10:16:36 +00:00

openai_transcription_client.py

[BugFix] Fix authorization of openai_transcription_client.py (#17321 )

2025-04-30 09:51:05 -07:00

ray_serve_deepseek.py

[Misc] Refine ray_serve_deepseek example (#17204 )

2025-04-25 16:06:59 -07:00

retrieval_augmented_generation_with_langchain.py

[doc] Add RAG Integration example (#17692 )

2025-05-06 16:10:23 +00:00

retrieval_augmented_generation_with_llamaindex.py

[doc] Add RAG Integration example (#17692 )

2025-05-06 16:10:23 +00:00

run_cluster.sh

[Doc] Move examples into categories (#11840 )

2025-01-08 13:09:53 +00:00

sagemaker-entrypoint.sh

[Doc] Move examples into categories (#11840 )

2025-01-08 13:09:53 +00:00

streamlit_openai_chatbot_webserver.py

[doc] add streamlit integration (#17522 )

2025-05-01 13:34:02 +00:00