youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
a8439e2fd4de27e29ceb68d89f8255376ea90ec3
vllm/examples
History
Lucas Wilkinson 9c60a6299d tp1 working multistream tp > 1 broken 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
2025-05-22 20:51:36 +00:00
..
lmcache
[Misc] Fix typo (#18330)
2025-05-19 09:51:01 -07:00
offline_inference
manually manage stream
2025-05-22 20:51:36 +00:00
online_serving
[Misc] refactor prompt embedding examples (#18405)
2025-05-20 15:26:12 +00:00
other
[Doc] Fix typo in documentation (#14783)
2025-03-13 20:33:09 -07:00
basic-ub.py
tp1 working multistream tp > 1 broken
2025-05-22 20:51:36 +00:00
template_alpaca.jinja
Support chat template and echo for chat API (#1756)
2023-11-30 16:43:13 -08:00
template_baichuan.jinja
Fix Baichuan chat template (#3340)
2024-03-15 21:02:12 -07:00
template_chatglm2.jinja
Add chat templates for ChatGLM (#3418)
2024-03-14 23:19:22 -07:00
template_chatglm.jinja
Add chat templates for ChatGLM (#3418)
2024-03-14 23:19:22 -07:00
template_chatml.jinja
Support chat template and echo for chat API (#1756)
2023-11-30 16:43:13 -08:00
template_dse_qwen2_vl.jinja
[Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944)
2024-11-13 08:28:13 +00:00
template_falcon_180b.jinja
Add chat templates for Falcon (#3420)
2024-03-14 23:19:02 -07:00
template_falcon.jinja
Add chat templates for Falcon (#3420)
2024-03-14 23:19:02 -07:00
template_inkbot.jinja
Support chat template and echo for chat API (#1756)
2023-11-30 16:43:13 -08:00
template_teleflm.jinja
[Model] Support Tele-FLM Model (#15023)
2025-03-22 02:04:44 -07:00
template_vlm2vec.jinja
[Frontend] Use a proper chat template for VLM2Vec (#9912)
2024-11-01 14:09:07 +00:00
tool_chat_template_deepseekv3.jinja
[Feature] Support DeepSeekV3 Function Call (#17784)
2025-05-12 00:45:21 -07:00
tool_chat_template_granite_20b_fc.jinja
[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339)
2024-10-29 15:07:37 -07:00
tool_chat_template_granite.jinja
Change granite chat template to keep json list formatting for tool calls (#10452)
2024-11-19 18:16:54 -07:00
tool_chat_template_hermes.jinja
[Bugfix] Fix Hermes tool call chat template bug (#8256)
2024-09-07 10:49:01 +08:00
tool_chat_template_internlm2_tool.jinja
[Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405)
2024-10-04 10:36:39 +08:00
tool_chat_template_llama3.1_json.jinja
[Bugfix][Frontend] Update Llama Chat Templates to also support Non-Tool use (#10164)
2024-11-23 10:17:38 +08:00
tool_chat_template_llama3.2_json.jinja
[Misc] Update llama 3.2 template to support system prompt with images (#10901)
2024-12-05 05:54:06 +00:00
tool_chat_template_llama3.2_pythonic.jinja
[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)
2025-04-06 07:44:36 +00:00
tool_chat_template_llama4_json.jinja
Add chat template for Llama 4 models (#16428)
2025-04-24 20:19:36 +00:00
tool_chat_template_llama4_pythonic.jinja
[Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463)
2025-04-12 06:26:17 +08:00
tool_chat_template_mistral3.jinja
[Bugfix] Fix tool call template validation for Mistral models (#17644)
2025-05-08 09:47:19 +00:00
tool_chat_template_mistral_parallel.jinja
[Bugfix] example template should not add parallel_tool_prompt if tools is none (#9007)
2024-10-03 03:04:17 +00:00
tool_chat_template_mistral.jinja
[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649)
2024-09-04 13:18:13 -07:00
tool_chat_template_phi4_mini.jinja
[Frontend] Add Phi-4-mini function calling support (#14886)
2025-03-31 22:50:05 -07:00
tool_chat_template_toolace.jinja
[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)
2025-04-06 07:44:36 +00:00