youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[Doc] Add xgrammar in doc (#11549)

Browse Source 
Signed-off-by: ccjincong <chenjincong11@gmail.com>
This commit is contained in:
Chen1022
2024-12-27 21:05:10 +08:00
committed by GitHub
parent 7af553ea30
commit 5ce4627a7e
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/usage/structured_outputs.md
View File

@ -2,7 +2,7 @@
# Structured Outputs # Structured Outputs
vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines) or [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer) as backends for the guided decoding. vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines), [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer), or [xgrammar](https://github.com/mlc-ai/xgrammar) as backends for the guided decoding.
This document shows you some examples of the different options that are available to generate structured outputs. This document shows you some examples of the different options that are available to generate structured outputs.
## Online Inference (OpenAI API) ## Online Inference (OpenAI API)