Signed-off-by: zxw <1020938856@qq.com>
This commit is contained in:
@ -74,7 +74,7 @@ python -m vllm.entrypoints.openai.api_server --model <model>
|
||||
|
||||
That code can be found in <gh-file:vllm/entrypoints/openai/api_server.py>.
|
||||
|
||||
More details on the API server can be found in the [OpenAI-Compatible Server][openai-compatible-server] document.
|
||||
More details on the API server can be found in the [OpenAI-Compatible Server][serving-openai-compatible-server] document.
|
||||
|
||||
## LLM Engine
|
||||
|
||||
|
||||
Reference in New Issue
Block a user