vllm.entrypoints.openai.api_server
vllm serve
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: yewentao256 <zhyanwentao@126.com>
prompt_token_ids
LLM.generate
LLM.embed