youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update link to KServe deployment guide (#9173)

Browse Source
This commit is contained in:
Yuan Tang
2024-10-08 23:58:49 -04:00
committed by GitHub
parent ffc4b27ea8
commit acce7630c1
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/serving/deploying_with_kserve.rst
View File

@ -5,4 +5,4 @@ Deploying with KServe
vLLM can be deployed with `KServe <https://github.com/kserve/kserve>`_ on Kubernetes for highly scalable distributed model serving.
Please see `this guide <https://kserve.github.io/website/latest/modelserving/v1beta1/llm/vllm/>`_ for more details on using vLLM with KServe.
Please see `this guide <https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/>`_ for more details on using vLLM with KServe.