[Doc] Add docs about OpenAI compatible server (#3288)

This commit is contained in:
Simon Mo
2024-03-18 22:05:34 -07:00
committed by GitHub
parent 6a9c583e73
commit ef65dcfa6f
10 changed files with 383 additions and 161 deletions

View File

@ -90,7 +90,7 @@ Requests can specify the LoRA adapter as if it were any other model via the ``mo
processed according to the server-wide LoRA configuration (i.e. in parallel with base model requests, and potentially other
LoRA adapter requests if they were provided and ``max_loras`` is set high enough).
The following is an example request
The following is an example request
.. code-block:: bash