20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[doc][misc] remove deprecated api server in doc (#6037)

Browse Source
This commit is contained in:
youkaichao 2024-07-01 09:52:43 -07:00 committed by GitHub
parent d76084c12f
commit 4050d646e5
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/serving/distributed_serving.rst
View File

@ -19,7 +19,7 @@ To run multi-GPU serving, pass in the :code:`--tensor-parallel-size` argument wh
.. code-block:: console .. code-block:: console
$ python -m vllm.entrypoints.api_server \ $ python -m vllm.entrypoints.openai.api_server \
$ --model facebook/opt-13b \ $ --model facebook/opt-13b \
$ --tensor-parallel-size 4 $ --tensor-parallel-size 4