vllm/docs/source/serving/engine_args.md

26 lines
495 B
Markdown
Raw Normal View History

(engine-args)=
# Engine Arguments
Below, you can find an explanation of every engine argument for vLLM:
```{eval-rst}
.. argparse::
:module: vllm.engine.arg_utils
:func: _engine_args_parser
:prog: vllm serve
:nodefaultconst:
```
## Async Engine Arguments
Below are the additional arguments related to the asynchronous engine:
```{eval-rst}
.. argparse::
:module: vllm.engine.arg_utils
:func: _async_engine_args_parser
:prog: vllm serve
:nodefaultconst:
```