23 lines
280 B
Markdown
23 lines
280 B
Markdown
|
# Optional Parameters
|
||
|
|
|
||
|
|
Optional parameters for vLLM APIs.
|
||
|
|
|
||
|
|
(sampling-params)=
|
||
|
|
|
||
|
|
## Sampling Parameters
|
||
|
|
|
||
|
|
```{eval-rst}
|
||
|
|
.. autoclass:: vllm.SamplingParams
|
||
|
|
:members:
|
||
|
|
```
|
||
|
|
|
||
|
|
(pooling-params)=
|
||
|
|
|
||
|
|
## Pooling Parameters
|
||
|
|
|
||
|
|
```{eval-rst}
|
||
|
|
.. autoclass:: vllm.PoolingParams
|
||
|
|
:members:
|
||
|
|
```
|
||
|
|
|