20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
vllm/docs/source/api/inference_params.md
Cyrus Leung 65097ca0af
[Doc] Add model development API Reference (#11884) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2025-01-09 09:43:40 +00:00

281 B
Raw Blame History

Inference Parameters

Inference parameters for vLLM APIs.

(sampling-params)=

Sampling Parameters

.. autoclass:: vllm.SamplingParams
    :members:

(pooling-params)=

Pooling Parameters

.. autoclass:: vllm.PoolingParams
    :members: