vllm/docs/source/dev/engine/llm_engine.rst

LLMEngine
=================================

.. autoclass:: vllm.engine.llm_engine.LLMEngine
    :members: add_request, abort_request, step
    :show-inheritance:
[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011) 2024-01-12 11:26:49 +08:00			`LLMEngine`
			`=================================`

			`.. autoclass:: vllm.engine.llm_engine.LLMEngine`
Add distributed model executor abstraction (#3191) 2024-03-11 11:03:45 -07:00			`:members: add_request, abort_request, step`
[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011) 2024-01-12 11:26:49 +08:00			`:show-inheritance:`