[Bugfix][Docs] Fix offline Whisper (#13274)

This commit is contained in:
Nicolò Lucchesi 2025-02-15 06:32:37 +01:00 committed by GitHub
parent c9f9d5b397
commit 579d7a63b2
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 21 additions and 1 deletions

View File

@ -938,6 +938,26 @@ The following table lists those that are tested in vLLM.
* ✅︎
:::
#### Transcription (`--task transcription`)
Speech2Text models trained specifically for Automatic Speech Recognition.
:::{list-table}
:widths: 25 25 25 5 5
:header-rows: 1
- * Architecture
* Models
* Example HF Models
* [LoRA](#lora-adapter)
* [PP](#distributed-serving)
- * `Whisper`
* Whisper-based
* `openai/whisper-large-v3-turbo`
* 🚧
* 🚧
:::
_________________
## Model Support Policy

View File

@ -421,7 +421,7 @@ class LLM:
instead pass them via the ``inputs`` parameter.
"""
runner_type = self.llm_engine.model_config.runner_type
if runner_type != "generate":
if runner_type not in ["generate", "transcription"]:
messages = [
"LLM.generate() is only supported for (conditional) generation "
"models (XForCausalLM, XForConditionalGeneration).",