parent
d3b5b98021
commit
57792ed469
@ -234,10 +234,10 @@ Multimodal Language Models
|
||||
- Image
|
||||
- :code:`openbmb/MiniCPM-V-2` (see note), :code:`openbmb/MiniCPM-Llama3-V-2_5`, :code:`openbmb/MiniCPM-V-2_6`, etc.
|
||||
-
|
||||
* - :code: `UltravoxModel`
|
||||
* - :code:`UltravoxModel`
|
||||
- Ultravox
|
||||
- Audio
|
||||
- :code: `fixie-ai/ultravox-v0_3`
|
||||
- :code:`fixie-ai/ultravox-v0_3`
|
||||
-
|
||||
|
||||
.. note::
|
||||
|
@ -1,6 +1,6 @@
|
||||
"""
|
||||
This example shows how to use vLLM for running offline inference
|
||||
with the correct prompt format on vision language models.
|
||||
with the correct prompt format on audio language models.
|
||||
|
||||
For most models, the prompt format should follow corresponding examples
|
||||
on HuggingFace model repository.
|
||||
|
Loading…
x
Reference in New Issue
Block a user