parent
d3b5b98021
commit
57792ed469
@ -234,10 +234,10 @@ Multimodal Language Models
|
|||||||
- Image
|
- Image
|
||||||
- :code:`openbmb/MiniCPM-V-2` (see note), :code:`openbmb/MiniCPM-Llama3-V-2_5`, :code:`openbmb/MiniCPM-V-2_6`, etc.
|
- :code:`openbmb/MiniCPM-V-2` (see note), :code:`openbmb/MiniCPM-Llama3-V-2_5`, :code:`openbmb/MiniCPM-V-2_6`, etc.
|
||||||
-
|
-
|
||||||
* - :code: `UltravoxModel`
|
* - :code:`UltravoxModel`
|
||||||
- Ultravox
|
- Ultravox
|
||||||
- Audio
|
- Audio
|
||||||
- :code: `fixie-ai/ultravox-v0_3`
|
- :code:`fixie-ai/ultravox-v0_3`
|
||||||
-
|
-
|
||||||
|
|
||||||
.. note::
|
.. note::
|
||||||
|
@ -1,6 +1,6 @@
|
|||||||
"""
|
"""
|
||||||
This example shows how to use vLLM for running offline inference
|
This example shows how to use vLLM for running offline inference
|
||||||
with the correct prompt format on vision language models.
|
with the correct prompt format on audio language models.
|
||||||
|
|
||||||
For most models, the prompt format should follow corresponding examples
|
For most models, the prompt format should follow corresponding examples
|
||||||
on HuggingFace model repository.
|
on HuggingFace model repository.
|
||||||
|
Loading…
x
Reference in New Issue
Block a user