20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Doc] Update tip info on using latest transformers when creating a custom Dockerfile (#15070)

Browse Source
This commit is contained in:
Marc-Alexandre Côté 2025-03-19 09:33:40 -04:00 committed by GitHub
parent 3d446433ec
commit 073d1ed354
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/deployment/docker.md
View File

@ -34,11 +34,11 @@ If you need to use those dependencies (having accepted the license terms),
create a custom Dockerfile on top of the base image with an extra layer that installs them: create a custom Dockerfile on top of the base image with an extra layer that installs them:
```Dockerfile ```Dockerfile
FROM vllm/vllm-openai:v0.7.3 FROM vllm/vllm-openai:v0.8.0
# e.g. install the `audio` and `video` optional dependencies # e.g. install the `audio` and `video` optional dependencies
# NOTE: Make sure the version of vLLM matches the base image! # NOTE: Make sure the version of vLLM matches the base image!
RUN uv pip install --system vllm[audio,video]==0.7.3 RUN uv pip install vllm[audio,video]==0.8.0
``` ```
::: :::
@ -52,7 +52,7 @@ with an extra layer that installs their code from source:
```Dockerfile ```Dockerfile
FROM vllm/vllm-openai:latest FROM vllm/vllm-openai:latest
RUN uv pip install --system git+https://github.com/huggingface/transformers.git RUN uv pip install git+https://github.com/huggingface/transformers.git
``` ```
::: :::