vllm/requirements/cuda.txt

# Common dependencies
-r common.txt

numba == 0.60.0; python_version == '3.9' # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding
numba == 0.61.2; python_version > '3.9'

# Dependencies for NVIDIA GPUs
ray[cgraph]>=2.43.0, !=2.44.* # Ray Compiled Graph, required for pipeline parallelism in V1.
torch==2.6.0
torchaudio==2.6.0
# These must be updated alongside torch
torchvision==0.21.0 # Required for phi3v processor. See https://github.com/pytorch/vision?tab=readme-ov-file#installation for corresponding version
xformers==0.0.29.post2; platform_system == 'Linux' and platform_machine == 'x86_64'  # Requires PyTorch 2.6.0
[Misc] Define common requirements (#3841) 2024-04-05 00:39:17 -07:00			`# Common dependencies`
Move requirements into their own directory (#12547) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> 2025-03-08 17:44:35 +01:00			`-r common.txt`
[Misc] Define common requirements (#3841) 2024-04-05 00:39:17 -07:00
Use numba 0.61 for python 3.10+ to support numpy>=2 (#15692) Signed-off-by: cyy <cyyever@outlook.com> 2025-03-29 12:11:51 +08:00			`numba == 0.60.0; python_version == '3.9' # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding`
Update Numba to 0.61.2 (#16376) Signed-off-by: cyy <cyyever@outlook.com> 2025-04-10 15:59:37 +08:00			`numba == 0.61.2; python_version > '3.9'`
Moved numba from common requirements to cuda/rocm specific requirements (#14199) Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com> 2025-03-05 09:55:00 +05:30
[Misc] Define common requirements (#3841) 2024-04-05 00:39:17 -07:00			`# Dependencies for NVIDIA GPUs`
[Misc] Restrict ray version dependency and update PP feature warning in V1 (#15556) 2025-03-26 23:21:07 -07:00			`ray[cgraph]>=2.43.0, !=2.44.* # Ray Compiled Graph, required for pipeline parallelism in V1.`
Update to torch==2.6.0 (#12721) Signed-off-by: mgoin <michael@neuralmagic.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: luka <luka@neuralmagic.com> Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com> Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com> Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk> Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com> Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> 2025-03-14 16:58:30 -04:00			`torch==2.6.0`
			`torchaudio==2.6.0`
[Bugfix] Add phi3v resize for dynamic shape and fix torchvision requirement (#5772) 2024-06-24 12:11:53 +08:00			`# These must be updated alongside torch`
Update to torch==2.6.0 (#12721) Signed-off-by: mgoin <michael@neuralmagic.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: luka <luka@neuralmagic.com> Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com> Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com> Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk> Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com> Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> 2025-03-14 16:58:30 -04:00			`torchvision==0.21.0 # Required for phi3v processor. See https://github.com/pytorch/vision?tab=readme-ov-file#installation for corresponding version`
			`xformers==0.0.29.post2; platform_system == 'Linux' and platform_machine == 'x86_64' # Requires PyTorch 2.6.0`