vllm/requirements/rocm.txt

# Common dependencies
-r common.txt

numba == 0.60.0 # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding

# Dependencies for AMD GPUs
awscli
boto3
botocore
datasets
ray >= 2.10.0
peft
pytest-asyncio
tensorizer>=2.9.0
runai-model-streamer==0.11.0
runai-model-streamer-s3==0.11.0
[Misc] Define common requirements (#3841) 2024-04-05 00:39:17 -07:00			`# Common dependencies`
Move requirements into their own directory (#12547) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> 2025-03-08 17:44:35 +01:00			`-r common.txt`
[Misc] Define common requirements (#3841) 2024-04-05 00:39:17 -07:00
Moved numba from common requirements to cuda/rocm specific requirements (#14199) Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com> 2025-03-05 09:55:00 +05:30			`numba == 0.60.0 # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding`

[Misc] Define common requirements (#3841) 2024-04-05 00:39:17 -07:00			`# Dependencies for AMD GPUs`
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543) 2024-07-20 11:39:07 -05:00			`awscli`
			`boto3`
			`botocore`
[ci/build] Fix AMD CI dependencies (#11087) 2024-12-11 00:39:53 -08:00			`datasets`
[Build/CI] Enabling AMD Entrypoints Test (#4834) Co-authored-by: Alexey Kondratiev <alexey.kondratiev@amd.com> 2024-05-20 13:29:28 -05:00			`ray >= 2.10.0`
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543) 2024-07-20 11:39:07 -05:00			`peft`
[Build/CI] Enabling AMD Entrypoints Test (#4834) Co-authored-by: Alexey Kondratiev <alexey.kondratiev@amd.com> 2024-05-20 13:29:28 -05:00			`pytest-asyncio`
[ci/build] Fix AMD CI dependencies (#11087) 2024-12-11 00:39:53 -08:00			`tensorizer>=2.9.0`
[ci] Add AWS creds for AMD (#13572) 2025-02-19 19:56:06 -08:00			`runai-model-streamer==0.11.0`
Moved numba from common requirements to cuda/rocm specific requirements (#14199) Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com> 2025-03-05 09:55:00 +05:30			`runai-model-streamer-s3==0.11.0`