07964e2f30
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com> Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
470 B
470 B
(installation-index)=
Installation
vLLM supports the following hardware platforms:
:::{toctree} :maxdepth: 1 :hidden:
installation/gpu installation/cpu installation/ai_accelerator :::
- project:installation/gpu.md
- NVIDIA CUDA
- AMD ROCm
- Intel XPU
- project:installation/cpu.md
- Intel/AMD x86
- ARM AArch64
- Apple silicon
- IBM Z (S390X)
- project:installation/ai_accelerator.md
- Google TPU
- Intel Gaudi
- AWS Neuron
- OpenVINO