2025-01-06 10:18:33 +08:00
|
|
|
(installation-index)=
|
|
|
|
|
|
|
|
|
|
# Installation
|
|
|
|
|
|
|
|
|
|
vLLM supports the following hardware platforms:
|
|
|
|
|
|
2025-01-29 03:38:29 +00:00
|
|
|
:::{toctree}
|
2025-01-06 10:18:33 +08:00
|
|
|
:maxdepth: 1
|
2025-01-31 23:38:35 +00:00
|
|
|
:hidden:
|
2025-01-06 10:18:33 +08:00
|
|
|
|
2025-01-13 12:27:36 +00:00
|
|
|
gpu/index
|
|
|
|
|
cpu/index
|
|
|
|
|
ai_accelerator/index
|
2025-01-29 03:38:29 +00:00
|
|
|
:::
|
2025-01-31 23:38:35 +00:00
|
|
|
|
|
|
|
|
- <project:gpu/index.md>
|
|
|
|
|
- NVIDIA CUDA
|
|
|
|
|
- AMD ROCm
|
|
|
|
|
- Intel XPU
|
|
|
|
|
- <project:cpu/index.md>
|
|
|
|
|
- Intel/AMD x86
|
|
|
|
|
- ARM AArch64
|
|
|
|
|
- Apple silicon
|
|
|
|
|
- <project:ai_accelerator/index.md>
|
|
|
|
|
- Google TPU
|
|
|
|
|
- Intel Gaudi
|
|
|
|
|
- AWS Neuron
|
|
|
|
|
- OpenVINO
|
