2025-01-06 10:18:33 +08:00
|
|
|
(installation-index)=
|
|
|
|
|
|
|
|
|
|
# Installation
|
|
|
|
|
|
|
|
|
|
vLLM supports the following hardware platforms:
|
|
|
|
|
|
|
|
|
|
```{toctree}
|
|
|
|
|
:maxdepth: 1
|
|
|
|
|
|
|
|
|
|
gpu-cuda
|
|
|
|
|
gpu-rocm
|
|
|
|
|
cpu-x86
|
|
|
|
|
cpu-arm
|
2025-01-08 05:35:49 -03:00
|
|
|
cpu-apple
|
2025-01-06 10:18:33 +08:00
|
|
|
hpu-gaudi
|
|
|
|
|
tpu
|
|
|
|
|
xpu
|
|
|
|
|
openvino
|
|
|
|
|
neuron
|
|
|
|
|
```
|
