vllm/docs/source/serving/deploying_with_kserve.rst

.. _deploying_with_kserve:

Deploying with KServe
============================

vLLM can be deployed with `KServe <https://github.com/kserve/kserve>`_ on Kubernetes for highly scalable distributed model serving.

Please see `this guide <https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/>`_ for more details on using vLLM with KServe.