6 lines
463 B
Markdown
6 lines
463 B
Markdown
|
(deploying-with-triton)=
|
||
|
|
|
||
|
|
# Deploying with NVIDIA Triton
|
||
|
|
|
||
|
|
The [Triton Inference Server](https://github.com/triton-inference-server) hosts a tutorial demonstrating how to quickly deploy a simple [facebook/opt-125m](https://huggingface.co/facebook/opt-125m) model using vLLM. Please see [Deploying a vLLM model in Triton](https://github.com/triton-inference-server/tutorials/blob/main/Quick_Deploy/vLLM/README.md#deploying-a-vllm-model-in-triton) for more details.
|