20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Add llmaz as another integration (#13643)

Browse Source 
Signed-off-by: kerthcet <kerthcet@gmail.com>
This commit is contained in:
Kante Yin 2025-02-21 11:52:40 +08:00 committed by GitHub
parent 33170081f1
commit 44c33f01f3
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 8 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
docs/source/deployment/integrations/index.md
View File

@ -6,4 +6,5 @@
kserve
kubeai
llamastack
llmaz
:::

7
docs/source/deployment/integrations/llmaz.md Normal file
View File

@ -0,0 +1,7 @@
(deployment-llmaz)=
# llmaz
[llmaz](https://github.com/InftyAI/llmaz) is an easy-to-use and advanced inference platform for large language models on Kubernetes, aimed for production use. It uses vLLM as the default model serving backend.
Please refer to the [Quick Start](https://github.com/InftyAI/llmaz?tab=readme-ov-file#quick-start) for more details.