20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Misc] update benchmark backend for scalellm (#6018)

Browse Source
This commit is contained in:
zhyncs 2024-07-02 01:20:33 +08:00 committed by GitHub
parent 4050d646e5
commit bb60326836
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
benchmarks/backend_request_func.py
View File

@ -422,4 +422,5 @@ ASYNC_REQUEST_FUNCS = {
"openai": async_request_openai_completions,
"openai-chat": async_request_openai_chat_completions,
"tensorrt-llm": async_request_trt_llm,
"scalellm": async_request_openai_completions,
}