20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[BugFix] make sure socket close (#15875)

Browse Source 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
This commit is contained in:
yihong 2025-04-02 04:10:24 +08:00 committed by GitHub
parent 7acd539cd7
commit 93491aefc7
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
vllm/entrypoints/openai/api_server.py
View File

@ -1098,9 +1098,10 @@ async def run_server(args, **uvicorn_kwargs) -> None:
) )
# NB: Await server shutdown only after the backend context is exited # NB: Await server shutdown only after the backend context is exited
await shutdown_task try:
await shutdown_task
sock.close() finally:
sock.close()
if __name__ == "__main__": if __name__ == "__main__":