20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Bugfix]Fix index out of range error in api server log (#16787)

Browse Source 
Signed-off-by: WangErXiao <863579016@qq.com>
This commit is contained in:
Robin 2025-04-18 00:01:07 +08:00 committed by GitHub
parent 05fcd1b430
commit 6211b92273
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/entrypoints/openai/api_server.py
View File

@ -881,7 +881,8 @@ def build_app(args: Namespace) -> FastAPI:
section async for section in response.body_iterator section async for section in response.body_iterator
] ]
response.body_iterator = iterate_in_threadpool(iter(response_body)) response.body_iterator = iterate_in_threadpool(iter(response_body))
logger.info("response_body={%s}", response_body[0].decode()) logger.info("response_body={%s}",
response_body[0].decode() if response_body else None)
return response return response
for middleware in args.middleware: for middleware in args.middleware: