20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[ci][distributed] shorten wait time if server hangs (#7098)

Browse Source
This commit is contained in:
youkaichao 2024-08-02 21:05:16 -07:00 committed by GitHub
parent ed812a73fa
commit 69ea15e5cc
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
tests/utils.py
View File

@ -50,7 +50,7 @@ VLLM_PATH = Path(__file__).parent.parent
class RemoteOpenAIServer:
DUMMY_API_KEY = "token-abc123" # vLLM's OpenAI server does not need API key
MAX_SERVER_START_WAIT_S = 600 # wait for server to start for 60 seconds
MAX_SERVER_START_WAIT_S = 120 # wait for server to start for 120 seconds
def __init__(
self,