Sebastian Schoennenbeck f8e7adda21

Fix/async chat serving (#2727)

2024-05-03 11:04:14 -07:00

..

api_server_async_engine.py

Migrate linter from pylint to ruff (#1665)

2023-11-20 11:58:01 -08:00

test_api_server.py

[Core] Fix engine-use-ray broken (#4105)

2024-04-16 05:24:53 +00:00

test_async_llm_engine.py

[Bugfix][Core] Fix get decoding config from ray (#4335)

2024-04-27 11:30:08 +00:00

test_chat_template.py

Fix/async chat serving (#2727)

2024-05-03 11:04:14 -07:00

test_merge_async_iterators.py

[Bugfix] Abort requests when the connection to /v1/completions is interrupted (#4363)

2024-04-27 09:48:37 -07:00

test_openapi_server_ray.py

[Bugfix][Core] Fix get decoding config from ray (#4335)

2024-04-27 11:30:08 +00:00

test_request_tracker.py

Add health check, make async Engine more robust (#3015)

2024-03-04 22:01:40 +00:00