3 Commits

Author	SHA1	Message	Date
Woosuk Kwon	d7afab6d3a	[BugFix] Fix GC bug for LLM class (#2882)	2024-02-14 22:17:44 -08:00
Nikola Borisov	3209b49033	[Bugfix] fix crash if max_tokens=None (#2570)	2024-01-23 22:38:55 -08:00
Simon Mo	cb08cd0d75	[Minor] Fix duplication of ignored seq group in engine step (#1666)	2023-11-16 13:11:41 -08:00