3 Commits

Author	SHA1	Message	Date
afeldman-nm	e5cab71531	[Frontend] Add --logprobs argument to benchmark_serving.py (#8191)	2024-09-06 09:01:14 -07:00
afeldman-nm	428dd1445e	[Core] Logprobs support in Multi-step (#7652)	2024-08-29 19:19:08 -07:00
Alexander Matveev	9db93de20c	[Core] Add multi-step support to LLMEngine (#7789)	2024-08-23 12:45:53 -07:00