3 Commits

Author	SHA1	Message	Date
Cody Yu	d11bf435a0	[MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510)	2024-10-18 14:30:55 -07:00
Joe Runde	062c89e7c9	[Frontend][Core] Move guided decoding params into sampling params (#8252) ... Signed-off-by: Joe Runde <Joseph.Runde@ibm.com> Co-authored-by: Nick Hill <nickhill@us.ibm.com>	2024-10-01 09:34:25 +08:00
Yihuan Bu	654bc5ca49	Support for guided decoding for offline LLM (#6878) ... Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>	2024-08-04 03:12:09 +00:00