4 Commits

Author	SHA1	Message	Date
Zhuohan Li	721fa3df15	FastAPI-based working frontend (#10)	2023-03-29 14:48:56 +08:00
Woosuk Kwon	1a7eb7da61	Support beam search & parallel generation (#7)	2023-03-10 09:58:21 -08:00
Woosuk Kwon	46ce1356f7	Add max_num_steps to SamplingParams	2023-02-24 11:44:40 +00:00
Woosuk Kwon	501c4bd0cd	decoding.py -> sampling_params.py	2023-02-23 07:39:20 +00:00