13 Commits

Author SHA1 Message Date
Zhuohan Li
057daef778
OpenAI Compatible Frontend (#116) 2023-05-23 21:39:50 -07:00
Woosuk Kwon
f746ced08d
Implement stop strings and best_of (#114) 2023-05-21 11:18:00 -07:00
Woosuk Kwon
c3442c1f6f
Refactor system architecture (#109) 2023-05-20 13:06:59 -07:00
Woosuk Kwon
b322fd1607
Add docstrings to some modules and classes (#100) 2023-05-14 22:32:38 -07:00
Woosuk Kwon
6208d622ca
Minor code cleaning for SamplingParams (#99) 2023-05-12 18:07:09 -07:00
Woosuk Kwon
42f1042e1c
Enhance SamplingParams (#96) 2023-05-11 15:45:30 -07:00
Woosuk Kwon
55f8b0a5de
Implement presence and frequency penalties (#95) 2023-05-10 23:39:12 -07:00
Woosuk Kwon
9f88db35da
Support top-k sampling (#94) 2023-05-10 12:51:36 -07:00
Woosuk Kwon
8d66a7b6d7
Rename variables and methods (#91) 2023-05-10 00:58:31 -07:00
Zhuohan Li
721fa3df15
FastAPI-based working frontend (#10) 2023-03-29 14:48:56 +08:00
Woosuk Kwon
1a7eb7da61
Support beam search & parallel generation (#7) 2023-03-10 09:58:21 -08:00
Woosuk Kwon
46ce1356f7 Add max_num_steps to SamplingParams 2023-02-24 11:44:40 +00:00
Woosuk Kwon
501c4bd0cd decoding.py -> sampling_params.py 2023-02-23 07:39:20 +00:00