7 Commits

Author SHA1 Message Date
Zhuohan Li
057daef778
OpenAI Compatible Frontend (#116) 2023-05-23 21:39:50 -07:00
Woosuk Kwon
aedba6d5ec
Print warnings/errors for large swap space (#123) 2023-05-23 18:22:26 -07:00
Woosuk Kwon
7c041ab578
Refactor system architecture (#82) 2023-05-09 15:30:12 -07:00
Zhuohan Li
721fa3df15
FastAPI-based working frontend (#10) 2023-03-29 14:48:56 +08:00
Zhuohan Li
2f49f15585
Support tensor parallel (#2) 2023-03-21 13:45:42 -07:00
Woosuk Kwon
c574f19506 Fix typo 2023-02-14 01:19:27 +00:00
Woosuk Kwon
5e644b912e Add utils 2023-02-09 11:26:50 +00:00