3 Commits

Author	SHA1	Message	Date
Woosuk Kwon	311490a720	Add script for benchmarking serving throughput (#145)	2023-06-14 19:55:38 -07:00
Zhuohan Li	5020e1e80c	Non-streaming simple fastapi server (#144)	2023-06-10 10:43:07 -07:00
Zhuohan Li	057daef778	OpenAI Compatible Frontend (#116)	2023-05-23 21:39:50 -07:00