4 Commits

Author	SHA1	Message	Date
Lily Liu	43c413ec57	[Kernel] Use flashinfer for decoding (#4353) ... Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>	2024-05-03 15:51:27 -07:00
SangBin Cho	67b4221a61	[Core][5/N] Fully working chunked prefill e2e (#3884)	2024-04-10 17:56:48 -07:00
youkaichao	8f44facddd	[Core] remove cupy dependency (#3625)	2024-03-27 00:33:26 -07:00
Zhuohan Li	a61f0521b8	[Test] Add basic correctness test (#2908)	2024-02-18 16:44:50 -08:00