2 Commits

Author	SHA1	Message	Date
Kunshang Ji	96b6f475dd	Remove hardcoded device="cuda" to support more devices (#2503) ... Co-authored-by: Jiang Li <jiang1.li@intel.com> Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>	2024-02-01 15:46:39 -08:00
Cade Daniel	79d64c4954	[Speculative decoding 1/9] Optimized rejection sampler (#2336)	2024-01-09 15:38:41 -08:00