2 Commits

Author	SHA1	Message	Date
Lily Liu	d5a1697772	[Dynamic Spec Decoding] Minor fix for disabling speculative decoding (#5000)	2024-05-25 10:00:14 -07:00
Cody Yu	f942efb5a3	[Dynamic Spec Decoding] Auto-disable by the running queue size (#4592) ... Co-authored-by: Cade Daniel <edacih@gmail.com>	2024-05-08 21:44:00 +00:00