17 Commits

Author SHA1 Message Date
Woosuk Kwon
762fd1c3fa Refactor and annotate types for attention 2023-02-24 08:58:46 +00:00
Woosuk Kwon
7f22f90e8c Remove xformers 2023-02-24 08:36:16 +00:00
Woosuk Kwon
932844f1cd Fix attention 2023-02-23 23:02:25 +00:00
Woosuk Kwon
ba84b8728a Fix attention 2023-02-23 22:29:46 +00:00
Woosuk Kwon
87e0bcd426 Fix attention 2023-02-23 21:32:02 +00:00
Woosuk Kwon
1ce1333573 Set default dtype to half 2023-02-23 21:31:39 +00:00
Woosuk Kwon
de0fabbc5c Fix sampler 2023-02-23 20:30:12 +00:00
Woosuk Kwon
fdd0f2f472 Minor 2023-02-23 20:23:47 +00:00
Woosuk Kwon
7f985166f7 Consider pempty tensor 2023-02-23 20:20:33 +00:00
Woosuk Kwon
86f9eb6d39 Fix typo 2023-02-23 20:19:24 +00:00
Woosuk Kwon
d4bc1a4d24 Add unoptimized OPT Attention 2023-02-23 09:31:55 +00:00
Woosuk Kwon
b56b6ca0d6 Add greedy sampler 2023-02-23 09:26:09 +00:00
Woosuk Kwon
343cea3dbc Add seq_ids to input metadata 2023-02-23 09:25:01 +00:00
Woosuk Kwon
4b1ac23f53 Fix slot mapping 2023-02-23 00:10:07 +00:00
Woosuk Kwon
7b6844e590 Add input metadata 2023-02-22 19:01:20 +00:00
Woosuk Kwon
608f74ffe5 Minor 2023-02-22 18:08:25 +00:00
Woosuk Kwon
709a69176e Move worker/models -> models 2023-02-22 18:03:48 +00:00