Woosuk Kwon
|
6d2f74efb3
|
Remove redundant fn
|
2023-02-16 09:24:42 +00:00 |
|
Woosuk Kwon
|
3b41f16596
|
Add gitignore
|
2023-02-16 07:47:21 +00:00 |
|
Woosuk Kwon
|
6f058c7ba8
|
Implement cache ops
|
2023-02-16 07:47:03 +00:00 |
|
Woosuk Kwon
|
a1c67e6db8
|
Minor
|
2023-02-16 01:42:53 +00:00 |
|
Woosuk Kwon
|
9e68a6827e
|
Fix return type error
|
2023-02-16 01:33:03 +00:00 |
|
Woosuk Kwon
|
8edcabc737
|
Add warning
|
2023-02-16 01:28:17 +00:00 |
|
Woosuk Kwon
|
2f4887de77
|
Fix KVCache shape
|
2023-02-16 01:24:45 +00:00 |
|
Woosuk Kwon
|
3363c27d19
|
Add __repr__
|
2023-02-14 09:34:07 +00:00 |
|
Woosuk Kwon
|
2729087efe
|
Fix a ref count bug in swapping
|
2023-02-14 09:20:12 +00:00 |
|
Woosuk Kwon
|
c128c2ed03
|
Fix double free
|
2023-02-14 09:14:05 +00:00 |
|
Woosuk Kwon
|
c80ed212a1
|
Minor
|
2023-02-14 09:06:27 +00:00 |
|
Woosuk Kwon
|
263e91b386
|
Minor
|
2023-02-14 09:05:39 +00:00 |
|
Woosuk Kwon
|
be1e2163c9
|
Fix memory leak in swapping
|
2023-02-14 08:46:33 +00:00 |
|
Woosuk Kwon
|
7e5f604e68
|
Fix bugs in scheduler
|
2023-02-14 02:25:32 +00:00 |
|
Woosuk Kwon
|
1f739f9b03
|
Fix a bug in swap_in and swap_out
|
2023-02-14 02:12:58 +00:00 |
|
Woosuk Kwon
|
b1644f764f
|
Fix can_swap_in
|
2023-02-14 01:57:40 +00:00 |
|
Woosuk Kwon
|
c574f19506
|
Fix typo
|
2023-02-14 01:19:27 +00:00 |
|
Woosuk Kwon
|
e40fa136aa
|
Fix typo
|
2023-02-14 01:19:05 +00:00 |
|
Woosuk Kwon
|
ee9442518d
|
Fix get_model
|
2023-02-13 22:51:03 +00:00 |
|
Woosuk Kwon
|
531e1c74e8
|
Fix typo
|
2023-02-13 18:51:33 +00:00 |
|
Woosuk Kwon
|
d3d317665b
|
Fix scheduler
|
2023-02-13 09:37:00 +00:00 |
|
Woosuk Kwon
|
fffa2e1f4b
|
Add model_utils
|
2023-02-13 09:36:12 +00:00 |
|
Woosuk Kwon
|
bb59a3e730
|
Fix cache engine
|
2023-02-13 09:35:48 +00:00 |
|
Woosuk Kwon
|
5a309bb588
|
Add scheduler
|
2023-02-13 02:39:53 +00:00 |
|
Woosuk Kwon
|
0961f5a49a
|
Add find method to sequence group
|
2023-02-13 02:39:12 +00:00 |
|
Woosuk Kwon
|
eb52db1bea
|
Fix can_swap_in
|
2023-02-13 02:38:50 +00:00 |
|
Woosuk Kwon
|
a2a9869cb7
|
SERVING -> RUNNING
|
2023-02-12 08:25:05 +00:00 |
|
Woosuk Kwon
|
46958cf941
|
BlockAllocator -> BlockManager
|
2023-02-12 08:15:18 +00:00 |
|
Woosuk Kwon
|
3be29a1104
|
Add blank setup file
|
2023-02-09 11:37:06 +00:00 |
|
Woosuk Kwon
|
38ed06a846
|
Minor
|
2023-02-09 11:30:55 +00:00 |
|
Woosuk Kwon
|
0a11a2e5ca
|
Add gitignore
|
2023-02-09 11:28:12 +00:00 |
|
Woosuk Kwon
|
e7bee2aa81
|
Add cache engine
|
2023-02-09 11:28:02 +00:00 |
|
Woosuk Kwon
|
aa78aeaa0f
|
Add block manager
|
2023-02-09 11:27:33 +00:00 |
|
Woosuk Kwon
|
3c2b47fcae
|
Add decoding params
|
2023-02-09 11:27:06 +00:00 |
|
Woosuk Kwon
|
5e644b912e
|
Add utils
|
2023-02-09 11:26:50 +00:00 |
|
Woosuk Kwon
|
d904350a2c
|
Add sequence
|
2023-02-09 11:26:35 +00:00 |
|
Woosuk Kwon
|
6680129ba2
|
Add blocks
|
2023-02-09 11:26:21 +00:00 |
|
Woosuk Kwon
|
39161c98a0
|
Add OPT
|
2023-02-09 11:25:37 +00:00 |
|
Woosuk Kwon
|
e7d9d9c08c
|
Initial commit
|
2023-02-09 11:24:15 +00:00 |
|