youkaichao 551603feff

[core] overhaul memory profiling and fix backward compatibility (#10511) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>

2024-12-16 13:32:25 -08:00

..

__init__.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

test_encoder_decoder_model_runner.py

[core] clean up cudagraph batchsize padding logic (#10996)

2024-12-13 06:57:50 +00:00

test_model_input.py

[Misc] Rename embedding classes to pooling (#10801)

2024-12-01 14:36:51 +08:00

test_model_runner.py

[core] clean up cudagraph batchsize padding logic (#10996)

2024-12-13 06:57:50 +00:00

test_profile.py

[core] overhaul memory profiling and fix backward compatibility (#10511)

2024-12-16 13:32:25 -08:00

test_swap.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00