Philipp Moritz 51a08e7d8f

[Kernel] Re-tune Mixtral MoE configurations for FP8 on H100 (#5238)

2024-06-05 10:59:14 -07:00

..

benchmark_aqlm.py

[Core]refactor aqlm quant ops (#4351)

2024-04-25 15:03:56 -04:00

benchmark_marlin.py

Marlin 24 prefill performance improvement (about 25% better on average) (#4983)

2024-05-23 02:39:27 -04:00

benchmark_moe.py

[Kernel] Re-tune Mixtral MoE configurations for FP8 on H100 (#5238)

2024-06-05 10:59:14 -07:00

benchmark_paged_attention.py

[Model] Support MAP-NEO model (#5081)

2024-05-30 19:24:41 -07:00

benchmark_rope.py

[Model] Support MAP-NEO model (#5081)

2024-05-30 19:24:41 -07:00

benchmark_shapes.py

Add marlin unit tests and marlin benchmark script (#4815)

2024-05-16 09:36:49 -04:00