This website requires JavaScript.
Explore
Help
Register
Sign In
20231088
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
vllm
/
benchmarks
/
cutlass_benchmarks
History
Lucas Wilkinson
9798b2fb00
[Kernel] Update
cutlass_scaled_mm
to support 2d group (blockwise) scaling (
#11868
)
2025-01-30 18:33:00 -08:00
..
sparse_benchmarks.py
[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (
#10995
)
2024-12-18 09:57:16 -05:00
utils.py
[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (
#10995
)
2024-12-18 09:57:16 -05:00
w8a8_benchmarks.py
[Kernel] Update
cutlass_scaled_mm
to support 2d group (blockwise) scaling (
#11868
)
2025-01-30 18:33:00 -08:00
weight_shapes.py
[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (
#10995
)
2024-12-18 09:57:16 -05:00