dongmao zhang 87525fab92

[bitsandbytes]: support read bnb pre-quantized model (#5753) ...

Co-authored-by: Michael Goin <michael@neuralmagic.com>

2024-07-23 23:45:09 +00:00

..

auto_awq.rst

[Docs] Update the AWQ documentation to highlight performance issue (#1883)

2023-12-02 15:52:47 -08:00

bnb.rst

[bitsandbytes]: support read bnb pre-quantized model (#5753)

2024-07-23 23:45:09 +00:00

fp8_e4m3_kvcache.rst

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

fp8_e5m2_kvcache.rst

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

fp8.rst

[Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (#5975)

2024-07-03 17:38:00 +00:00

supported_hardware.rst

[Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (#5975)

2024-07-03 17:38:00 +00:00