zhaoyang-star 9090bf02e7

Support FP8-E5M2 KV Cache (#2279) ...

Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2024-01-28 16:43:54 -08:00

..

auto_awq.rst

[Docs] Update the AWQ documentation to highlight performance issue (#1883)

2023-12-02 15:52:47 -08:00

fp8_e5m2_kv_cache.rst

Support FP8-E5M2 KV Cache (#2279)

2024-01-28 16:43:54 -08:00