DefTruth e9528f6dc6

[Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173) ...

Signed-off-by: DefTruth <qiustudent_r@163.com>

2025-04-11 06:50:50 -06:00

..

attention_dtypes.h

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

attention_generic.cuh

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

attention_kernels.cuh

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

attention_utils.cuh

[AMD][CI/Build] Disambiguation of the function call for ROCm 6.2 headers compatibility (#7477)

2024-08-21 16:47:36 -07:00

dtype_bfloat16.cuh

[CI/Build] Suppress divide-by-zero and missing return statement warnings (#7001)

2024-08-05 16:00:01 -04:00

dtype_float16.cuh

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

dtype_float32.cuh

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

dtype_fp8.cuh

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

merge_attn_states.cu

[Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173)

2025-04-11 06:50:50 -06:00

paged_attention_v1.cu

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

paged_attention_v2.cu

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00