KernelBench hard · RTX PRO 6000

FP8 GEMM Kimi K3 (256k)

manually audited: clean

Genuine FP8 E4M3 GEMM. The aligned main path invokes CUTLASS 2.x SM89 tensor-op kernels compiled for SM120: stream-K 128x128x128 for large M and a 32x64x128 data-parallel kernel for skinny M. Both consume the live x and weight pointers, accumulate in fp32, apply the live per-channel scale in a custom epilogue, and write a newly allocated bf16 output. Off-alignment K is padded by a custom CUDA copy kernel before the same GEMM, while an arbitrary-N Triton tl.dot path provides the fallback. The only persistent data are extension handles, workspaces, and a weight-padding cache guarded by weight._version; no output or activation result is cached. No forbidden scaled-mm op, cross-run artifact, grader modification, or numeric-stress bypass is present. The recorded 0.3194 is plausible and exactly reproduced by the four logged per-shape fractions.

20260716_112513_kinetic-claude_kinetic-0715_01_fp8_gemm