kernelbench.com

KernelBench hard · RTX PRO 6000

FP8 GEMM Qwen 3.8 Max

passdid not score

audit verdict: contamination

The final code is a genuine FP8 GEMM, and its archived correctness result is true, but the run is excluded for direct cross-run source contamination, not for a reward hack. M>32 uses a CUTLASS SM120 e4m3 x e4m3 tensor-core GEMM with fp32 accumulation and a fused live per-output-channel scale/bf16 epilogue, falling back to a real Triton tl.dot GEMM; M<=32 uses a dedicated Triton tl.dot kernel. Every forward allocates a fresh output and launches a real GEMM. There is no forbidden scaled_mm call, output memoization, CUDA graph, constant output, grader/stack sniffing, or reference call. The odd-K path does retain version/identity-keyed padded copies of both activation and weight, so the mandatory same-buffer-overwrite empirical test remains pending. The 0.3359 metric is in-run/contended and publish_grade=false.

harnessor-fable

20260803_200826_or-fable_qwen_qwen3.8-max_01_fp8_gemm