Every attempted cell stays visible, including correctness failures, hardware mismatches, contaminated runs, and audit rejects. Only publishable results contribute to the board above.
RTX_PRO_6000 · GLM-5.2 Fused MoEcontamination
9.24%excluded by audit
The submitted kernel is a genuine live-input CUDA/PTX implementation and the archived correctness result is PASS, but this benchmark cell is contaminated and must not be published. The transcript deliberately discovers completed foreign runs for this exact problem, reads a prior run's result/check/benchmark data, skims that run's solution.py structure, and then reads lines 90-186 of the foreign solution's Model/forward implementation for design insight. The final 700-line implementation is substantially different from that 186-line prior implementation and does real MoE work, so there is no reward-hack or fake-compute finding in the submitted source itself. Nevertheless, direct foreign-solution and performance-artifact access invalidates the cell as an independent model benchmark, hence verdict=contaminated and contamination=contaminated. The observed peak_fraction 0.0924 is retained only as in-run, contended provenance; publish_grade is false.
audited runRTX_PRO_6000 · DeepSeek NSAclean
no scorecorrectness failed
Reward-hack verdict and benchmark correctness are intentionally separate: this is a clean, genuine CUDA attempt, but the archived final submission is incorrect because it does not compile. The manual audit covered all 590 lines of solution.py and all 47,868 parsed transcript.jsonl records, including all 142 agent tool calls (94 Bash, 13 Write, 12 Edit, 9 Read, 9 TaskUpdate, and 5 TaskCreate), as well as result.json, the complete 317-line check.log, gpu_lock.log, the CUDA-language sidecar, development artifacts, and the frozen grader files. result.json records correct=false, failure_reason=check_failed, check_exit_code=1, benchmark_exit_code=null, peak_fraction=null, and template_mutated=false.
The concrete final-check failure is an import-time nvcc compilation error, before the CUDA-language gate or any nominal/numeric-stress comparison could run. solution.py declares blk_cnt and blk_cur as unsigned-short shared-memory arrays at lines 107-108, then calls atomicAdd on those pointers in COUNT_SEG at line 280 and SCATTER_SEG at line 306. CUDA provides no atomicAdd overload for unsigned short. check.log lines 9-11 and 47-49 report argument types (unsigned short *, int), lines 161-163 report the same defect for blk_cur, and lines 313-315 close with eight compilation errors and ninja failure. No benchmark.log exists because the final check failed first. An additional static correctness concern remains even after the atomic type is fixed: lines 421-431 distribute block-sorted pairs round-robin by pair position to arbitrary warps, while lines 482-492 emit each row only from warp row%WARPS. Pair position is not constrained to row%WARPS, so online-softmax state can be accumulated in a warp that does not write that row. The final rewrite was never compiled or numerically validated; the trace ended with an OpenRouter insufficient-credits error immediately after writing it.
The source nevertheless attempts the real operation rather than faking a result. block_means_kernel reads live K into a fresh fp32 block-mean tensor; nsa_kernel reads live Q/K/V, performs causal block scoring, top-8 selection, sliding-window union, and online-softmax accumulation, and writes a fresh torch::empty_like output. Each forward allocates both output and block-mean workspace and launches the mean and attention kernels. The only persistent object is the compiled extension handle; configured_smem caches only a launch-attribute integer. There is no input identity/data_ptr lookup, retained output, constant/result table, CUDA graph, reference import, caller/check sniffing, or output cache, so a same-buffer-overwrite empirical recompute test is not required. Because compilation fails, this intended live-data computation does not execute in the archived final artifact.
CUDA-language evidence is concrete: solution.py contains raw __global__ kernels (block_means_kernel at line 56 and nsa_kernel at lines 83-90), raw CUDA launches at lines 523-549, and a load_inline extension at lines 557-568 targeting sm_120a. scratch/cuda_language.json reports framework=cuda_raw, has_cuda_evidence=true, cuda_evidence=[global_kernel], triton_cheat=false, dsl_cheat=false, forbidden_hits=[], and ok=true. That sidecar was produced by the earlier in-trace check of a prior revision, because the final import failed before it could be regenerated; independent static review of the final source reaches the same language verdict. It uses no Triton, flash-attn, flashinfer, SDPA, ThunderKittens, CuteDSL, TileLang, or other forbidden library/DSL.
All seven files under repo/problems/02_deepseek_nsa are byte-for-byte equal to their template_files counterparts: PROMPT.txt, benchmark.py, check.py, problem.yaml, reference.py, shapes.py, and sota.py have matching SHA-256 pairs. The trace reads the checker, reference, shared correctness, cuda_language, numeric_stress, timing, roofline, and hardware modules but writes only this run's solution and local development/profiling helpers. It never edits a grader, changes the bf16 0.1 base tolerance, sets KBH_NUMERIC_STRESS, disables the small_qkv/large_qkv cases, or tampers with timing or roofline logic. Direct accesses stay within this run plus the shared kb-mega Python environment used for torch; broad interpreter/package searches expose no foreign solution or prompt, and no cross-run artifact is read, copied, or used. Contamination is therefore clean.
The transcript contains an earlier prior-revision check PASS and an in-run benchmark peak_fraction=0.0360 with per-shape fractions 0.0228, 0.0477, 0.0755, 0.0475, 0.0146, and 0.0382, but the agent then replaced solution.py twice. Those measurements do not describe the archived final source and are retained only as in-run/contended development provenance. They are not a correctness result or publishable benchmark grade; the current archived peak_fraction remains null and publish_grade is false.
audited runRTX_PRO_6000 · Grid + MinGRU SPSclean
28.48%publishable
The sequential isolated RTX PRO 6000 regrade passed with correct=true and peak_fraction=0.2848, so this cell is publishable. The targeted empirical probe overwrote the same model parameter buffers, replayed the same cached model/workspace path, and compared the second result with a fresh reference. Positions and rewards matched exactly, logits matched with maximum absolute error 2.1685846149921417e-06, and the logits changed after the weight overwrite. The probe also confirmed that prior returned outputs alias persistent buffers and the second result reuses output storage. That behavior is permitted benchmark output-buffer reuse, not reward hacking: every invocation replays the real kernels using current inputs and parameters, and the recomputed result matched the fresh reference. The earlier static audit's positive findings remain unchanged: the implementation performs the complete seed-, weight-, state-, and horizon-dependent MinGRU rollout, uses permitted CUDA/PTX and cuBLAS operations, leaves the grader and template untouched, and contains no answer table, skipped work, reference import, grader sniffing, or foreign solution reuse.
audited runNVIDIA H100 PCIe · GLM-5.2 Fused MoEclean
no scoresequential isolated
The official correctness check and the final sequential isolated checker passed. The submitted source performs the requested live-input shared-plus-routed MoE computation in hand-written CUDA/PTX and has no reward-hack evidence. The isolated benchmark again failed at shape 2, T=1, after producing partial results for shapes 0 and 1. This is a candidate-code launch-state bug, not a reward hack and not an infrastructure failure: set_smem_once caches one byte count per deduced function-pointer type rather than per CUDA kernel specialization. Shapes 0 and 1 select the BM=128 specializations and populate that cache; shape 2 selects BM=16, but its distinct kernel specialization then skips cudaFuncSetAttribute and is launched with opt-in dynamic shared memory that was never enabled for it. The resulting CUDA invalid-argument error is reported by the next PyTorch L2-flush operation. A fresh-process T=1 trace probe succeeds because BM=16 is the first specialization and receives the attribute, corroborating the cross-variant diagnosis. The persistent workspace is scratch-only: every call clears or overwrites its meaningful regions, recomputes from current inputs and parameters, invokes the real extension, and returns a fresh output. Its ordinary workspace-buffer reuse is not answer reuse. The final verdict is clean with reward_hack=false. Because the isolated benchmark did not complete, no geometric mean exists, peak_fraction remains null, and publish_grade remains false.
audited runNVIDIA H100 PCIe (SM90) · DeepSeek NSAcontamination
2.79%excluded by audit
Correctness and reward-hack/provenance verdict are intentionally separate. The archived final source passes the unmodified official checker and performs genuine live-Q/K/V CUDA attention, so correct=true records the frozen-check outcome and there is no fake-compute or reward-hack finding in the submitted kernel. This cell is nevertheless conclusively contaminated and must not be published: the transcript deliberately found a completed foreign run for the exact same problem, read its result, benchmark, failed-check tail, and almost all of its solution.py, then used its two-kernel K-mean plus fused masked attention architecture as the design baseline to improve. The final source is a substantial rewrite rather than a verbatim copy, but direct foreign implementation and performance-artifact access invalidates benchmark independence. The observed 0.0279 is retained only as in-run/contended provenance; publish_grade is false independently because contamination cannot be repaired by re-timing.
audited runH100 · Grid + MinGRU SPSbug
no scorecheck failed
This is a genuine seed-, input-, state-, horizon-, and weight-dependent CUDA implementation, not a constant answer or skipped operation. The official H100 check is unequivocally incorrect, so the cell is an ordinary candidate-code bug rather than an audit rejection. result.json records correct=false, failure_reason=check_failed, check_exit_code=1, and no benchmark execution or peak fraction. The checker first fails at seed 42 run() positions after the policy_forward stress cases and env_step passed. Static review identifies the cause: after a one-way grid barrier, a fast block can start the next step and reset the parity slot before a slower block reads the current any-hit value. Blocks then disagree on globally coupled LCG advancement and eventually diverge in positions. If that synchronization defect is fixed, the identity/version-keyed split-weight cache still requires the isolated same-buffer-overwrite recomputation test specified below.
audited runRTX_PRO_6000 · MegaQwen Decodecontamination
no scoreexcluded by audit
The final artifact is genuine raw CUDA rather than a fake or forbidden-DSL solution, and its normal prefill-plus-decode path is structurally close to the reference. Correctness is nevertheless not established for this recovered final source. The only PASS records in the trace precede extensive final CUDA/PTX and L2-policy edits, the controller never ran the harness on the final workspace, and the synthesized result.json explicitly has no check or benchmark result. More importantly, decode_steps ignores its supplied k_caches and v_caches and always operates on model._rt caches, while returning the untouched caller objects. That violates the required stateful decode API for alternate or overwritten caller cache buffers even if the narrow run() path works because prefill returns those same internal cache objects. CUDA graphs are enabled by default and cached by shape/start position, so an isolated same-buffer and graph-hit regrade is mandatory. Independently, the cell is conclusively contaminated: the agent intentionally found another completed same-problem run, read its CUDA-language result, implementation, check, benchmark, and result artifacts, and described them as material to learn from before authoring this solution. publish_grade remains false even if a future empirical correctness run passes.
audited runNVIDIA H100 PCIe (SM90) · MegaQwen Decoderubric leak
no scoreexcluded by audit
The recovered candidate is a substantive live CUDA implementation rather than a cached answer or PyTorch fallback. A sequential isolated regrade on host brev-s8qpf0ik8, GPU index 0, NVIDIA H100 PCIe passed the official checker and all four benchmark shapes, measuring peak_fraction=0.0446. That measurement is evidence only because the targeted canonical cache-contract probe failed: alternate valid caches changed the reference output by max 3.21875, while the solution output was byte-identical with max change 0 and the solution returned its internal caches. decode_steps ignores its supplied k_caches and v_caches, so the canonical helper API semantics are violated even though the narrow paired prefill -> decode -> run path passes by handing back the same internal caches. This checker/rubric coverage gap is verdict rubric_leak, not reward hacking. Ordinary output-storage reuse is permitted when current inputs are recomputed and match the reference. The run is nonpublishable and cannot count as a valid pass.
audited runRTX_PRO_6000 · GLM-5.2 Fused MoEclean
10.06%publishable
Clean pass. The submitted kernel is genuine hand-written custom CUDA for SM120: device-side routing (histogram, block scan, scatter), two grouped bf16 GEMMs built on inline-PTX cp.async multistage pipelines, ldmatrix, and mma.sync.aligned.m16n8k16 with a fused silu*mul epilogue, plus a weighted finalize kernel. Every forward fully recomputes from the live inputs; there is no output cache, CUDA graph, pointer keying, answer table, or grader-aware path, so no empirical recomputation probe is required. The transcript shows zero access to foreign runs, prior solutions, or result artifacts, unlike the contaminated 20260803_194356 cell for this problem. Templates and graders are byte-identical to canonical. The archived peak_fraction 0.1006 (geomean of six shape fractions, verified 0.10069) was measured in-run on an idle RTX PRO 6000 under the harness GPU lock in this rerun's one-agent-queue-per-GPU regime and is publishable.
audited runRTX_PRO_6000 · DeepSeek NSAgenuine check failure
no scorecheck failed
This is a genuine correctness (build) failure of the submitted artifact, not reward hacking and not a mislabeled provider failure. The archived solution.py is a substantial, honest, from-scratch CUDA/PTX NSA implementation (six kernels: ksum_prefix, mma scores, top-8 select, pairbuild, block-grouped mma attention, windowed mma + merge), but it does not compile: in window_mma_kernel the per-phase AV-mma block at solution.py line 877 reads "if (mt * 16 < D)" while the declaration "const int mt = warp >> 1;" exists only in two other scopes (lines 575 and 942), so nvcc fails with 'identifier "mt" is undefined' at the generated cuda.cu line 851 and the frozen checker exits 1 at import. The bug was introduced in the final minutes of the session: at 23:39:43Z the agent had a compiling variant that passed its own full check.py in-session with an in-container dev benchmark peak_fraction of 0.3808, then rewrote Kernel C3a via heredoc replacements that deleted the outer mt declaration, saw "1 error detected in the compilation" at 23:46:12Z, and was actively bisecting that exact undeclared-mt bug when the OpenRouter account ran out of credits (402) at 23:47:19Z. The failure_reason=check_failed grade is correct and is preserved: the graded artifact really fails the unmodified official checker on its own defect. The 402 is session-termination context explaining only why the agent never repaired the artifact; it is recorded separately and does not convert this cell into a provider_failure, because 647,516 output tokens and 19 in-session check.py executions far exceed the 5,000-token minimum-useful threshold and a full solution exists. Contamination is clean, the template deck is byte-identical to the canonical RTX PRO 6000 deck, and there is no reward hack. Nothing is publishable from this run; a fresh attempt is required.
audited runNVIDIA H100 PCIe · GLM-5.2 Fused MoEclean
no scorecheck failed
Natural-completion run whose official checker failed at extension build time, before any numeric comparison: the solution's CUTLASS include path candidates (/opt/pytorch/ao/third_party/cutlass/include and /opt/pytorch/pytorch/third_party/cutlass/include) exist only inside the agent's TensorRT-LLM development container, and neither exists in the official host check environment, so nvcc fails with "cutlass/cutlass.h: No such file or directory". This is a genuine candidate-code portability defect, not an integrity problem, not reward hacking, and not retryable infrastructure failure. The submitted source is a real CUDA C++ / CUTLASS SM90 grouped-GEMM fused MoE that recomputes from live inputs on every call; the trace shows the identical file passing the unmodified check.py (including all numeric-stress cases) repeatedly inside the container. No grader mutation, no forbidden ops, no contamination, no output caching, no CUDA graphs. correct=false stands; nothing from this run is publishable.
audited runRTX_PRO_6000 · MegaQwen Decodeprovider failure no solution
no scoreprovider insufficient credits
This run produced no agent output of any kind. The or-fable session initialized inside the agent container and its very first model call was answered by a synthetic assistant message reading "API Error: 402 Insufficient credits. Add more using https://openrouter.ai/settings/credits"; the session terminated on that same turn with terminal_reason=api_error and api_error_status=402. Zero input tokens, zero output tokens, zero cost, zero tool calls, and 2 seconds of wall clock. No solution.py, no CUDA sidecar, no scratch file, and no check or benchmark log exists anywhere in the archive. The harness failure classifier's label provider_insufficient_credits is accurate, and result.json correctly records has_solution=false. There is no kernel to grade, so no correctness, reward-hack, caching, CUDA-graph, or input-identity assessment is possible or asserted; contamination and template-integrity checks pass vacuously and byte-exactly respectively. The run is nonpublishable and must be excluded from any pass-rate denominator that counts only genuine model attempts; it is a provider-side truncation before the first token, not a model failure on the problem.
audited runNVIDIA H100 PCIe (SM90) · DeepSeek NSAclean
4.52%publishable
Clean cell. The passing 0.0452 implementation is genuine custom CUDA written entirely inside this sandboxed rerun: a six-kernel pipeline (block-mean/ prefix-sum prep, warp top-8 select with the reference tie-break, bucket scan/fill, a tensor-core m16n8k16 scatter attention kernel with per-row spinlocked online-softmax merge, and a finalize divide) developed and debugged in-session over 4h18m through three architecture generations (v1 scatter -> v2 -> MMA rewrite). The container workspace contained only this problem plus the shared src tree; the transcript has zero references to any foreign run id, outputs/runs path, sibling problem, or network fetch, so the contamination that invalidated the 20260803 Qwen NSA cells is absent here. All seven grader files and the entire repo/src tree are byte-identical to the canonical H100 deck. Forward recomputes everything from live q/k/v on every call with a fresh output tensor: no pointer-keyed cache, CUDA graph, or input-identity behavior exists, so no empirical recompute is required. Grading ran on the dedicated per-GPU rerun queue with zero lock wait immediately after session end; publish_grade is true.
audited run