Skip to content

Heat-demo accuracy study

Results catalogue · Problem/reference · Validation

27 October 2026. CPU, float32, 2500 Adam updates, 144 interior grid points, 24 points per side, tanh 32×32 network. Evaluation: 41×41 coordinates, compared with the explicitly truncated 40-odd-mode rectangular series. No plots were changed.

Method BC weight Seed RMSE Maximum absolute error
baseline 10 7 0.0204918 0.0796043
baseline 10 17 0.0185791 0.0821636
baseline 10 27 0.0203726 0.0808272
baseline 100 7 0.0139774 0.0637816
baseline 100 17 0.0187275 0.0938645
baseline 100 27 0.014494 0.0599912
hard_dirichlet 1 7 0.00090309 0.00246223
hard_dirichlet 1 17 0.000932801 0.00241451
hard_dirichlet 1 27 0.000898833 0.00212636

The hard-Dirichlet method reduced field RMSE and maximum error for all three tested seeds and enforces the supported boundary values exactly. It is available as an explicit optional variant; the existing heat template remains baseline. Raising only the soft boundary penalty helped two seeds but worsened seed 17's maximum error, so a larger penalty was not made a universal default.

This is a narrow correctness/accuracy study, not a mesh-convergence or broad PDE benchmark. The hard variant still has a non-zero collocation residual (reported in the raw data) and is restricted to equal constant Dirichlet boxes. It does not establish GPU equivalence or accuracy on unrelated physics.

Reproduce with the root environment:

.venv/bin/python -m examples.benchmark_heat_accuracy --output benchmark-results/heat-reproduction.json

Choose a fresh output filename: the heat script permits overwriting. The original record is preserved, not rerun during the documentation update. It records Torch, time, evaluation grid/reference and per-run settings/losses/errors, but not a full environment/source snapshot. The file was introduced in commit 0e37a1e; that identifies artifact provenance rather than an inferred exact execution revision.

Raw per-run losses/errors and limited metadata: heat-accuracy.json.