4-lepton pairing auditCMS Open Data
mZ = 91.2 GeV·101 fixed events·generator-record agreement 59 / 101·§5j split 79 + 22

Toy decay identifiability → CMS Open Data 4‑lepton pairing audit

Bottom line

This is a two‑part research record. Stages 1–3 use a toy model to study when the decay history X→Y1Y2→4 particles becomes indistinguishable from a direct four‑body decay.
Stage 4 applies the same closest‑to‑Z pairing heuristic to CMS 2012 Open Data. The central Stage‑4 finding is that on 101 same‑flavour (4e/4mu) simulated events, the closest‑to‑Z rule agrees with the generator ancestry record on 59/101 (58.4%) and disagrees on 42/101 — and the 95% interval on that point estimate still contains chance (0.5).
For identical‑flavour four‑lepton final states, this is agreement with one internal generator bookkeeping record rather than a unique observable history. The real‑data work consists of an exploratory examination of 26 four‑lepton candidates, a Z‑peak validation check, and modestly tighter selection criteria for four candidates in the 120–130 GeV range; these are pipeline checks rather than a Higgs measurement.
A full ancestry audit of all 42 mismatches (§5m) traced every mother/daughter edge and found 0/42 pairing‑label changes and 0/42 ambiguous labels — this validates how the labels were built, not a unique physical pairing, so the 59/101 agreement stands unchanged. A follow‑up official JHUGenMELA interference audit (§5n) of the same fixed 101 events found relative identical‑lepton interference of median +4.54% in the 42 mismatch events versus +10.03% in the 59 matched events, a difference of −5.49 percentage points whose bootstrap interval [−15.80, +6.16] comfortably includes zero — this sample gives no stable evidence that interference explains the mismatches.
Three small detector‑covariance follow‑ups round out this update. A fixed‑three‑event local hybrid‑covariance benchmark (§5o) and a related 91‑complete‑case screen (§5p) found the exact nonlinear boundary distance within 0.4% of the local linear estimate for the two events it could evaluate; a prospective, target‑unseen two‑event pilot (§5q) found a fixed quadratic correction outperformed the linear one for both events (absolute errors 0.0173σ vs 0.306σ for 4e, and 0.000343σ vs 0.0228σ for 4mu). A larger, prespecified fixed‑16 extension (§5r) — eight independent‑file candidates per channel, no NA replacement — then mechanically compared 14 paired events (4e 8, 4mu 6) and found the quadratic correction improved on the linear one for 14/14, with median DeltaE = 0.0794076 and all 14 signed residuals positive. None of these establish a global detector‑covariance distance, a measured mispairing probability, a population‑wide bias, or a unique physical pairing — they remain local, small‑sample sensitivity checks over a deliberately selected near‑distance cohort.


1. Research question

Two nested questions.

  1. Toy (Stages 1–3): Under a controllable artificial generator + detector, at what resonance width does the sequential‑decay history stop being recoverable — both as an A/B classification and as a correct 4‑particle pairing — and which pieces of information vanish first?
  2. Open Data (Stage 4): When the fixed closest‑to‑Z heuristic is applied to CMS simulated 4‑lepton events, how often does it match the generator ancestry label, and — crucially — is that label even a valid ground truth for identical‑flavour final states?

2. Project timeline

# Step What it did Source
1 Stage 1 toy Artificial X→4p (A) vs X→Y1Y2→4p (B); RAMBO + toy detector; identifiability by width/missing‑rate/etc. artificial_four_particle_decays_README.md
2 Stage 2 Structured‑direct A, relativistic wide‑width B, particle merging, conditional vs domain‑shift, rare‑signal metrics STAGE2_FINAL_REPORT.md
3 Stage 3 Order in which decay‑history information is lost as width grows STAGE3_FINAL_REPORT.md
4 Stage 4 pre‑flight CMS Open Data H→ZZ→4l design; fixed selection/weights; quick runner; go/no‑go on TLS/XRootD stage4_cms_open_data_README.md
5 Stage 4T truth validation Fixed 1,000 AODSIM events; reco pairing vs generator ancestry truth_validation_README.md, truth_summary.json
6 Failure atlas (101) 59/101 agreement, 42 mismatches characterised FAILURE_ATLAS_REPORT.md, events_101.csv
7 Label‑validity audit Can the 42 mismatches' generator labels even be trusted? LABEL_VALIDITY_AUDIT.md
8 Top‑10 ancestry validation check ("canary") Full family trees for the 10 highest‑gap failures TOP10_CANARY_REPORT.md
9 Real data small 200k real Run2012B events → 26 4‑lepton candidates cms-real-data-small_REPORT.md, summary.json
10 Z‑peak validation check ("canary") Rebuild the known Z peak in ee and μμ z-peak-canary_REPORT.md, summary.json
11 Strict‑cuts 125 GeV Modest tightening of the selection criteria for the four 120–130 GeV candidates strict-cuts-125gev_REPORT.md, selected_electrons.csv
12 Pairing‑rule strength scan Sensitivity of the choice to on‑shell‑Z emphasis w pairing-rule-strength-101_REPORT.md, event_classification_101.csv
13 Physical pairing rules Agreement among three physically motivated rules physical-pairing-rules-101_REPORT.md, rule_agreement_counts.csv
14 Two mass-rule boundary events The only 2/101 events where the on-shell-Z and symmetric-propagator rules disagree two-mass-rule-edge-events_REPORT.md, two_events.csv
15 Pairing-rule geometry (final summary) 4×4 rule agreement, four-way vote split, and the mass-rule decision boundary — a visualization of prior results, no new analysis final-pairing-geometry-101_REPORT.md, final_pairing_geometry.png
16 Minimum observable perturbation audit Smallest fixed one-dimensional pT/eta/phi perturbation that flips each rule's choice minimum-observable-perturbation-101_REPORT.md, event_minimum_perturbations_101.csv
17 Fragile-event / candidate-value audit Ranking of the least stable events and their candidate pairing values fragile_event_rankings.csv, top10_pairing_candidate_values.csv
18 Local multivariate boundary audit (4 events) 12-dimensional normalized pT+angle boundary distances for four selected events local-multivariate-boundaries-top4_REPORT.md, local_boundary_results.csv
19 Comparison of 181002 and 181079 Descriptive gradient/geometry comparison of the two most degenerate events comparison-181002-181079_summary.json, event_level_comparison.csv
20 Δm distribution (all 101) Distribution of the gap between the two Z1 candidate masses delta-m-distribution-101_REPORT.md, event_delta_m_101.csv
21 Δm-bin rule behavior Rule agreement and flip behavior by fixed Δm bin delta-m-bin-rule-behavior-101_REPORT.md, delta_m_bin_rule_behavior.csv
22 Continuous local-pT boundary geometry (all 101) Local linear boundary distance in fractional-pT coordinates and its relation to Δm delta-m-local-pt-boundary-101_REPORT.md, event_local_pt_boundary_101.csv, structural_correlations.csv
23 Analytic fractional-pT gradient audit Closed-form explanation of the local on-shell score-difference gradient for all fixed 101 events, with a finite-difference cross-check and an independent stored-lepton-mass exact-derivative check; fractional-pT coordinates, η and φ fixed, active Z1 pair fixed analytic-gradient-audit-101_REPORT.md, DERIVATION.md, analytic_vs_finite_difference_101.csv, summary.json
24Fixed five-event pT-projected uncertainty canaryPartial feasibility check: per-lepton pT uncertainty content of the fixed AODSIM projected onto the §5j score-difference gradient for 5 preselected EventIDs; pT-only, η/φ fixed, zero cross-lepton covariance, local linear Gaussian — not a full detector-aware metricdetector-aware-canary-5_REPORT.md, summary.json, pt_projected_event_metrics.csv, selected_lepton_uncertainty_diagnostics.csv
25Fixed-101 uncertainty-availability auditFull audit of all 404 selected leptons for stored per-lepton uncertainty availability; found candidateP4Kind=2 && p4Error==0 in 10/168 electrons (10/42 4e events), 236/236 muons usable, 91/101 events fully availableuncertainty-availability-audit-101_REPORT.md, summary.json
26Channel-separated pT projection and alternative-error sensitivityComplete-case pT projection on the 91 official-uncertainty events (4e/4mu separately) plus four explicit alternative-error models for the 10 missing electrons — sensitivity, not official-error recoverypt-projection-sensitivity-101_REPORT.md, summary.json
27Independent-file 1000-raw-event availability replicationSame-dataset, different AODSIM file; first 1000 raw events; kind=2 && p4Error==0 in 6/248 electrons (6/62 4e events), 0 EventID overlap with the fixed 101independent-availability-replication_REPORT.md, summary.json
28Pooled 416-electron covariate-overlap diagnosticContinuous-covariate ECDF overlap and seed-category support for the pooled 416 electrons (kind=1 400 / kind=2 16); complete categorical seed separation remainsoverlap-diagnostic-416_REPORT.md, summary.json, continuous_overlap_summary.csv
29Full 42-mismatch ancestry auditFull mother/daughter graph audit for every mismatch EventID; 0 all-mother changes, 0 Z-copy-collapsed changes, 0 ambiguous labels; 59/101 unchangedANCESTRY_AUDIT_42_REPORT.md, summary_42.json, event_label_comparison.csv
30Official JHUGenMELA interference audit (101)Full same-flavour ME and two forced-pairing different-flavour controls for all fixed 101 events; mismatch 42 vs match 59 comparison; no additional cmsRunREPORT.md, results_101.csv, group_comparison.csv
31Fixed-three-event local hybrid-covariance benchmark and 4mu completion testSeparate 4e/4mu treatment in (ln pT, eta, phi) with available within-lepton covariance; one missing-electron event remains NA; the initially unaccepted 4mu SLSQP was completed only after a new 12D analytic Jacobian passed finite-difference checksLocal Codex artifacts detector-aware-3event-benchmark and muon-182137-analytic-jacobian-completion-test (not bundled in this README snapshot)
32Prospective two-event quadratic exact-ray audit (Stages P/T/C)Fixed one independent-file 4e event and one independent-file 4mu event before target generation; Stage P saved quadratic predictions, Stage T independently generated exact ray targets, and Stage C compared sealed artifacts without scoringLocal Codex artifacts prospective-two-event-quadratic-ray-audit-v3, prospective-two-event-quadratic-ray-audit-stage-t-v1, and prospective-two-event-quadratic-ray-audit-stage-c-v1 (not bundled in this README snapshot)
33Fixed-16 prospective quadratic exact-ray extension (Stages P/T/C)Retained eight candidates per channel with no NA substitution; sealed prediction and target stages independently; mechanically compared PREDICTED ∩ TARGETED; 14 paired events, all 14 improvedLocal Codex artifacts fixed16-quadratic-ray-audit-stage-p-v2, fixed16-quadratic-ray-audit-stage-t-v2, and fixed16-quadratic-ray-audit-stage-c-v1 (not bundled in this README snapshot)

3. Data, fixed ranges, event counts

Piece Data Fixed scope Events
Stages 1–3 Artificial RAMBO / toy amplitude — no real particles seed 20260802 etc.; mX=500, mY=150 50,000/hyp (Stage 1); 1,680,000 total (Stage 3)
Stage 4T truth CMS Open Data AODSIM SMHiggsToZZTo4L_M‑125 (record 9356) exactly 1,000 input events, DeltaR<0.1 reco–gen match 1,000 → 200 four‑lepton → 101 same‑flavour
Real data small Run2012B reduced NanoAOD (already‑processed quick outputs) 200,000 previously‑processed events; 0 new downloads 26 candidates; 4 in 120–130 GeV
Z‑peak canary Run2012B real data 2 files × 4 strata × 5,000 = 40,000 fixed events 4,191 dilepton candidates
Strict cuts same fixed quick_candidates.csv (SHA‑256 D9F9…462D) intervals [0,2,3], 75,000 events the same 4 candidates
Uncertainty availability (§5l)same fixed 101 AODSIM events, re-run through cmsRun101 events404 selected leptons (168 e + 236 μ); 91/101 fully available
Independent-file replication (§5l)different AODSIM file, same H→ZZ MC datasetfirst 1,000 raw events; 0 EventID overlap with the fixed 101121 eligible → 62 4e (248 electrons) + 59 4mu
JHUGenMELA interference audit (§5n)stored reconstructed four-vectors from the same fixed 101 AODSIM eventsexactly 101 same-flavour events; decay-only raw ME; no additional cmsRun42 mismatch + 59 match; 404 lepton rows
Local hybrid-covariance benchmark (§5o)saved selected-lepton kinematics and covariance content from the same fixed AODSIM sampleexactly 3 preselected EventIDs; no additional cmsRun2 × 4e + 1 × 4mu; one 4e accepted, one missing-error 4e NA, one 4mu completed adaptively
Fixed-16 quadratic extension (§5r)independent AODSIM file from the same H→ZZ MC dataset; frozen local hybrid covariance and fixed rayseight smallest eligible d_lin events per channel after fixed exclusions; no replacement16 fixed: Stage P 15 predicted / 1 NA; Stage T 14 targeted / 2 NA; Stage C 14 paired / 2 NA

Fixed physics constants used throughout Stage 4: mZ = 91.2 GeV, score S = ((mZ1−91.2)/10)², softmax T = 1.0, reco–gen DeltaR < 0.1 (truth_summary.json).


4. Method and main fixed conditions


5. Main results

5a. Toy identifiability (Stages 1–3)

Quantity Value Note
Stage 1 full RF test AUC (A vs B, no width) 0.9992 artificial only, not a discovery
Stage 2 conditional AUC at Γ/m = 0.60 0.5189 drops toward chance at large width
Stage 3 "history lost first" best‑second gap collapses first (~196 → ~4.4 by Γ/m=0.3) pairing survives longer than A/B class
Stage 3 pairing accuracy at Γ/m=0.6 (toy) 0.6831 still above chance 1/3

The ability to distinguish the two decay models and the ability to recover the correct pairing degrade at different rates (STAGE3_FINAL_REPORT.md). All values are conditioned on the toy generator and detector; they do not imply the existence of a corresponding physical process or any experimental discovery sensitivity.

5b. Stage 4 — closest‑to‑Z vs generator record (101 events)

Channel agree / n agreement exact 95% CI p vs 0.5
all same‑flavour 59 / 101 0.584 [0.482, 0.681] 0.111
4e 26 / 42 0.619 [0.456, 0.764] 0.164
4mu 33 / 59 0.559 [0.424, 0.688] 0.435

The 95% interval includes chance (0.5), so this fixed sample does not establish that the rule performs better than chance. The mismatches are not merely close ties: in all 42 mismatched events, even the generator‑record pairing places the more on‑shell Z candidate more than 20 GeV away from 91.2 GeV (FAILURE_ATLAS_REPORT.md).

5c. Label‑validity audit

The existing saved ROOT stores only mother(0)‑derived Z/H indices — not mother counts, statuses, or generator four‑momenta — so from these files alone the 42 labels cannot be confirmed correct or incorrect. Current exclusive primary classification: D = 42, A = 0, B = 0, C = 0 (D = undetermined with the saved information) (LABEL_VALIDITY_AUDIT.md). A full‑family‑tree canary on the top‑10 highest‑gap failures found 0/10 label changes under all‑mother traversal or Z‑copy collapse; those labels were internally consistent, and the canary's primary class is C = 10 — internally consistent bookkeeping, but no unique physical pairing for identical leptons (TOP10_CANARY_REPORT.md).

5d. Pairing‑rule strength scan

Weight w∈[0.5,1.0] on C(w)=w·d1²+(1−w)·d2² (w=1 = legacy Z1‑only):

Classification count
stable 65 / 101
rule‑dependent 34 / 101
near‑tie (≤1 GeV at w=1) 2 / 101
events with an analytic flip point in [0.5,1.0] 35

Agreement with the generator record is 54/101 at w=0.50 and 59/101 at w=1.00; the scan's maximum was 60/101, but that is a post‑hoc maximum over the same 101 events and is not advertised as a performance improvement (pairing-rule-strength-101_REPORT.md).

5e. Three physically motivated rules

on‑shell‑Z symmetric propagator compact ΔR
on‑shell‑Z 101 99 23
symmetric propagator 99 101 23
compact ΔR 23 23 101

All three agree on 22/101. Agreement with the generator record: on‑shell‑Z 59/101, symmetric propagator 59/101, compact ΔR 43/101. These are explainable fixed heuristics, not the full H→ZZ*→4l matrix element (the symmetric‑propagator rule is propagator‑only: no phase space, couplings, spin correlation, or identical‑particle interference) (physical-pairing-rules-101_REPORT.md).

5f. Two events where the mass-based rules disagree

The on‑shell‑Z and symmetric‑propagator rules agree on 99/101; the two exceptions are the only same‑flavour events where they select different pairings. Both are 4e events near m(4l) ≈ 125 GeV, so two simultaneous ~91 GeV Z candidates are kinematically impossible — the disagreement is the trade‑off between a slightly more on‑shell‑like Z1 and a higher Z2 mass, sometimes with a more compact angular pairing.

event option pairing mZ1, mZ2 [GeV] mean pair ΔR selected by
1:604:181002 A 0-1|2-3 69.92, 46.95 2.504 symmetric propagator; generator record
1:604:181002 B 0-3|1-2 70.84, 29.13 2.138 on‑shell Z; compact ΔR
1:608:182172 A 0-2|1-3 49.86, 40.20 1.878 symmetric propagator; compact ΔR
1:608:182172 B 0-3|1-2 53.30, 32.20 2.067 on‑shell Z; generator record

5g. Pairing-rule geometry (final summary)

A consolidated view of the rule‑comparison results above — a visualization of prior numbers, not a new analysis, physical law, or performance gain (final-pairing-geometry-101_REPORT.md).
The 4×4 agreement matrix reproduces §5b/§5e (generator record vs on‑shell‑Z / symmetric propagator / compact ΔR = 59 / 59 / 43; the two mass rules agree 99/101; each mass rule agrees with compact ΔR only 23/101). The one new breakdown is how the four rules vote per event:

vote split events
4‑0 12
3‑1 56
2‑2 33

Because only two valid OSSF pairings exist per event, a four‑way (ABCD) split is impossible. The decision‑boundary panel places each event in Δ(d1²) vs Δ(d2²) coordinates (the difference between the two candidate matchings, not a single selected (mZ1, mZ2)); a weight‑w mass rule flips across the line w·Δd1² + (1−w)·Δd2² = 0, and points are colored by the fixed classification (stable 65, rule‑dependent 34, near‑tie 2). Rule agreement or disagreement here does not mean physical correctness or error, and the generator record remains an internal reference, not an observable rule or a unique physical truth.

5h. Pairing stability, mass degeneracy, and local boundary geometry

All of the following are derived analyses of the same fixed 101 events — no new downloads, no new CMS processing, no independent validation sample. The perturbations are artificial numerical stress tests; their widths are not CMS detector resolution, calibration, or systematic uncertainties, and no per-species resolution model was used.

Fixed one-dimensional perturbation audit. Search bounds were ±20% for a common pT scale and for a single lepton's pT, and ±100 mrad for a single lepton's eta or phi. Within these bounds an on‑shell‑Z flip was found for common pT in 6/101, one‑lepton pT in 5/101, one‑lepton eta in 5/101, and one‑lepton phi in 3/101 events. These are minima inside the specified one‑dimensional families, not global multidimensional distances, and events with no boundary found are not asserted to be infinitely far from one (minimum-observable-perturbation-101_REPORT.md).

Rare Δm tail. With Δm = |mZ1,A − mZ1,B| and relative Δm = Δm / ((mZ1,A + mZ1,B)/2), over the 101 events absolute Δm has minimum 0.882 GeV, median 36.936 GeV, maximum 77.051 GeV.

event Δm relative Δm rank m4l
1:604:181079 0.882 GeV 1.236% 1/101 122.897 GeV
1:604:181002 0.915 GeV 1.300% 2/101 126.891 GeV

The sample is entirely M‑125 Higgs signal MC, so this does not show that degeneracy concentrates near 125 GeV, and events outside 118–130 GeV are not an experimental background sideband (delta-m-distribution-101_REPORT.md).

Fixed Δm-bin behavior (counts, not rates alone — the first bins are tiny):

Δm bin n on-shell single-pT flip within ±20%
<1 GeV 2 2/2
1–2 GeV 1 1/1
2–5 GeV 2 2/2
5–10 GeV 6 0/6
≥10 GeV 90 0/90

All 5 events with Δm < 5 GeV flipped under the one‑lepton‑pT ±20% audit; none of the 96 with Δm ≥ 5 GeV did. This is structurally expected, because Δm is closely related to the on‑shell‑Z decision margin itself — it is not an independent predictive or discovery result. The 5 GeV split was not preregistered and is not a natural physical threshold; the accompanying tests are exploratory and unadjusted (delta-m-bin-rule-behavior-101_REPORT.md).

Continuous local-pT boundary. Using fractional coordinates u_i = ΔpT_i / pT_i for the four leptons and d_local = g(0) / ‖∇_u g(0)‖₂, where g is the on‑shell score difference between the unselected and selected matching: 79/101 events have both candidate Z1 masses below 91.2 GeV, and 22/101 straddle it. For the 79 both‑below events Δm equals the on‑shell score margin algebraically. Spearman correlations with the local boundary distance:

subset metric ρ
all 101 absolute Δm 0.8388
all 101 relative Δm 0.8996
both-below 79 absolute Δm 0.9832
straddling 22 absolute Δm 0.8532
4e (42) / 4mu (59) absolute Δm ≈0.834 / ≈0.838

This strong correlation is mainly structural, not an independent validation: Δm supplies the numerator for the 79 both‑below events, and the remaining spread comes from event‑specific gradient norms. For straddling events Δm is not the exact score margin, and the actual score margin tracks the local distance more directly. For the two closest events, 1:604:181079 gives a linear local pT L2 of 1.748% (nonlinear boundary 1.748%, rank 1/101) and 1:604:181002 gives 1.838% (nonlinear 1.838%, rank 2/101) — linear/nonlinear agreement better than 0.01%. A nonlinear boundary was confirmed for 16 local candidates inside a per‑lepton ±20% box; the remaining distant linear extrapolations must not be read as exact global minima (delta-m-local-pt-boundary-101_REPORT.md).

Four-event multivariate audit — a different coordinate system. The earlier top‑four audit used normalized 12‑dimensional coordinates (pT change ÷ 20%; eta/phi change ÷ 0.1 rad) and let pT and angles move cooperatively. Its "combined audit distance" and the pT/angle components printed in that table therefore belong to the combined pT+angle solution and are not competing values against the later pT‑only L2 distances. In local_boundary_results.csv the pT‑only rows for 181079 and 181002 reproduce the later figures of ≈1.748% and ≈1.838%, while the smaller pT numbers in the top‑four summary (≈1.577% and ≈1.485%) come with simultaneous angle components (local-multivariate-boundaries-top4_REPORT.md).

181002 versus 181079. The two events share the two smallest absolute and relative Δm values among all 101, the two shortest local on‑shell pT boundary distances, both candidates lying below 91.2 GeV, and m4l near 125 GeV. The saved gradient comparison gives a cosine similarity of about 0.845 using same‑index bookkeeping labels; because cross‑event lepton indices are not a permutation‑invariant physical correspondence, this is descriptive similarity only, not evidence that the two events form a physical class (comparison-181002-181079_summary.json).

5i. Real‑data pipeline validation

Check Result
4‑lepton candidates (200k real events, 0 new downloads) 27 raw → 26 after fixed stream routing (4e=22, 2e2mu=4)
candidates in 120 ≤ m(4l) < 130 GeV 4not called Higgs events (no background estimate, no formal electron ID)
Z‑peak validation check (40,000 fixed events, 4,191 candidates) ee fit center 91.25 GeV, μμ 90.79 GeV vs known 91.2 GeV
Modest tightening of the selection criteria for the four 120–130 GeV candidates 0 / 4 survive all conditions simultaneously; the conditions do not constitute formal electron ID

Input‑quality flag: of the 16 selected electrons in the four candidates, 14 had isolation at the missing‑value sentinel −999 (isolation_available = False); the original isolation < 0.40 cut passes −999, so isolation was effectively inert for these candidates (strict-cuts-125gev_REPORT.md, verified in selected_electrons.csv).

5j. Analytic fractional-pT gradient audit

This subsection explains, in closed form, the local gradient of the on-shell score difference used in §5h, evaluated on all fixed 101 events. It is deliberately narrow in scope:

Structure. The two competing active Z1 pairings of an event share exactly one lepton. Ordering the four fractional-pT coordinates as (shared, other-only, chosen-only, unused) and writing the two candidate Z1 masses as m_a (the "other" matching) and m_b (the "chosen"/selected matching), with on-shell signs q_k = sign(m_k − m_Z), the massless closed form gives

grad g = 1/2 ( q_a m_a − q_b m_b,  q_a m_a,  −q_b m_b,  0 )

so the gradient norm follows the plus-sign closed form — all three squared terms are added:

||grad g||^2 = 1/4 [ m_a^2 + m_b^2 + (q_a m_a − q_b m_b)^2 ],   q_k = sign(m_k − m_Z).

For the 79 both-below events the shared term is a mass difference (q_a = q_b); for the 22 straddling events it is a mass sum (q_a ≠ q_b). The two unique-lepton components (q_a m_a and −q_b m_b) are always present.

Which masses enter. The primary closed form uses the candidate masses m0_a, m0_b obtained from massless four-vectors. The derivative computed from the stored electron/muon rest masses is kept separately as an independent cross-check against the saved finite difference, not as the primary formula. The massless form is primary for interpretability — only the massless limit collapses to the clean two-mass expression above — not for accuracy: the stored-mass derivative is the more accurate of the two, matching the saved finite difference to ~1e-8, while the massless form departs from it at the ~1e-3 level (see the error tables below).

Fixed scope and structural checks (from summary.json and internal_z1_branch_audit.csv):

Check Value
fixed events 101
both-below events 79
straddling events 22
baseline-selection mismatches 0
active-Z1-pair changes after switching to the massless model 0
active-pair q-sign changes 0
exact internal Z1 ties at the origin 0
active-pair switches in the per-coordinate ±1e-4 finite-difference stencil 0
max difference: closed-form norm vs norm of the four analytic components 1.4210854715202004e-14

Exact stored-mass derivative vs saved finite difference (independent cross-check, 404 components):

Metric Value
component RMS absolute error 2.6443607718971793e-09
component maximum absolute error 1.923128678527064e-08
maximum event-vector relative error 4.475563013813169e-10

Massless analytic approximation vs saved finite difference (404 components):

Metric Value
component RMS absolute error 3.6273790441550404e-04
component maximum absolute error 2.352876117170055e-03
max component relative error (reference components > 1e-12 only) 2.3629231766061218e-04
maximum event-vector relative error 4.16342873822614e-05

The stored-mass derivative therefore matches the saved finite difference to ~1e-8 or better, while the massless approximation departs from it at the ~1e-3 level; the difference between the two is the finite stored-mass correction, isolated from the numerical finite-difference residual (error_metrics.csv).

Shared-lepton contribution. The "shared-component fraction" below is the shared coordinate's share of the squared gradient norm, not a fraction of the gradient amplitude (component_contribution_summary.csv, side_class_comparison.csv):

Class events mean saved-FD norm median saved-FD norm mean shared fraction of squared norm median shared fraction
both-below / difference 79 49.83110501073093 52.330996933004016 0.12484488654354996 0.10176327590951395
straddling / sum 22 85.74566110595714 87.15635311591495 0.631631434092001 0.6432211204389451

Interpretation (scope-limited): in these fractional-pT local coordinates, for both-below events the shared component enters as a mass difference and largely cancels, whereas for straddling events it enters as a mass sum and adds; this is why the straddling events carry the larger gradient norms in this fixed sample. This is a statement about the two active candidate masses and the shared-lepton topology within the fixed local coordinates only.

Relation to the §5h both-below correlation. In the fully massless both-below model, g(0) = Δm and ‖∇g‖ = ½√(m_a² + m_b² + Δm²), so the local boundary distance reduces exactly to d = 2Δm / √(m_a² + m_b² + Δm²), using massless masses and the massless Δm. This is an exact massless-model reduction; against the saved finite-mass finite-difference distance of §5h it is a numerically validated approximation, not an identity (the saved analysis carries the stored electron/muon masses). It therefore explains the strong both-below Δm–distance relationship structurally, but does not by itself mathematically determine the observed Spearman ρ = 0.9832, because the candidate-mass scale m_a² + m_b² also varies across events.

Worked examples (from target_examples_181079_181002.csv). The gradient vectors below are printed in physical lepton-index order (u0, u1, u2, u3), not the canonical (shared, other-only, chosen-only, unused) order of the formula above; the per-event index mapping is given with each example.

1:604:181002 — massless other/chosen masses 69.92313036889585 / 70.83805787655506 GeV, q_other = q_chosen = −1 (shared term is a difference); indices shared=0, other-only=1, chosen-only=3, unused=2:

1:604:181079 — massless other/chosen masses 70.89208275962014 / 71.77380860949629 GeV, q_other = q_chosen = −1 (shared term is a difference); indices shared=2, other-only=1, chosen-only=3, unused=0:

Both examples above are 4e events, where the massless approximation is at its best (their massless-vs-finite-difference vector relative errors are ~8e-8 and ~3e-8). A representative event shows the typical — and worst — massless departure, because the approximation error is driven by the muon mass:

1:604:180905, both-below; massless other/chosen masses 24.621186397148737 / 88.6468016747457 GeV, q_other = q_chosen = −1 (difference); indices shared=3, other-only=0, chosen-only=1, unused=2:

So for this event the exact stored-mass derivative reproduces the saved finite difference to ~1e-10, while the massless form differs in the fifth significant figure of the norm — the interpretability / accuracy trade-off made concrete.

Within-candidate Z1 branch audit. Within the fixed local region:

Across all 202 candidate matchings the local-linear internal-branch distance spans 0.9527% to 133.44% L2, and taking the nearest branch per event spans 0.9527% to 114.87%. These are local linear estimates, not verified radii of validity, so the large values must not be read as exact branch-free neighborhoods; the 0.9527% minimum is the tightest local region and stays well outside the ±1e-4 stencil. That figure is a local linear estimate of the internal branch distance, not an exact nonlinear branch distance, and it does not assert that the closed form carries across an internal Z1 branch (internal_z1_branch_audit.csv).

5k. Fixed five-event pT-projected uncertainty canary

A partial feasibility result, not a completed detector-aware analysis. This canary ran cmsRun (CMSSW_5_3_32, the recommended analysis release) over 5 preselected EventIDs to answer one narrow question: for the leptons of the saved pairing, is a per-lepton momentum uncertainty actually present in the fixed 2012 AODSIM, and can it be projected onto the on-shell score-difference direction of §5j? It is a pT-projected uncertainty canarynot a full detector-aware metric (detector-aware-canary-5_REPORT.md, summary.json).

Scope and method. The metric is pT-projected only, with η and φ held fixed, zero cross-lepton covariance, and a local linear Gaussian approximation. For each event it forms z = |score margin| / σ_g, where σ_g projects the per-lepton pT uncertainties onto the §5j analytic score-difference gradient, and reads a linear-Gaussian flip probability from that z. That probability is a number inside the local linear Gaussian model — it is not a measured probability of a wrong pairing. Muons used the track pT uncertainty (candidate pT and muonBestTrack pT agreeing to 1e-5); electrons projected the stored candidate-P4 p4Error as a direction-fixed relative pT uncertainty, which is not a full electron covariance.

Availability audit (20 leptons matching the saved selection):

Check Result
selected leptons audited 20
candidate pT / η / φ vs saved (max abs diff) 7.1e-15 / 2.2e-16 / 5.6e-17
track covariance finite / symmetric / positive 20 / 20 / 20
usable pT projection (leptons) 19 / 20
events with all four leptons usable 4 / 5

Per-event pT projection (from pt_projected_event_metrics.csv):

EventID channel role z linear flip probability usable
1:604:180905 4mu massless-correction stress 31.6785 1.53522e-220 yes
1:604:181002 4e selection-boundary rank 2 0.772356 0.219952 yes — provisional electron approximation
1:604:181079 4e selection-boundary rank 1 NA NA no
1:608:182137 4mu nearest 4mu selection boundary 1.60784 0.0539351 yes
1:608:182396 4mu straddling event 24.4876 1.00116e-132 yes

The 181002 electron result is provisional: it rests on the candidate-P4 p4Error standing in for a full electron covariance, so its 0.219952 flip number must not be read as a physical mispairing probability. 181079 is not usable / NA.

Why 181079 is NA. Its lepton slot 3 (reco_index = 3) is a candidateP4Kind = 2 (P4_PFLOW_COMBINATION) electron whose stored candidate p4Error = 0. The same electron does carry correctedEcalEnergyError = 0.567356646 GeV and a GSF trackMomentumError = 999, but neither was substituted for the missing candidate-P4 error, so the row was left NA rather than filled with a stand-in.

Independent repository-wide verification of the deltaP omission. Beyond inspecting the two source files cited above, a sparse checkout of the official cms-sw/cmssw repository at tag CMSSW_5_3_10 was used to grep every call site of setDeltaP( across the full RecoParticleFlow package tree (all files under RecoParticleFlow/, ~300+ .cc/.h files), DataFormats/ParticleFlowCandidate, and RecoEgamma/EgammaElectronAlgos — not just the two files quoted in the discussion. Result: exactly one occurrence of setDeltaP( in that entire scope, and it is the inline setter definition itself in PFCandidate.h:257 — zero call sites. The backing member deltaP_ is touched only by the two constructors in PFCandidate.cc (deltaP_(0.)), never reassigned. This confirms, at the scope of the whole relevant module tree rather than the two originally cited files, that PFCandidate::deltaP() cannot be nonzero anywhere in this CMSSW tag's PF-electron path, so every electron reaching GsfElectronAlgo.cc:866-869 with candidateP4Kind() == P4_PFLOW_COMBINATION will deterministically carry p4Error = 0 — not as a property specific to 181079. Scope of this specific verification: tag CMSSW_5_3_10 only (the AODSIM's HLT/RECO production release); the analysis release CMSSW_5_3_32 was checked earlier only for file-identity of the same three files, not re-grepped repository-wide; PF2PAT or other wrapper/customization producers outside the three listed packages were not searched; and this does not establish developer intent, only the absence of any code path writing deltaP_ to a nonzero value.

CMSSW source audit (bounded). The target AODSIM's HLT/RECO was produced with CMSSW_5_3_10; the recommended analysis release is CMSSW_5_3_32, and the relevant PF-electron source files are identical between the two. PFCandidate does provide deltaP / pflowP4Error fields — so the data format is not missing an error field — but deltaP is initialized to 0, the standard RecoParticleFlow PF-electron path does not call setDeltaP(), and PFElectronTranslator copies that 0 into the P4_PFLOW_COMBINATION error. The bounded reading is therefore that, for this electron, the combined-uncertainty field was left unset by the standard PF-electron producer path — this is not a true zero uncertainty, not an extraction mistake, and not a confirmed CMSSW defect. The official combined error cannot be taken from this AOD's p4Error; an independent approximation from the ECAL error and GSF covariance could be built later, but that would be an approximation, not a recovery of the official value.

Reproducibility. cmsRun processed exactly 5/5 fixed events (wall time 1:29.34, maximum RSS 390,864 kB). Independent postprocessing reproduced REPORT.md, summary.json, and both CSV outputs with 0 SHA-256 mismatches, and no additional CMS event processing was performed during the check (REPRODUCIBILITY_CHECK.txt, runtime_environment.txt).

The five-event canary above is retained as its historical scope; the audits below later generalized the same availability question to all 101 fixed events, to an independent file, and to a pooled covariate-overlap diagnostic (§5l).

5l. Uncertainty-availability audits and covariate-overlap diagnostics

These four audits extend the §5k five-event feasibility canary to the full fixed 101 events, to an independent AODSIM file, and to a pooled covariate-overlap diagnostic. They remain availability and overlap diagnostics — no z or flip number here is a full detector-aware distance or a measured probability of a wrong pairing.

Fixed 101-event uncertainty-availability audit

All 404 selected leptons of the fixed 101 events were audited for stored per-lepton uncertainty availability (uncertainty-availability-audit-101_REPORT.md, summary.json):

This generalizes the §5k single-electron observation: the earlier canary happened to hit one such electron; the full audit finds 10/168.

Channel-separated pT projection and sensitivity analysis

The official complete-case projection uses the 91 events with official saved uncertainties, reported per channel and never pooled (pt-projection-sensitivity-101_REPORT.md, summary.json):

channel n z min z median z max z < 1 z < 2 max linear-Gaussian flip
4e 32 0.772356 18.189 74.517 1 1 0.219952
4mu 59 1.60784 35.4552 111.123 0 1 0.0539351

Independent-file replication

A pre-fixed different AODSIM file from the same CERN H→ZZ MC dataset, first 1000 raw events only, with the same truth matching and the same 4e/4mu selection (independent-availability-replication_REPORT.md, summary.json):

Pseudoreplication correction

Pooled 416-electron covariate-overlap diagnostic

Pooled descriptive sample of 416 electrons = kind=1 400 + kind=2 16 (168 original + 248 independent; 158 + 242 kind=1, 10 + 6 kind=2) (overlap-diagnostic-416_REPORT.md, summary.json, continuous_overlap_summary.csv):

The six exclusions relative to the pooled central 95% range of the closest 370-electron kind=1 subgroup (0.7644 to 2.0707) are listed below. Four lie below the interval and two lie above it, so the result is not produced by the single largest outlier alone.

EventID sample candidate pT / track pT side
1:604:181104 original fixed-101 0.298 below
1:119:35596 independent file-1000 0.599 below
1:122:36320 independent file-1000 0.686 below
1:611:183165 original fixed-101 0.688 below
1:608:182259 original fixed-101 3.055 above
1:608:182324 original fixed-101 5.155 above

This completes the planned descriptive follow-up for the pooled 416-electron overlap diagnostic. No additional cmsRun, calibration fit, or reconstruction-mechanism claim is implied by this table. - electron_track_momentum_error and electron_combined_p4_error are sentinel 999 for 16/16 kind=2 electrons — a missing-value sentinel, not a large physical uncertainty. The finite covariance-derived track_pt_error is a different field. The candidate-P4 error is exactly 0 for 16/16 kind=2 electrons and is not interpreted as a true zero uncertainty. - This analysis diagnoses observed covariate overlap only; it does not verify equality of reconstruction-error mechanisms or transportability of a kind=1 error model. Any future proxy must be treated as an explicit cross-seed-path sensitivity model, not a recovery of the official value.

5m. Full ancestry audit of all 42 mismatch EventIDs

The fixed top-10 canary method was extended to the complete, prespecified set of 42/42 events where the closest-to-Z rule disagreed with the legacy generator pairing (ANCESTRY_AUDIT_42_REPORT.md, summary_42.json, event_label_comparison.csv). The same single fixed AODSIM file was used, with only the 42 EventIDs selected by eventsToProcess.

The 10-event benchmark completed in 1:57.61 with maximum RSS 362,032 kB. The full 42-event cmsRun completed in 2:26.31 with maximum RSS 365,260 kB. The final artifact check found 0 SHA-256 mismatches; an independent postprocessing rerun reproduced all 10 core artifacts exactly; and the full run's top-10 subset reproduced all eight corresponding canary tables exactly. No reliable XRootD byte counter was present in the log.

This closes the generator-label construction audit for the fixed 42 mismatches. At this stage it did not determine which identical-lepton pairing was physically preferred; the separate fixed-101 matrix-element/interference audit is reported next.

5n. Official JHUGenMELA interference audit of all fixed 101 events

The same stored four-vectors were evaluated for all 101/101 same-flavour events with official JHUGenMELA v7.5.6, ROOT 6.30.02, and a fixed 8 TeV decay-ME configuration (REPORT.md, results_101.csv, group_summary.csv, group_comparison.csv). No additional cmsRun was needed: the frozen input contains 404 rows = 101 events × 4 reconstructed leptons.

The complete same-flavour ME was compared with the same-normalization no-interference control 0.5(P_A+P_B), where P_A and P_B force the two valid OSSF pairings by assigning their pairs different charged-lepton flavours without changing the measured four-vectors. The resulting relative interference is a signed ME comparison, not an A/B truth probability.

Group n Mean relative interference Median IQR Positive fraction
Mismatch, all 42 +14.10% +4.54% +0.19% to +24.57% 76.2%
Match, all 59 +19.83% +10.03% +0.43% to +35.04% 79.7%
Mismatch, 4e 16 +23.57% +18.67% +4.00% to +38.34% 87.5%
Match, 4e 26 +22.38% +12.99% +2.09% to +43.19% 80.8%
Mismatch, 4mu 26 +8.27% +1.73% −0.30% to +12.42% 69.2%
Match, 4mu 33 +17.82% +8.40% +0.07% to +25.06% 78.8%

The prespecified comparison was the median relative-interference difference, mismatch minus match. Pooled over channels it was −5.49 percentage points, with a deterministic 20,000-resample conditional bootstrap interval of [−15.80, +6.16] points. The 4e estimate was +5.68 points ([−24.22, +25.28]); the 4mu estimate was −6.68 points ([−17.64, +0.89]). All intervals include zero, and the channel point estimates have opposite signs. The fixed sample therefore gives no stable evidence that mismatch events have stronger interference.

Validation was exact within the saved calculation: two independent executions agreed in all 23 non-timing fields for all 101 events; all 101 passed the 16 structured OSSF input-order checks with maximum ME difference 0; the corrected one-event benchmark 1:604:181002 reproduced +25.0719358298%; and all complete/control MEs were finite and positive. Nominal JHUGen InterfOn and InterfOff remained exactly equal in all 101 events, so their difference was not used. The reproducible bundle includes the C++ source, scripts, fixed input, Dockerfile, JHUGen distribution, environment record, two raw result tables, logs, and SHA-256 manifest.

This audit tests association within the fixed selected 101 events. It does not establish causality, choose the physically "true" A/B pairing, include detector/theory/background systematics, or validate the result on an independent event sample.

5o. Fixed-three-event local hybrid-covariance benchmark

This follow-up moved beyond the earlier pT-only projection for exactly three preselected events while keeping electron and muon uncertainty handling separate. It used local coordinates (ln pT, eta, phi), recomputed four-vectors and active closest-to-Z branches under variation, and compared the local linear projection with an exact nonlinear boundary calculation. It did not run an additional cmsRun or extend to the other 98 events.

For 4mu, each best-track 5×5 covariance was transformed to the available within-muon 3×3 covariance. For 4e, the active candidate-P4 relative scale error was combined with the GSF-track (eta,phi) 2×2 block. The unavailable candidate-scale/GSF-angle cross terms and all cross-lepton covariances were set to zero. The covariance was frozen at the central point. This is therefore a hybrid covariance, not a complete electron or event-level detector covariance.

All 8/8 selected electrons passed the fixed candidate-P4 versus GSF centre-direction check; the maximum DeltaR was 0.000365077. The two mandatory saved pT-only checks reproduced with absolute differences 4.46e-11 (4e 181002) and 1.87e-11 (4mu 182137). The missing candidate-P4 error in 1:604:181079 slot 3 was not replaced by ECAL, GSF, an average, or another proxy.

EventID Channel Linear distance Ray boundary Accepted iterative distance Outcome
1:604:181002 4e 0.772266030 σ 0.775368015 σ 0.775346555 σ accepted; iterative minus linear +0.399%; no branch switch
1:604:181079 4e NA NA NA one active candidate-P4 error missing; no imputation
1:608:182137 4mu 1.607406407 σ 1.613524556 σ 1.613366841 σ accepted only in the later analytic-Jacobian completion test; iterative minus linear +0.3708%

The first fixed-three-event run is retained as an immutable failure record. Its final recorded two-pass job used 1,480 exact-score evaluations, but the session cumulative estimate was 3,700, exceeding the authorized ≈1,494 cap because an aborted attempt and a report-regeneration calculation were also run. It is labelled partial_score_cap_violation; the 4mu SLSQP result remained NA there after the numerical finite-difference Jacobian consumed its 300-evaluation optimizer cap. A proposed cap-400 retry was prepared later but never executed and consumed zero exact-score evaluations.

The 4mu result was completed in a separate adaptive test with a newly derived exact stored-mass, piecewise-active 12D analytic constraint Jacobian. This was not the earlier §5j pT-only analytic gradient reused as a 12D formula. The new derivatives included ln pT, η, and φ and were checked against central finite differences at the origin, half-ray, saved-ray, and accepted endpoint, plus six fixed directional derivatives. The maximum component discrepancy was 2.24e-9 GeV/unit, the maximum relative L2 discrepancy was 5.36e-11, and the maximum directional absolute discrepancy in the debug checks was 4.58e-9; active pairs did not switch.

With the analytic Jacobian, the formal 4mu SLSQP terminated in 3 iterations / 7 optimizer score evaluations, with final g = -2.84e-14 GeV and relative KKT residual 8.28e-14. Formal and reproduction outputs matched. The new test used 99 debug + 121 formal + 121 reproduction = 341/528 authorized exact-score evaluations and 1.164/120 s. The accepted distance differs from the predecessor's last unaccepted point by only about 3.3e-12 σ, so this closes the numerical termination issue rather than finding a materially different boundary.

This is explicitly a numerical-completion test after the preceding failure, not an independently prespecified confirmation from the beginning. Both accepted values are local hybrid-covariance sensitivities. They are not complete detector-covariance distances, global shortest distances, pairing-error probabilities, or evidence that either pairing is the unique physical history.

5p. Fixed 91-complete-case hybrid-linear audit

The subsequent fixed audit covered all 91 complete cases (4e 32, 4mu 59). Under the unchanged hybrid definition and event-level QC, 83 passed and 8 failed: 4e had 24 PASS / 8 FAIL, while 4mu had 59 PASS / 0 FAIL. All eight failures were candidate-P4/GSF hybrid-compatibility-gate failures; they are not physics failures. Thus, 91 complete cases and 83 hybrid-QC-usable cases are distinct denominators.

The preregistered operational screen, QC PASS and hybrid d_lin <= 3, selected exactly two events: 1:604:181002 (4e) and 1:608:182137 (4mu). They are the same two events already used in the local nonlinear pilot, not an independent nonlinear validation. Their linear distances differed from the existing nonlinear results by less than 0.4% (0.3989% and 0.3708%, respectively). The other 89 complete cases produced zero new local candidates; no additional nonlinear calculation was run.

The d_lin <= 3 cutoff is an operational screening threshold for limiting nonlinear follow-up far from the centre of a frozen local hybrid covariance. It is not a statistical three-sigma statement, a theoretical guarantee of linear accuracy, or a calibration from Delta-m, the pT-only distance, or the +/-20% perturbation study. These results remain local hybrid-covariance sensitivities subject to the omitted scale-angle and cross-lepton correlations and do not establish a global distance, probability, unique physical pairing, or independent confirmation.

5q. Prospective two-event quadratic exact-ray prediction audit

This pilot tested whether a fixed second-order correction predicted the exact boundary better than the local linear distance on two target-unseen events. Candidate selection was completed before target generation from the independent-file audit: among 115 complete cases / 96 event-QC PASS cases, the minimum hybrid d_lin event was fixed separately for 4e (1:120:35923) and 4mu (1:120:35961). A target-exposure inventory found 31 candidate-related records, 0 candidate-specific numerical exact-ray exposures, and 0 scan errors. Here, “target-unseen” means this saved-artifact exposure test passed; it is not a claim about inaccessible human memory or information outside the audited files.

The computation was separated into three sealed stages:

  1. Stage P (prediction): computed and saved the linear and quadratic predictions without reading or generating the exact targets. It used 20/20 event-score evaluations and 40/40 pairing-score calls; evaluation 21 was not started. The deterministic repeat matched exactly, target semantic parse count was 0, and wall time was 0.246 s.
  2. Stage T (target): generated only the two exact ray targets, without semantically parsing the prediction artifact. It used 174/204 event-score evaluations and 348/408 pairing-score calls; evaluation 205 was not started. Both events were TARGETED, the deterministic repeat matched exactly, prediction semantic parse count was 0, and wall time was 0.739 s.
  3. Stage C (comparison): read each sealed numerical artifact once and performed no exact scoring, ROOT/truth read, or scoring-kernel import. The deterministic repeat matched exactly and wall time was 0.0226 s.
Event Channel Linear d_lin (σ) Quadratic prediction (σ) Exact ray target (σ) Linear abs. error (σ) Quadratic abs. error (σ) Quad./linear abs.-error ratio Result
1:120:35923 4e 4.455655098 4.779493300 4.762146960 0.306491862 0.017346340 0.0565964 IMPROVED; +0.364255% overprediction
1:120:35961 4mu 4.509850534 4.487424664 4.487082139 0.022768396 0.000342525 0.0150439 IMPROVED; +0.00763359% overprediction

Thus the quadratic prediction had smaller absolute error than the linear approximation for 2/2 fixed events, and it overpredicted both exact ray targets. The sealed Stage-P prediction JSON has SHA-256 EFF53FB41D60537E75670413DE9DEE25035FB12A20AEE0223ED446AA2AD5A19E; the Stage-T target JSON, D96432E5EA11F26E1A4120D359989A6FD8C675DDEA0BB2A675A6916390AD4FA8; and the Stage-C comparison JSON, 91BF6A0781033AFF2B9BCFD567DFDF48D21242A309B2F4CBF38DF95968C1D17F.

The computational-integrity checks passed, but scientific accuracy is a separate question. With only one event per channel, no population error rate, coverage, calibration, channel comparison, or generalization performance can be estimated. These remain fixed-ray, frozen local hybrid-covariance sensitivities, not global shortest detector-covariance distances or measured pairing-error probabilities.

5r. Fixed-16 prospective quadratic exact-ray extension

The extension was fixed before its exact targets were generated. It retained the eight smallest eligible d_lin events per channel after excluding the previously known target and the two pilot events. The fixed ranges were 7.1660–13.6458 σ for 4e and 11.0305–20.0789 σ for 4mu. All 16 EventIDs and their order were retained throughout; an event-level NA was never removed, replaced, or used to redefine the denominator.

The computation again used three sealed stages:

  1. Stage P (prediction): used 160/160 event-score evaluations and 320/320 pairing-score calls. It produced 15 PREDICTED rows and one NA (1:121:36059, selected-pair mass-minus-MZ sign changed from the origin). The two deterministic passes matched exactly, target semantic parsing was zero, and wall time was 0.855 s.
  2. Stage T (target): used 1228/1632 event-score evaluations and 2456/3264 pairing-score calls. It produced 14 TARGETED rows and two NAs (1:122:36334 and 1:121:36059, both active-pair switches from the origin). The two 614-evaluation passes matched exactly, prediction semantic parsing was zero, and wall time was 3.755 s.
  3. Stage C (comparison): mechanically formed the primary set Stage-P PREDICTED ∩ Stage-T TARGETED, preserving all 16 formal rows. The overlap of the Stage-P and Stage-T NA sets left 14 paired events and 2 formal NA rows. Stage C parsed each sealed JSON once, performed the in-memory comparison twice with exact agreement, made zero score calls, and completed in 0.128 s.

The primary event-level quantities were fixed as

E_lin  = abs(d_lin  - d_ray) / d_ray
E_quad = abs(d_quad - d_ray) / d_ray
DeltaE = E_lin - E_quad
signed quadratic residual = (d_quad - d_ray) / d_ray
Fixed-cohort result Value
Formal rows16
Primary paired denominator14
Paired channel counts4e 8; 4mu 6
IMPROVED / TIED / WORSE14 / 0 / 0
Median DeltaE0.0794076141
Linear relative-error range0.00868198–0.158321 (0.868%–15.832%)
Quadratic relative-error range0.000403737–0.0194545 (0.0404%–1.945%)
DeltaE range0.00544707–0.146539
Signed quadratic residualpositive for 14/14 paired events

The sealed prediction, target, and comparison JSON SHA-256 values are respectively C70EBE2D8C8F091592CDE19F3CC00CE7D4C67174BE76A1BB31DF8952A658BD1E, 827D97C0F90555BC7479B514A11C00A9A269BDCBAAD206EF054D4BEDE4289E98, and 1B16667EB45549218F2F9CF1582CD3FC4D4F357DF6E9279252494FBCC46210CC. The Stage-C artifact manifest contains 13 entries with zero mismatches and has SHA-256 4A568B2B2394EF2BE46D80B20F6C9A538F28A1AEC8C98EE927F8B6A60607A423.

This prospectively fixed cohort gives substantially stronger evidence than the two-event pilot that the quadratic correction improves the fixed-ray approximation in the selected near-distance independent-file range. It still does not establish population accuracy, coverage, calibration, a global shortest detector-covariance distance, or transport to another process, detector condition, dataset, or real data. The 14/14 positive residuals are a reproducible cohort pattern and a hypothesis for external validation; they are not by themselves proof of a population-wide overprediction bias.


6. Figures

Figure Shows
m4l_data_vs_mc.png quick m(4l) real data vs MC, low statistics
z_peak_ee_mumu.png ee/μμ Z peaks vs known 91.2 GeV
strength_scan_overview.png agreement vs w; the scan max 60 is a post‑hoc peak on these 101 events
representative_examples.png stable / rule‑dependent / near‑tie crossings
final_pairing_geometry.png 4×4 rule agreement, four-way vote split (12/56/33), and the mass-rule decision boundary
minimum_perturbation_stability.png minimum fixed one-dimensional perturbation that flips each rule; artificial stress test, not detector resolution
delta_m_distribution_101.png Δm distribution over the 101 events, with 181079 and 181002 in the rare low tail
delta_m_bin_rule_behavior.png rule agreement and flip behavior by fixed Δm bin (n = 2, 1, 2, 6, 90)
delta_m_local_pt_boundary_101.png Δm vs local linear pT boundary distance, split by both-below and straddling events
analytic_gradient_error_distributions.png analytic massless norm vs saved finite-difference norm; component-error distributions; shared-component contribution for both-below vs straddling events; stored-mass correction vs numerical finite-difference residual
continuous_covariate_ecdf.png pooled 416-electron ECDF overlap of kind=1 (all / dual-seed) vs kind=2 across candidate pT, |eta|, corrected ECAL energy, relative ECAL error, relative track-pT error, and candidate-pT/track-pT ratio
sample_stratified_ecdf.png the same overlap split by sample (original kind=1 n=158 / kind=2 n=10, independent kind=1 n=242 / kind=2 n=6) for |eta|, relative track-pT error, and candidate-pT/track-pT ratio
support_and_distance.png seed-cell support (complete kind=1/kind=2 separation), within-4e candidate-pT rank, and kind=2 nearest-kind=1 distance in IQR units

7. Corrections and terminology updates

Where documents report different values, this README uses the result from the most recent audit and records the change as "earlier wording → post‑audit wording."


8. Reproduction and main scripts

# Stages 1–3 (artificial)
python -m pip install -r requirements.txt
python -m unittest discover -s tests -v
python run_all.py --quick        # 2,500 events/hyp
python run_all.py                # full: 50,000 events/hyp
python run_stage2.py             # → outputs_stage2/
python run_stage3.py             # → outputs/stage3/

9. Suggested artifact layout

Relative links above assume this consolidated tree (rename your dated Codex folders to match):

.
├── project/
│   ├── README.md                     # Stage 1 (= artificial_four_particle_decays_README.md)
│   ├── STAGE2_FINAL_REPORT.md
│   └── STAGE3_FINAL_REPORT.md
├── stage4_cms_open_data/
│   ├── README.md                     # Stage 4 pre-flight
│   └── truth_validation/
│       ├── README.md
│       └── outputs/fixed_1000/truth_summary.json
├── failure_atlas_101/                # FAILURE_ATLAS_REPORT.md, events_101.csv
├── label_validity_audit_101/         # LABEL_VALIDITY_AUDIT.md
├── top10_label_canary/               # TOP10_CANARY_REPORT.md
├── cms-real-data-small/              # REPORT.md, summary.json, m4l_data_vs_mc.png
├── z-peak-canary/                    # REPORT.md, summary.json, z_peak_ee_mumu.png
├── strict-cuts-125gev/               # REPORT.md, selected_electrons.csv
├── pairing-rule-strength-101/        # REPORT.md, event_classification_101.csv, *.png
├── physical-pairing-rules-101/       # REPORT.md, rule_agreement_counts.csv, rule_definitions.csv
├── two-mass-rule-edge-events/        # REPORT.md, two_events.csv
├── final-pairing-geometry-101/       # REPORT.md, final_pairing_geometry.png
├── minimum-observable-perturbation-101/  # REPORT.md, event_minimum_perturbations_101.csv, *.png
├── fragile-pairing-events-audit/     # fragile_event_rankings.csv, top10_pairing_candidate_values.csv
├── local-multivariate-boundaries-top4/   # REPORT.md, local_boundary_results.csv
├── comparison-181002-181079/         # summary.json, event_level_comparison.csv
├── delta-m-distribution-101/         # REPORT.md, event_delta_m_101.csv, *.png
├── delta-m-bin-rule-behavior-101/    # REPORT.md, delta_m_bin_rule_behavior.csv, *.png
├── delta-m-local-pt-boundary-101/    # REPORT.md, event_local_pt_boundary_101.csv, structural_correlations.csv, *.png
└── analytic-gradient-audit-101/
    ├── REPORT.md
    ├── DERIVATION.md
    ├── analytic_vs_finite_difference_101.csv
    ├── error_metrics.csv
    ├── side_class_comparison.csv
    ├── component_contribution_summary.csv
    ├── internal_z1_branch_audit.csv
    ├── target_examples_181079_181002.csv
    ├── analytic_gradient_error_distributions.png
    ├── analytic_gradient_error_distributions.pdf
    ├── run_analytic_gradient_audit.py
    ├── summary.json
    └── artifact_sha256.txt
├── detector-aware-canary-5/
│   ├── REPORT.md
│   ├── summary.json
│   ├── selected_lepton_uncertainty_diagnostics.csv
│   ├── pt_projected_event_metrics.csv
│   ├── REPRODUCIBILITY_CHECK.txt
│   ├── runtime_environment.txt
│   ├── configs/detector_canary_5_cfg.py
│   ├── run_detector_canary_5.sh
│   ├── preflight_canary.py
│   ├── postprocess_canary.py
│   └── cmssw/Stage4/DetectorAwareCanary5/plugins/   # DetectorAwareCanary5Analyzer.cc, BuildFile.xml
├── uncertainty-availability-audit-101/
│   ├── REPORT.md
│   ├── summary.json
│   ├── selected_lepton_availability_404.csv
│   └── source/    # fixed_events_101.txt, prepare_audit.py, postprocess_audit.py,
│                  # uncertainty_availability_audit_101_cfg.py, run_uncertainty_availability_audit_101.sh,
│                  # DetectorAwareCanary5Analyzer.cc, BuildFile.xml
├── pt-projection-sensitivity-101/
│   ├── REPORT.md
│   └── summary.json
├── independent-availability-replication/
│   ├── REPORT.md
│   └── summary.json
├── overlap-diagnostic-416/           # REPORT.md, summary.json, overlap tables and figures
├── ancestry-audit-42/                # report, graph tables, event comparison, hashes and logs
├── mela-interference-101/
│   ├── REPORT.md
│   ├── input_101x4.csv
│   ├── results_101.csv
│   ├── results_101_run2.csv
│   ├── group_summary.csv
│   ├── group_comparison.csv
│   ├── mela_interference_101.cpp
│   ├── prepare_input.py
│   ├── aggregate_results.py
│   ├── compare_runs.py
│   ├── run_all.ps1
│   ├── Dockerfile
│   ├── JHUGenerator.v7.5.6.tar.gz
│   ├── validation.txt
│   ├── reproducibility.txt
│   ├── environment.txt
│   ├── source_provenance.txt
│   └── artifact_sha256.txt
├── detector-aware-3event-benchmark/  # immutable first attempt; partial_score_cap_violation
├── muon-182137-analytic-jacobian-completion-test/
│   ├── PLAN.md
│   ├── REPORT.md
│   ├── compute_summary.json
│   ├── debug_result.json
│   ├── formal_result.json
│   ├── reproduction_result.json
│   ├── score_ledger.jsonl
│   ├── compute_analytic_retry.py
│   ├── render_report.py
│   └── artifact_sha256.txt
├── fixed16-quadratic-ray-audit-stage-p-v2/  # sealed fixed-16 predictions
├── fixed16-quadratic-ray-audit-stage-t-v2/  # sealed fixed-16 exact-ray targets
└── fixed16-quadratic-ray-audit-stage-c-v1/  # fixed paired comparison and integrity closure

10. Limitations


11. Next steps and current interpretation limits

Scientifically valuable next:

  1. The full 42-event generator ancestry audit is now complete (§5m). All 42 EventIDs were traced; no all-mother or Z-copy-collapsed label changed, no ambiguity remained, and the one prespecified recount left the bookkeeping agreement at 59/101. Treat this step as done.
  2. The fixed-101 official JHUGenMELA interference audit is now complete (§5n). It found broad overlap between mismatch and match events and no stable evidence of stronger interference in the mismatch group. Treat the fixed-sample calculation as done. A future extension would require an independently fixed event sample and a separately specified physical observable; do not reinterpret P_A or P_B as probabilities that one pairing is the true history.
  3. Independent seeds and confidence intervals for the toy scans; parent‑boost, spin correlation, background and generator‑systematics extensions.
  4. The analytic local‑boundary denominator is now explained (§5j) — treat that step as done. Within the fractional‑pT metric, ‖∇_u g‖ reduces to the two active candidate masses and the shared‑lepton topology, matched to the saved finite difference and to an exact stored‑mass derivative. A complete detector‑covariance distance remains future work and should not be built from a uniform 1–2% smearing. Section 5o now supplies only a fixed-three-event local hybrid-covariance benchmark. Future work should, in order: - first verify which per‑electron and per‑muon uncertainty or covariance quantities are actually available in the fixed 2012 AODSIM representation; - treat electrons and muons separately; - distinguish a diagonal resolution approximation from a covariance‑aware metric; - validate on an independently fixed sample; - do not call a resolution‑weighted distance a measured pairing‑error probability. A first feasibility step is now done (§5k): a fixed five-event cmsRun canary confirmed the AODSIM carries per-lepton track covariance (20/20 finite, symmetric, positive) and formed a pT-projected uncertainty for 4/5 preselected events. The availability side is now audited more fully (§5l): across the fixed 101 events 236/236 muons and 158/168 electrons carry usable stored uncertainties (91/101 events fully available), the 10 missing electrons were characterized and replicated at 6/248 in an independent file, and a pooled 416-electron overlap diagnostic showed complete categorical seed separation between the two electron kinds. Still not done: an official PF-electron combined-error model (only explicit sensitivity proxies exist, not a recovered official value), a complete covariance-aware distance with the unavailable scale-angle and cross-lepton terms, and validation beyond this one H→ZZ MC dataset — the independent file is same-dataset/different-file, not another process, detector condition, dataset, or real data. The §5o result adds η/φ and available within-lepton covariance for three events, but remains local, hybrid, and adaptively completed. Every §5k–§5l z and flip number remains a local-linear-Gaussian model value, and every §5o distance remains a local sensitivity rather than a measured pairing-error probability. Any cross-seed-path proxy must be treated as an explicit sensitivity model rather than a recovery of the official uncertainty.
  5. The two-event pilot (§5q) and fixed-16 extension (§5r) are now complete. The extension found 14/14 improvements under the mechanically fixed paired rule and retained both NA rows without substitution. Treat this as strong fixed-cohort evidence for the quadratic fixed-ray approximation, not as population calibration. The next informative test is a newly sealed sample from another AODSIM file and preferably another production condition or dataset, using the same metrics and no target-informed replacement. It should test both quadratic improvement and whether the 14/14 positive residual direction reproduces. Do not add events to either completed cohort after seeing its targets.

Do NOT over‑interpret now: do not report 58.4% as physical accuracy; do not call the 42 mismatches confirmed rule errors; do not treat the scan's 60/101 as an improvement; do not call the 120–130 GeV real‑data candidates Higgs events; do not call any of Stages 1–3 experimental sensitivity, discovery significance, or a Higgs re‑discovery.


12. Fact / interpretation / unverified separation