Repository navigation
Lyon audit (#159): Jon's 200-pano review, scores, recall by elevation - #277
Merged
Merged
Conversation
Not a finished review: do not score or quote. verdicts.json is the 2026-10-22T16:47Z export (104 panos); verdicts_backups/ keeps each export as received (38 panos 2026-10-21, 104 panos 2026-10-22). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
verdicts.json is the 2026-10-27T16:34Z export, copied byte for byte; verdicts_backups/ adds it beside the 38- and 104-pano partial exports. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
`lyon_review_159.py elevation` splits the 0.55 recall pool (asserted equal to score.json's recall_055) by degrees below the horizon, level-camera and, with --tilt, after undoing PR #273's per-pano pitch/roll. Within ~24 m recall is 0.31 either way, so most of Lyon's recall deficit is near-field, not far-field. docs/lyon_review_159.md section 10 carries the per-group verdicts, the split, the caveats and the clean-clone reproduce commands. Tests cover the geometry, the band edges, the pool identity and the committed score's byte check. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Pool-wide elevation intervals now keep zero-ramp panos as score does, and cmd_elevation asserts the total interval equals score.json recall_055's. Doc: near-field sentence states the miss shares and that size still matters; tilt recipe notes the unmerged-commit risk; input list completed. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… CI on #277) Lyon's verdicts.json made shared split discovery pick it up, adding a 'lyon' gap row to cascade_cost_35's summary and failing its byte check. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes out the Lyon label audit of #159 (campaign #263, track 2). The bundle and plan merged in #264. This PR adds the review and the reads made from it.
What's here
benchmark/lyon/verdicts.json: Jon's export of 2026-10-27T16:34Z, byte for byte. The 38- and 104-pano partial exports are inverdicts_backups/.analysis_out/lyon_review_159/score.json:score --writeagainst the posted plan (plan_posted: true,partial: false).elevationsubcommand →recall_by_elevation.json(level camera) andrecall_by_elevation_tilt.json(PR Image-based pano tilt estimator: validated on GSV, run on Lyon (#159) #273's per-pano pitch/roll undone). It asserts that its pool equals score.json'srecall_055pool.docs/lyon_review_159.mdsection 10 holds the results, caveats and clean-clone reproduce commands..gitattributespinsanalysis_out/lyon_review_159/**to LF.Results
Replication caveat
The tilt-corrected file needs
analysis_out/pano_tilt/lyon.jsonfrom #273, which is not merged yet. The doc gives thegit show 090cb4f:…recipe, and the file's sha256 is recorded in the output. Everything else re-derives on CPU from committed files. Re-doing the review needs the 200 git-ignored panos, which are pinned inimagery_manifest.jsonand held in the makelab2 run archive.Open for Jon
🤖 Generated with Claude Code — Opus 5.5, claude-opus-5-5