Skip to content

#263 control arm: three GSV-only fine-tunes scored on 14 splits #271

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jonfroehlich merged 6 commits into from
Nov 1, 2026
Merged

#263 control arm: three GSV-only fine-tunes scored on 14 splits #271

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
85c42e1
WIP #263 control arm: scoring launcher (control263_score.slurm), LABE…
jonfroehlich Oct 22, 2026
a885a15
control263_score.slurm: LABEL_PREFIX overridable; usage for the #82 c…
jonfroehlich Oct 22, 2026
b5e1dee
#263 control arm: score three seeds and released on 14 splits, ledger…
jonfroehlich Oct 22, 2026
b94006f
docs index: control_arm_263.md row
jonfroehlich Oct 22, 2026
b83a4a7
#271 review fixes: per-seed 0.55 contrasts, rerun confounds, proposed…
jonfroehlich Oct 22, 2026
69a85da
Merge origin/main into #271 (keep both .gitattributes blocks)
jonfroehlich Oct 31, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .gitattributes
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,10 @@ analysis_out/open_rig_258/** -text
# on #159 and `lyon_review_159.py score` refuses a plan whose bytes differ, and the never-train
# lists are read as LF. Keep git from rewriting their line endings on any checkout.
benchmark/lyon/* -text
# #263 control arm: the caches are byte-compared (determinism) and the reports are compared by
# control_arm_263.py --check, so neither may be re-ended on checkout.
analysis_out/control_arm_263/** -text
docs/control_arm_263.md text eol=lf

# Lyon audit results (#159): written LF and checked byte for byte by lyon_review_159.py.
analysis_out/lyon_review_159/** text eol=lf
22 changes: 22 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -525,3 +525,25 @@ analysis_out/lyon_review_159/**/*.html
!analysis_out/open_rig_258/
analysis_out/open_rig_258/*
!analysis_out/open_rig_258/*.log
# #263 control arm (docs/control_arm_263.md): per-checkpoint extract caches for the released
# checkpoint and the three control seeds on all 14 splits, the #82 controls' bayonne/juneau
# top-up, the scoring logs and both reports. control_arm_263.py --check re-derives the reports.
!analysis_out/control_arm_263/
analysis_out/control_arm_263/*
!analysis_out/control_arm_263/*.json
!analysis_out/control_arm_263/*.md
!analysis_out/control_arm_263/caches/
!analysis_out/control_arm_263/caches_aug82_controls/
analysis_out/control_arm_263/caches/*
analysis_out/control_arm_263/caches_aug82_controls/*
!analysis_out/control_arm_263/caches/*.log
!analysis_out/control_arm_263/caches/*.txt
!analysis_out/control_arm_263/caches/*/
!analysis_out/control_arm_263/caches/*/*.json
!analysis_out/control_arm_263/caches_aug82_controls/*.log
!analysis_out/control_arm_263/caches_aug82_controls/*.txt
!analysis_out/control_arm_263/caches_aug82_controls/*/
!analysis_out/control_arm_263/caches_aug82_controls/*/*.json
!analysis_out/control_arm_263/trainlogs/
analysis_out/control_arm_263/trainlogs/*
!analysis_out/control_arm_263/trainlogs/*.txt
11 changes: 11 additions & 0 deletions analysis_out/compute_log.jsonl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4110,3 +4110,14 @@
{"cluster": "klone", "job_id": "42083469", "job_name": "rampnet_restage263", "user": "jfroehli", "partition": "ckpt", "qos": "ckpt", "state": "FAILED", "submit": "2026-10-20T12:51:57", "start": "2026-10-20T12:52:14", "end": "2026-10-20T14:54:16", "elapsed_s": 7322, "nodes": 1, "gpus": 0, "gpu_type": null, "gpu_hours": 0.0, "exit_code": "1:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-21T04:58:08+00:00"}
{"cluster": "klone", "job_id": "42090420", "job_name": "rampnet_restage_pq263", "user": "jfroehli", "partition": "ckpt", "qos": "ckpt", "state": "REQUEUED", "submit": "2026-10-20T16:29:36", "start": "2026-10-20T16:31:21", "end": "2026-10-20T20:45:20", "elapsed_s": 15239, "nodes": 1, "gpus": 0, "gpu_type": null, "gpu_hours": 0.0, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-21T04:58:08+00:00"}
{"cluster": "klone", "job_id": "42090420", "job_name": "rampnet_restage_pq263", "user": "jfroehli", "partition": "ckpt", "qos": "ckpt", "state": "FAILED", "submit": "2026-10-20T20:45:59", "start": "2026-10-20T20:59:35", "end": "2026-10-20T21:36:56", "elapsed_s": 2241, "nodes": 1, "gpus": 0, "gpu_type": null, "gpu_hours": 0.0, "exit_code": "1:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-21T04:58:08+00:00"}
{"cluster": "klone", "job_id": "42104181", "job_name": "rampnet_ctrl263", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "FAILED", "submit": "2026-10-21T04:26:16", "start": "2026-10-21T07:15:33", "end": "2026-10-21T08:06:24", "elapsed_s": 3051, "nodes": 1, "gpus": 4, "gpu_type": "l40s", "gpu_hours": 3.39, "exit_code": "1:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42104182", "job_name": "rampnet_ctrl263", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "FAILED", "submit": "2026-10-21T04:26:16", "start": "2026-10-21T08:07:25", "end": "2026-10-21T08:08:05", "elapsed_s": 40, "nodes": 1, "gpus": 4, "gpu_type": "l40s", "gpu_hours": 0.0444, "exit_code": "1:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42104183", "job_name": "rampnet_ctrl263", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "FAILED", "submit": "2026-10-21T04:26:16", "start": "2026-10-21T08:09:06", "end": "2026-10-21T08:09:49", "elapsed_s": 43, "nodes": 1, "gpus": 4, "gpu_type": "l40s", "gpu_hours": 0.0478, "exit_code": "1:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42108716", "job_name": "rampnet_ctrl263", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "COMPLETED", "submit": "2026-10-21T08:57:55", "start": "2026-10-21T09:31:38", "end": "2026-10-21T11:52:34", "elapsed_s": 8456, "nodes": 1, "gpus": 4, "gpu_type": "l40s", "gpu_hours": 9.3956, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42108717", "job_name": "rampnet_ctrl263", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "COMPLETED", "submit": "2026-10-21T08:57:55", "start": "2026-10-21T09:31:38", "end": "2026-10-21T11:52:16", "elapsed_s": 8438, "nodes": 1, "gpus": 4, "gpu_type": "l40s", "gpu_hours": 9.3756, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42108718", "job_name": "rampnet_ctrl263", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "COMPLETED", "submit": "2026-10-21T08:57:55", "start": "2026-10-21T11:41:40", "end": "2026-10-21T14:40:48", "elapsed_s": 10748, "nodes": 1, "gpus": 4, "gpu_type": "a40", "gpu_hours": 11.9422, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42152649", "job_name": "control263_score", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "COMPLETED", "submit": "2026-10-22T07:46:25", "start": "2026-10-22T07:48:10", "end": "2026-10-22T08:35:37", "elapsed_s": 2847, "nodes": 1, "gpus": 1, "gpu_type": "a40", "gpu_hours": 0.7908, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42152650", "job_name": "control263_score", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "COMPLETED", "submit": "2026-10-22T07:46:26", "start": "2026-10-22T07:48:10", "end": "2026-10-22T08:36:57", "elapsed_s": 2927, "nodes": 1, "gpus": 1, "gpu_type": "a40", "gpu_hours": 0.8131, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42152651", "job_name": "control263_score", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "COMPLETED", "submit": "2026-10-22T07:46:26", "start": "2026-10-22T07:48:10", "end": "2026-10-22T08:36:57", "elapsed_s": 2927, "nodes": 1, "gpus": 1, "gpu_type": "a40", "gpu_hours": 0.8131, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42152652", "job_name": "control263_score", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "COMPLETED", "submit": "2026-10-22T07:46:26", "start": "2026-10-22T07:48:10", "end": "2026-10-22T08:19:51", "elapsed_s": 1901, "nodes": 1, "gpus": 1, "gpu_type": "l40s", "gpu_hours": 0.5281, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
{"cluster": "klone", "job_id": "42152687", "job_name": "control263_score", "user": "jfroehli", "partition": "ckpt-all", "qos": "ckpt-gpu", "state": "COMPLETED", "submit": "2026-10-22T07:52:31", "start": "2026-10-22T07:53:12", "end": "2026-10-22T08:02:16", "elapsed_s": 544, "nodes": 1, "gpus": 1, "gpu_type": "a40", "gpu_hours": 0.1511, "exit_code": "0:0", "est_cost_usd": 0.0, "rate_usd_per_gpu_hour": 0.0, "rate_as_of": "2026-07-30", "recorded_at": "2026-10-22T15:38:57+00:00"}
1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/annapolis.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/bayonne.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/bend.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/budapest_district5.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/clovis.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/gainesville.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/juneau.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/laurens_gsv.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/laurens_mapillary.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/manual_gold.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/morgantown.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/paterson.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/richmond.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s1/sao_paulo.json
View file
Open in desktop

Large diffs are not rendered by default.

59 changes: 59 additions & 0 deletions analysis_out/control_arm_263/caches/control_s1_extract.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
device=cuda model=control263_control_s1 score_floor=0.05 min_distance=10 tta=False
annapolis: 50/125
annapolis: 100/125
annapolis: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/annapolis.json
bayonne: 50/125
bayonne: 100/125
bayonne: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/bayonne.json
bend: 50/110
bend: 100/110
bend: 110 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/bend.json
budapest_district5: 50/125
budapest_district5: 100/125
budapest_district5: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/budapest_district5.json
clovis: 50/125
clovis: 100/125
clovis: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/clovis.json
gainesville: 50/125
gainesville: 100/125
gainesville: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/gainesville.json
juneau: 50/125
juneau: 100/125
juneau: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/juneau.json
laurens_gsv: 50/86
laurens_gsv: 86 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/laurens_gsv.json
laurens_mapillary: 50/94
laurens_mapillary: 94 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/laurens_mapillary.json
manual_gold: 50/1000
manual_gold: 100/1000
manual_gold: 150/1000
manual_gold: 200/1000
manual_gold: 250/1000
manual_gold: 300/1000
manual_gold: 350/1000
manual_gold: 400/1000
manual_gold: 450/1000
manual_gold: 500/1000
manual_gold: 550/1000
manual_gold: 600/1000
manual_gold: 650/1000
manual_gold: 700/1000
manual_gold: 750/1000
manual_gold: 800/1000
manual_gold: 850/1000
manual_gold: 900/1000
manual_gold: 950/1000
manual_gold: 1000/1000
manual_gold: 1000 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/manual_gold.json
morgantown: 50/125
morgantown: 100/125
morgantown: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/morgantown.json
paterson: 50/125
paterson: 100/125
paterson: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/paterson.json
richmond: 50/124
richmond: 100/124
richmond: 124 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/richmond.json
sao_paulo: 50/125
sao_paulo: 100/125
sao_paulo: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s1/sao_paulo.json
1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/annapolis.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/bayonne.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/bend.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/budapest_district5.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/clovis.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/gainesville.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/juneau.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/laurens_gsv.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/laurens_mapillary.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/manual_gold.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/morgantown.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/paterson.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/richmond.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s2/sao_paulo.json
View file
Open in desktop

Large diffs are not rendered by default.

59 changes: 59 additions & 0 deletions analysis_out/control_arm_263/caches/control_s2_extract.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
device=cuda model=control263_control_s2 score_floor=0.05 min_distance=10 tta=False
annapolis: 50/125
annapolis: 100/125
annapolis: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/annapolis.json
bayonne: 50/125
bayonne: 100/125
bayonne: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/bayonne.json
bend: 50/110
bend: 100/110
bend: 110 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/bend.json
budapest_district5: 50/125
budapest_district5: 100/125
budapest_district5: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/budapest_district5.json
clovis: 50/125
clovis: 100/125
clovis: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/clovis.json
gainesville: 50/125
gainesville: 100/125
gainesville: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/gainesville.json
juneau: 50/125
juneau: 100/125
juneau: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/juneau.json
laurens_gsv: 50/86
laurens_gsv: 86 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/laurens_gsv.json
laurens_mapillary: 50/94
laurens_mapillary: 94 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/laurens_mapillary.json
manual_gold: 50/1000
manual_gold: 100/1000
manual_gold: 150/1000
manual_gold: 200/1000
manual_gold: 250/1000
manual_gold: 300/1000
manual_gold: 350/1000
manual_gold: 400/1000
manual_gold: 450/1000
manual_gold: 500/1000
manual_gold: 550/1000
manual_gold: 600/1000
manual_gold: 650/1000
manual_gold: 700/1000
manual_gold: 750/1000
manual_gold: 800/1000
manual_gold: 850/1000
manual_gold: 900/1000
manual_gold: 950/1000
manual_gold: 1000/1000
manual_gold: 1000 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/manual_gold.json
morgantown: 50/125
morgantown: 100/125
morgantown: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/morgantown.json
paterson: 50/125
paterson: 100/125
paterson: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/paterson.json
richmond: 50/124
richmond: 100/124
richmond: 124 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/richmond.json
sao_paulo: 50/125
sao_paulo: 100/125
sao_paulo: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s2/sao_paulo.json
1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/annapolis.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/bayonne.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/bend.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/budapest_district5.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/clovis.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/gainesville.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/juneau.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/laurens_gsv.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/laurens_mapillary.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/manual_gold.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/morgantown.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/paterson.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/richmond.json
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions analysis_out/control_arm_263/caches/control_s3/sao_paulo.json
View file
Open in desktop

Large diffs are not rendered by default.

59 changes: 59 additions & 0 deletions analysis_out/control_arm_263/caches/control_s3_extract.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
device=cuda model=control263_control_s3 score_floor=0.05 min_distance=10 tta=False
annapolis: 50/125
annapolis: 100/125
annapolis: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/annapolis.json
bayonne: 50/125
bayonne: 100/125
bayonne: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/bayonne.json
bend: 50/110
bend: 100/110
bend: 110 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/bend.json
budapest_district5: 50/125
budapest_district5: 100/125
budapest_district5: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/budapest_district5.json
clovis: 50/125
clovis: 100/125
clovis: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/clovis.json
gainesville: 50/125
gainesville: 100/125
gainesville: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/gainesville.json
juneau: 50/125
juneau: 100/125
juneau: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/juneau.json
laurens_gsv: 50/86
laurens_gsv: 86 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/laurens_gsv.json
laurens_mapillary: 50/94
laurens_mapillary: 94 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/laurens_mapillary.json
manual_gold: 50/1000
manual_gold: 100/1000
manual_gold: 150/1000
manual_gold: 200/1000
manual_gold: 250/1000
manual_gold: 300/1000
manual_gold: 350/1000
manual_gold: 400/1000
manual_gold: 450/1000
manual_gold: 500/1000
manual_gold: 550/1000
manual_gold: 600/1000
manual_gold: 650/1000
manual_gold: 700/1000
manual_gold: 750/1000
manual_gold: 800/1000
manual_gold: 850/1000
manual_gold: 900/1000
manual_gold: 950/1000
manual_gold: 1000/1000
manual_gold: 1000 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/manual_gold.json
morgantown: 50/125
morgantown: 100/125
morgantown: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/morgantown.json
paterson: 50/125
paterson: 100/125
paterson: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/paterson.json
richmond: 50/124
richmond: 100/124
richmond: 124 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/richmond.json
sao_paulo: 50/125
sao_paulo: 100/125
sao_paulo: 125 panos -> /mmfs1/gscratch/scrubbed/jfroehli/control263/RampNet_score/analysis_out/control_arm_263/caches/control_s3/sao_paulo.json
28 changes: 28 additions & 0 deletions analysis_out/control_arm_263/caches/driver.log
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
=== control263 scoring (job 42152649) 2026-10-22T07:48:23-07:00 host g3046 repo commit 85c42e11
=== control263 scoring (job 42152652) 2026-10-22T07:48:23-07:00 host g3111 repo commit 85c42e11
python: /scr/jfroehli/ctrl263score_42152649_0/sidewalkcv2/bin/python (torch 2.6.0 timm 1.0.28)
gpu: NVIDIA A40, 0 MiB, 46068 MiB
splits: annapolis,bayonne,bend,budapest_district5,clovis,gainesville,juneau,laurens_gsv,laurens_mapillary,manual_gold,morgantown,paterson,richmond,sao_paulo
--- released: Hub projectsidewalk/rampnet-model (no --checkpoint)
python: /scr/jfroehli/ctrl263score_42152652_0/sidewalkcv2/bin/python (torch 2.6.0 timm 1.0.28)
gpu: NVIDIA L40S, 0 MiB, 46068 MiB
splits: annapolis,bayonne,bend,budapest_district5,clovis,gainesville,juneau,laurens_gsv,laurens_mapillary,manual_gold,morgantown,paterson,richmond,sao_paulo
--- control_s3: /gscratch/makelab/jonf/control263/control_s3.pth sha256 cabd583033f4438c
=== control263 scoring (job 42152651) 2026-10-22T07:48:26-07:00 host g3077 repo commit 85c42e11
=== control263 scoring (job 42152650) 2026-10-22T07:48:26-07:00 host g3077 repo commit 85c42e11
python: /scr/jfroehli/ctrl263score_42152651_0/sidewalkcv2/bin/python (torch 2.6.0 timm 1.0.28)
gpu: NVIDIA A40, 0 MiB, 46068 MiB
splits: annapolis,bayonne,bend,budapest_district5,clovis,gainesville,juneau,laurens_gsv,laurens_mapillary,manual_gold,morgantown,paterson,richmond,sao_paulo
python: /scr/jfroehli/ctrl263score_42152650_0/sidewalkcv2/bin/python (torch 2.6.0 timm 1.0.28)
gpu: NVIDIA A40, 0 MiB, 46068 MiB
splits: annapolis,bayonne,bend,budapest_district5,clovis,gainesville,juneau,laurens_gsv,laurens_mapillary,manual_gold,morgantown,paterson,richmond,sao_paulo
--- control_s2: /gscratch/makelab/jonf/control263/control_s2.pth sha256 bbb353f39bd65c09
--- control_s1: /gscratch/makelab/jonf/control263/control_s1.pth sha256 7c6f4920a5e34f32
--- control_s3 exit=0 splits=14 elapsed=1880s
=== done 2026-10-22T08:19:46-07:00 status=0
--- released exit=0 splits=14 elapsed=2828s
=== done 2026-10-22T08:35:34-07:00 status=0
--- control_s1 exit=0 splits=14 elapsed=2902s
=== done 2026-10-22T08:36:52-07:00 status=0
--- control_s2 exit=0 splits=14 elapsed=2904s
=== done 2026-10-22T08:36:54-07:00 status=0
Loading
Loading