Proof

Scored against what actually happened. Misses included.

Every number below was computed after the fact, from independent evidence, without tuning anything to it. Where AURORA is weak, it says so.

Roads under water: forecast against Sentinel-1 radar

Montha, IMD Bulletin No. 21 run. Radar flood maps from the first Sentinel-1 passes after landfall (78 h, 102 h after it) were compared with every road segment AURORA had forecast to close. 3,65,573 segments were observed; 206 showed water.

How to read this

The first Sentinel-1 pass came 78 and 102 hours after landfall, when much of the water had drained, and it found water at only 206 observed road segments. This is a weak test of a landfall-day forecast, and AURORA's false-alarm rate against it is very high.

Flagging the same number of segments, AURORA caught more flooded segments than the lowest-ground baseline (17 against 16) and more than the nearest-to-track baseline (17 against 0).

Skill scores per district and method
DistrictMethodHit rate (POD)False alarms (FAR)CSIHits · misses · false alarms
KakinadaAURORA (≥50% of futures)0.001.000.000 · 8 · 1707
IMD track alone0.751.000.006 · 2 · 11113
Baseline: nearest the track0.001.000.000 · 8 · 1707
Baseline: lowest ground0.131.000.001 · 7 · 1706
KonaseemaAURORA (≥50% of futures)0.710.990.015 · 2 · 904
IMD track alone0.001.000.000 · 7 · 2047
Baseline: nearest the track0.001.000.000 · 7 · 909
Baseline: lowest ground0.001.000.000 · 7 · 909
West GodavariAURORA (≥50% of futures)0.231.000.003 · 10 · 3420
IMD track alone0.461.000.006 · 7 · 9123
Baseline: nearest the track0.001.000.000 · 13 · 3423
Baseline: lowest ground0.081.000.001 · 12 · 3422
East GodavariAURORA (≥50% of futures)0.001.000.000 · 7 · 1496
IMD track alone0.291.000.002 · 5 · 6207
Baseline: nearest the track0.001.000.000 · 7 · 1496
Baseline: lowest ground0.001.000.000 · 7 · 1496
EluruAURORA (≥50% of futures)0.151.000.007 · 40 · 2374
IMD track alone0.281.000.0013 · 34 · 12906
Baseline: nearest the track0.001.000.000 · 47 · 2381
Baseline: lowest ground0.191.000.009 · 38 · 2372
Krishna districtAURORA (≥50% of futures)0.021.000.002 · 122 · 818
IMD track alone0.561.000.0070 · 54 · 18934
Baseline: nearest the track0.011.000.001 · 123 · 819
Baseline: lowest ground0.021.000.003 · 121 · 817

Contains modified Copernicus Sentinel data [2025]

Reading IMD bulletins: Gemini against hand-checked labels

Each bulletin was read on the deployed service. Agreement is field by field with a reading entered by hand from the PDF; those labels are drafts awaiting a second person's confirmation.

Montha · National Bulletin No. 19

16 pages · gemini-3.7-flash · bulletin-v2

48/49

fields agree with the labels; differs: rainfall categories and coverage

  • ✓ passMatches the reading schema (all required fields present)
  • ✓ passPositions inside the North Indian Ocean (11 positions)
  • ✓ passLead times increase (0, 6, 12, 18, 24, 36, 48, 60, 72, 84)
  • ✓ passFix-to-fix speed at most 60 km/h (fastest 16 km/h)
  • ✓ passWinds consistent with the stated category (all rows consistent)
  • ✓ passEvery numeric element has a quote (33/33 covered)
  • ✓ passQuotes found verbatim in the PDF (78/78 found in the text layer)
  • ✓ passTrack and winds match an independent table parser (10/10 table rows matched)
  • – n/a+24 h position within 150 km of the ensemble median (checked when a storm run uses this reading)

Montha · National Bulletin No. 21

17 pages · gemini-3.7-flash · bulletin-v2

48/49

fields agree with the labels; differs: rainfall categories and coverage

  • ✓ passMatches the reading schema (all required fields present)
  • ✓ passPositions inside the North Indian Ocean (11 positions)
  • ✓ passLead times increase (0, 6, 12, 18, 24, 36, 48, 60, 72, 84)
  • ✓ passFix-to-fix speed at most 60 km/h (fastest 16 km/h)
  • ✓ passWinds consistent with the stated category (all rows consistent)
  • ✓ passEvery numeric element has a quote (35/35 covered)
  • ✕ failQuotes found verbatim in the PDF (76/79 found in the text layer)
  • ✓ passTrack and winds match an independent table parser (10/10 table rows matched)
  • – n/a+24 h position within 150 km of the ensemble median (checked when a storm run uses this reading)

Live · IMD National Bulletin No. 4 (2026, BOB/07/2026)

8 pages · gemini-3.7-flash · bulletin-v2

–

no labels (live bulletin)

  • ✓ passMatches the reading schema (all required fields present)
  • ✓ passPositions inside the North Indian Ocean (7 positions)
  • ✓ passLead times increase (0, 6, 12, 18, 24, 36)
  • ✓ passFix-to-fix speed at most 60 km/h (fastest 22 km/h)
  • ✓ passWinds consistent with the stated category (all rows consistent)
  • ✓ passEvery numeric element has a quote (13/13 covered)
  • ✓ passQuotes found verbatim in the PDF (41/41 found in the text layer)
  • – n/aTrack and winds match an independent table parser (no national-bulletin table found)
  • – n/a+24 h position within 150 km of the ensemble median (checked when a storm run uses this reading)

Not validated yet