AutoCarto-Agent

Problem

Ask a language model to make a thematic map and it will happily pick a classification scheme, a projection, and a color ramp. It has no way to know whether any of those choices are defensible. Quintile breaks on a zero-inflated distribution, a density calculated in a geographic CRS, a bivariate map of two variables that are not spatially coupled — these are all fluent, plausible, and wrong.

The interesting question is not “can an LLM make a map?” It is: which decisions should an LLM be allowed to make at all? AutoCarto-Agent answers it by drawing an explicit authority boundary. The model handles intent, framing, and language. Every numeric cartographic decision is either prescribed or vetoed by a deterministic gate.

Approach

The architecture is neuro-symbolic: a Propose → Verify → Execute loop where verification is not another model but a set of statistical tests with published thresholds.

The critical design choice is that a gate never merely says no. Every rejection carries a prescription — the exact method and the full-precision break values that would make the proposal correct — and the orchestrator mandates that fix on the next iteration rather than asking the model to guess again. This is enforced structurally: a REJECT result without a prescription raises at construction time.

The six gates

Gate	Question it answers	Statistic
1 — CRS integrity	Is a density or rate about to be computed in degrees?	Equal-area EPSG whitelist per AOI scale
2 — Classification	Does this classification actually fit the distribution?	Goodness of Variance Fit, threshold 0.6
3a — Univariate structure	Is there spatial structure worth mapping?	Moran’s I with permutation test
3b — Bivariate justification	Are these two variables spatially coupled?	Bivariate Moran’s I, 199 permutations, Spearman ρ
4 — Projection distortion	How much does this projection lie at this extent?	Areal and angular distortion
5 — Color accessibility	Is the ramp readable for colorblind viewers?	Simulated dichromacy contrast
6 — Completeness	Does the map have the elements it needs to be read?	Structural checklist

Technical detail — how Gate 2 diagnoses rather than vetoes

Gate 2 characterises the raw distribution shape independently of whatever classification was proposed: well_behaved, zero_inflated, heavy_right_skew, outlier_dominated, discrete_ordinal, or insufficient_variance. Diagnosis dispatch runs before the GVF check, and zero-inflation is tested before skew, because a distribution can trigger both and the more specific diagnosis should win.

Each diagnosis maps to a mandated method — a manual break at zero then Fisher-Jenks on the non-zero tail; a log1p transform with back-transformed breaks; arcsinh where negatives make a log invalid; head-tail breaks for heavy tails; unique-value classification for discrete ordinals. The prescription carries breaks at full precision for the model to transcribe, with a human-readable version rounded to six significant figures so a last-bit float difference across platforms cannot change behaviour.

Thresholds live in a single versioned registry with a rationale attached to each, so changing one is a one-line diff with a citable reason rather than an archaeology exercise through gate source files.

Results

The worked case is tree canopy loss against asthma hospitalisation across 530 census tracts in Fulton and DeKalb counties, Georgia, on real TIGER geometry.

Does the validator actually decide correctly?

A rejection rate on its own means nothing — a gate that rejects everything scores well on it. So the benchmark is a seeded corpus with known ground-truth outcomes, and the headline number is decision correctness, not rejections.

Across 24 scenarios the validator reaches 95.2% strict decision accuracy (20 of 21 scorable scenarios; 3 borderline cases are reported but not scored). It is correct on 14 of 15 pathological scenarios and 6 of 6 benign ones. The overall rejection rate is 62.5%, which is high by construction: four of five Gate-2 regimes and one of three Gate-3b regimes in the corpus are pathological on purpose. That figure is only meaningful quoted alongside the corpus composition, and the committed report embeds it for exactly that reason.

What I would do next, and what is weak

One miss is worth naming: on an independently-generated scenario the bivariate gate approved an encoding it should have rejected — I_xy = +0.1965 at p = 0.005 with Spearman ρ = 0.2398. A statistically significant but substantively weak association passed a threshold tuned for stronger signal. That case is in the committed report rather than filtered out of it.

The threshold sensitivity analysis surfaced a second honest weakness: the heavy_right_skew prescription clears the GVF floor only 82.5% of the time even when applied correctly — the weakest of the five prescriptive regimes.

Next: a formal calibration sweep for the thresholds that are currently conventional rather than swept, and a second prescriptive regime for skewed distributions where the log transform underperforms.

Reproducibility

The core loop runs fully offline and seeded by default — no API key, no network, no Docker. Rerunning the demo reproduces the statistical trace content byte for byte, and the test suite compares against blessed traces committed in the repository.

pip install -e .[dev]
autocarto demo         # deterministic demo → ./output
autocarto benchmark    # rejection-rate report → ./benchmarks
pytest                 # ~215 tests: gates, orchestrator, determinism, security

CI runs on every push across Linux and Windows × Python 3.12 and 3.14, plus a dedicated gVisor security job. The execution sandbox — non-root, no shell, network-isolated — was red-teamed against 27 escape vectors, and air-gapped mode was verified to open zero sockets.

Presented as a poster at the Spatiotemporal Data Science Symposium (STDS) 2026.