MindTopo Logo MindTopo

Key Takeaway: Frontier models can recognize a topological relation in a static scene, but they cannot maintain or operate on it across an action sequence.

MindTopo overview: reasoning and planning tasks across five topological properties — continuity, separation, order, enclosure, and knots.
5 Piagetian primitives
13 Task types
11,016 Instances
11 MLLMs evaluated
54.1% Best model vs. 97.4% human

Yunfei Ge1*, Anbang Liu1*, Qineng Wang1*†, Johnalbert Garnica1*

Jianwen Lyu1, Zihan Wang1, Reuben Tan2, Jianfeng Gao2

Ruohan Zhang1, 3, Yining Hong3, Jiajun Wu3, Manling Li1

*Equal contribution, †Project lead

1Northwestern University, 2Microsoft Research, 3Stanford University

The Benchmark

Topological properties are the spatial properties that survive continuous deformation. A rope can be bent, stretched, or coiled, but whether it is knotted does not change. MindTopo organizes them into five Piagetian primitives and probes each at two cognitive levels — reasoning over a static rendered scene, and planning inside an interactive environment.

Continuity

Is there an unbroken path?

Whether a path or surface forms an unbroken whole — among the earliest spatial concepts a child acquires.

Reasoning
2D Maze, 3D Maze
Planning
Pipe

Separation

One whole, or distinct parts?

The complement of proximity, and the prerequisite for any reasoning beyond an undifferentiated whole.

Reasoning
IKEA
Planning
One Stroke

Order

Which comes before which?

The sequential arrangement of elements along a path, tracked through a transformation of the scene.

Reasoning
Bead, Origami Point
Planning
Swap

Enclosure

What is inside, what is outside?

The inside/outside relation induced by a closed boundary — the Jordan curve theorem, and the holes in a solid.

Reasoning
Sheep, Hole
Planning
Chat Noir

Knots

Truly knotted, or merely tangled?

The "mother structure" that coordinates every other topological relation: crossings, linking, and knotting.

Reasoning
Knots
Planning
Untangle
The 13 MindTopo tasks arranged by topological property and cognitive level, each with a representative rendered scene, question, or gym environment.
All 13 tasks, with a representative scene and question for each. Interactive environments are labelled Gym Env.
MindTopo dataset statistics: 11,016 instances across 13 task types, split 73% reasoning and 27% planning.
11,016 instances, split 73% reasoning and 27% planning. Each of the eight reasoning tasks contributes roughly 1,000 instances; each of the five planning tasks contributes 600. Every task is procedurally generated with controllable difficulty, so the pipelines can produce arbitrarily large datasets.

Leaderboard

Accuracy (%) on the 13 MindTopo tasks, grouped by the five topological properties. Overall, Reasoning and Planning are unweighted means over the 13, 8 and 5 tasks respectively. Every model recognizes topology far better than it acts on it.

Click a column header to sort · scroll the table sideways to see every task

Proprietary models Open-weight models Random chance / human Reasoning task Planning task
Model Summary ContinuitySeparationOrderEnclosureKnots
Overall Reasoning Planning 2D Maze 3D Maze Pipe IKEA One Stroke Bead Origami Point Swap Sheep Hole Chat Noir Knots Untangle
Gemini 3.1 Flash Lite 36.31 50.84 13.06 21.9060.300.0042.470.0066.9736.7012.8061.0055.0025.6062.4026.90
Gemini 3.1 Pro 53.54 60.00 43.20 44.1075.6026.5639.8029.4375.9032.0071.7078.6063.0058.9071.0029.40
GPT-5.4 mini 25.47 35.20 9.90 20.4030.100.0036.240.0059.8621.7315.6029.2557.9826.1026.007.80
GPT-5.5 54.13 57.74 48.33 50.9058.6021.6742.6725.0072.3731.75100.0078.2169.2661.7058.2033.30
InternVL-3.5-241b-a28b 21.78 32.74 4.26 10.8034.501.2017.800.0057.3025.4012.8028.3050.006.7037.800.60
Nemotron Nano 12B v2 VL 21.90 31.63 6.34 18.3025.200.5041.000.6041.5024.5013.9018.0059.701.7024.8015.00
Gemma-4-31b-it 25.50 39.74 2.71 26.5055.807.5018.800.0066.3745.240.0050.3549.900.005.006.06
Qwen3.5-VL-397B 34.94 44.34 19.90 18.7267.770.0039.760.0062.1923.2159.5042.9954.4929.7045.6010.30
Cosmos-Reason2 23.18 30.74 11.10 30.1022.400.0035.742.2056.969.8219.4029.0541.8212.2020.0021.70
BAGEL-7B 17.66 27.80 1.44 7.3033.300.0021.180.0017.4213.690.0034.7357.980.0036.807.20
ThinkMorph-7B 14.83 24.10 0.00 8.2031.100.0021.180.0017.2211.810.0020.0055.890.0027.400.00
Random Chance 9.49 13.27 3.45 11.1222.830.0019.940.008.4310.078.8910.318.411.6715.016.67
Human 97.40 95.77 100.00 97.1898.62100.0094.37100.0095.7791.94100.0099.0697.65100.0091.55100.00

Highlighted cells mark the best evaluated model in that column. Random Chance and Human are reference rows and are excluded from that comparison.

Citation

If you find our work useful in your research, please cite:

@misc{ge2026mindtopo,
      title={MindTopo: Can Foundation Models Reason in Topological Space?},
      author={Yunfei Ge and Anbang Liu and Qineng Wang and Johnalbert Garnica and Jianwen Lyu and Zihan Wang and Reuben Tan and Jianfeng Gao and Ruohan Zhang and Yining Hong and Jiajun Wu and Manling Li},
      year={2026},
      url={https://mind-topo.github.io/},
}