Software ICDAR 2021 maintained

ICDAR 2021 MapSeg Evaluation Tools

Description

Evaluation tools used to score submissions to the ICDAR 2021 MapSeg competition.

The package implements the three metrics described in the competition report:

  1. COCO PQ for building-block detection (Task 1).
  2. Mean intersection-over-union with hierarchical penalty for map-content segmentation (Task 2).
  3. Hausdorff-derived score for graticule line intersection localisation (Task 3).

A reference Python implementation, command-line front-end, and unit tests are provided. The tool is the canonical evaluator used to produce the official leaderboard for the dataset linked above.