OpenStreetMap

Open Peer Review Process at Mapbox

Posted by pratikyadav on 20 April 2016 in English. Last updated on 25 April 2016.

As part of the Mapbox Data team, we make sure that our contributions to OpenStreetMap from our mapping projects, through user feedback and support to HOT activations are at par with the OpenStreetMap data quality standards. One of the ways we check data quality is through our weekly manual peer review process.

To be more open towards our QA processes, we are bringing our manual peer review accessible for anyone to participate.

cwe5a3kxiaact3a

The process of manual peer review are as follows:

  • Every Wednesday a new Peer Review Ticket will be opened in our mapping repo with the following information:
  • List of projects the team worked on last week;
  • Link to each member’s edits (in .osm format) extracted using osm-history-processor
  • Instructions on loading data to JOSM.

  • After loading the data for a specific team member in JOSM, we compare the edits to the latest data.
  • We use JOSM filters to see only the edits of a specific team member.
  • We review quality based on the context of the mapping project. Specifically, we look for:
  • proper tags used;
  • geometric accuracy;
  • common mistakes like overlapping way, roads that need splitting, unconnected roads, etc.

  • The reviews are compiled as ticket comments for each team member providing links to changeset/ways/nodes that should be fixed.
  • Each team members will check all reported issues and correct the edit if necessary. In case of disagreements, we use changeset comments to discuss specific edits.

Aside from the manual peer review, we also run daily automated error detection with OSMLint and validation using the Tasking Manager.

We invite the community to take part in the process and improve workflow. Feel free to comment on the peer review ticket to report any quality issues in our edits.

Happy mapping.

Discussion

Log in to leave a comment