OpenStreetMap

PlaneMad's diary

Recent diary entries

Talk and workshop: State of validation, State of the Map, Japan

Posted by PlaneMad on 15 August 2017 in English (English)

This Friday, I will be at SOTM in Aizuwakamatsu, Fukushima this weekend talking about the state of validation on OpenStreetMap! I will talk about the need for making a validated error free map with OSM data, the recent efforts of the Mapbox Data team to review OSM changes and what the future of data validation might look like. If you are interested to attend the talk, grab a seat in the main hall at 4:10pm on Friday at the Aizuwakamatsu City Culture Center.

If you are interested in a deep-dive into validating edits in your area on OpenStreetMap, attend Validating the Map workshop conducted by manoharuss on Sunday at 1:30pm in Room-1.

image

Distribution of reviewed and validated changesets using OSMCha in 2017 | View Interactive Map

A dark railway map style

Posted by PlaneMad on 10 August 2017 in English (English)

Always wanted to make a nice railway map style. A well spent 20 mins before bed.

Dark Railway Map

new2

Visualizing Turn Restrictions

Posted by PlaneMad on 10 August 2017 in English (English)

A turn-restriction defines restricted or mandatory turns at a junction and are one of the most important features to map for accurate driving directions. Thought I would quickly make a comparison of how different map data editors visually represent this feature for mappers. Pick the best:

OSM

iD

JOSM

OSM navigation map

Restriction Validator

Comparing GIS and OpenStreetMap data

Posted by PlaneMad on 1 June 2017 in English (English)

Usually when meeting old timer GIS users in academia or government, there are a bunch of questions I get asked about how OSM data fits into the more traditional GIS model where data is organised into shapefiles and layers.

Since I could not really find a simple article which explained the difference, spent a few minutes today to come up with a (possibly) easy to understand benefits table for someone in Government. Its not technically accurate, but could quickly help pitch the idea for opening up more data.

Its still very rough, feel free to contribute any suggestions/improvements that could make this useful.

New MapRoulette challenges: Add missing Wikidata ids to cities and capitals

Posted by PlaneMad on 7 April 2017 in English (English)

Just created a couple of mapping challenges for the Wikidata enthusiasts:

There are over 8,000 important places on the map with neither a Wikipedia or Wikidata tag. These challenges are a great way for mappers interested in Wikidata as well as Wikidata contributors to get started with OSM. Do spread the word in your local communities and share your feedback on how to improve the challenge.

Edits from StreetComplete

Posted by PlaneMad on 5 April 2017 in English (English)

While reviewing edits in my neighbourhood, stumbled on a lot of edits by a new editor called StreetComplete. Streetcomplete seems like an open source map editor on Android to quickly add missing metadata to OSM around your location like streetnames, road surface opening hours etc. using a simple form based UI.

Github: https://github.com/westnordost/StreetComplete

Curious, I listed all the changesets from StreetComplete using osmcha and was surprised to find over 30,000 changesets since the first one in Nov 30 last year. Just yesterday, there was 2,700 changesets uploaded, so there seems to be a sudden surge in editing activity.

The edits in my city were mostly adding the road surface and looked quite good, and its exciting to see such well designed tools driving new contributors to the map. If you are curious use osmcha bbox filter to review edits from StreetComplete in your area and share any observations on the editing activity.

Lets have changeset mentions

Posted by PlaneMad on 3 April 2017 in English (English)

On an average, there are atleast 40 data reverts per day. Most changesets comments are non descriptive like revert previous change making it very hard for the community to track the action and any previous changeset or discussion.

It would be really useful if OSM implemented a changeset mention feature like GitHub, where if I fixed a changeset with a comment Remove duplicate features added in #47398827, it would automatically add a comment to the original changeset and notify the original mapper and anyone in the community know what action was taken. This would greatly improve the social aspect of mapping and link discussions over multiple changesets.

Any other cases where this could be useful?

Interesting lists of changesets by new mappers

Posted by PlaneMad on 31 March 2017 in English (English)

Protecting the map against Pokemon Go mappers

Posted by PlaneMad on 27 March 2017 in English (English)

The Pokemon Go mappers can strike anywhere, converting buildings into parks or pools of water. Check any changeset with 'Pokemon' in the changeset comment using osmcha.

Montauban, France vandalized

Posted by PlaneMad on 23 March 2017 in English (English)

A new user deleted over a 100 features including the place node in the centre of Montauban, a large town in France.

Just reverted both these changesets:

Caught and reverted in 15 hours! A few tools where one can review changesets from new users apart from the history tab:

Location: Villenouvelle, Issanchou, Montauban, Tarn-et-Garonne, Occitania, Metropolitan France, 82000, France

Harare gets a new name

Posted by PlaneMad on 21 March 2017 in English (English)

Yesterday, Paris became a bicycle shop named France and today the Zimbabwe capital Harare became Hwinidi offices. This time the edit was from iD. The Mapbox data team caught this while reviewing edits on https://osmcha.mapbox.com/ around 13 hours after the edit.

Location: Braeside, Harare, 04263, Zimbabwe

Paris is a bicycle shop

Posted by PlaneMad on 20 March 2017 in English (English)

The Paris city node got renamed to France and tagged with shop=bicycle yesterday. This was found and reverted by user:Chetan_Gowda from the Mapbox data team 27 hours later. For some reason the tiles still show a shop, while the name has got fixed.

While inspecting the Paris node, another user seemed to have renamed the French name to Algerie 6 month ago. This was fixed after 4 hours.

Both edits came through Maps.me, but this is just as simple an edit through any other editor. Its surprising no local mappers noticed this.

Location: Beaubourg, St-Merri, 4th Arrondissement, Paris, Ile-de-France, Metropolitan France, 75004, France

Generating a list of all the cities in the world with Wikipedia links

Posted by PlaneMad on 8 March 2017 in English (English)

A small tutorial on how one can export a CSV of all the cities in the world with their associated Wikipedia and Wikidata pages. This is useful if you want to do some spreadsheet analysis of data from OpenStreetMap.

Overpass Turbo is a great way to quickly extract data from OpenStreetMap by querying tags. An easy way to generate the query is to type "city" or the specific tag "place=city" in the wizard. Since most cities are tagged as just a point node, we can remove the query for ways and relations.

Also instead of the default geojson output, you can use the CSV output format and specify the the data columns to export. The end query looks like this:

[out:csv(::type,::id,name,"name:en",wikipedia,wikidata)][timeout:200];

( node["place"="city"] ({{bbox}}); );

Try the live query (takes around 2 minutes to run) | View results

The same query with a geojson output gives the map view

You might also be interested in reading about how one can query a similar list from Wikidata.

Fixing broken riverbanks

Posted by PlaneMad on 24 February 2017 in English (English)

Stumbled upon a dried up Nile on the map, which seems to be a jumble of large multipolygons.

This might require the expertise of an expert with the JOSM relation editor which can be a time consuming process.

It would be great if someone could make a simple howto tutorial for fixing such scenarios to help fix so many other big rivers that are broken this way.

Location: AlSheikh AlYagout, White Nile State, Sudan

Describing Wikidata items with OpenStreetMap tags

Posted by PlaneMad on 23 February 2017 in English (English)

For the curious, the crowdsourced open knowledge database - Wikidata has a property for OpenStreetMap tags that can be used to tag items that describe the same/similar object on the Wikidata database.

It took some time to understand how Wikidata items are described having been used to the more flat OSM tagging model, but we can use a simple example of the popular OSM tag of that is used for any human settlement as a start.

Finding a Wikidata item describing an OSM tag

Any notable topic that exists on Wikipedia will exist as a Wikidata item. Hence any widely used OSM tag should be easy to match to a Wikidata item. For example, cities are one of the most important features of maps, and from the OSM Wiki we know that this feature is described on the map using the Tag:place=city.

If we can find a Wikipedia page that describes the same concept as the OSM tag, we can get the associated Wikidata item from the sidebar links of the page. The Wikidata item for a city is Q515.

Improving Wikidata using OpenStreetMap tags

We can associate the city item Q515 on Wikidata to the OSM tag place=city by adding it as a new property to the item.

new3 Add Tag:place=city as a new OpenStreetMap tag or key property to the item

This will create a link on the Q515 item to the OSM Wiki Tag:place=city page.

Querying Wikidata using OpenStreetMap tags

By adding OSM tags to Wikidata, it is now possible to query Wikidata for all items that are linked to this property.

The query runs live on the Wikidata database using a language called SPARQL, similar to OverpassQL for OpenStreetMap.

Note The above queries only list items that are a direct instance of (P31) a city or town item in Wikidata. Unlike OSM, these items in Wikidata can have a fairly large structure of children items that more specifically describe a type of city. In the future I'm looking to further explore how we can use OSM and WIkidata together for data validation across both projects.

Update The total number of Wikidata items with an OSM tag is currently 964 items - Thanks to Ainali on #wikidata for the query

Finding dragged nodes

Posted by PlaneMad on 17 February 2017 in English (English)

Stumbled upon this mistakenly dragged node thats been hanging around Sheffield for the last two months. Considering its not fixed despite having a highly active mapping community, wonder if some tooling could have helped flagged this to local mappers sooner.

screenshot 2017-02-17 18 33 50

Ideas on how to prevent such edits in future? Any existing QA tools that highlight this?

Location: Stannington, Bradfield CP, Sheffield, Yorkshire and the Humber, England, United Kingdom

Rendering detailed road areas

Posted by PlaneMad on 10 February 2017 in English (English)

There are a couple of proposed tagging schemas for intense mappers to map street areas and road markings to enable a much more detailed road rendering with accurate widths and lanes.

Proposed tagging schema for street areas

Mappers are already active in Poland using this proposal and also have a renderer in place to visualize this with pretty impressive results.

Road area tag rendering from OSM Poland

The next level is going to be having accurate lane marking within the surfaces, but it looks like till date there has been no successful attempt to render roads to such a level of detail. A few weeks ago, Rasagy from Mapbox wrote about styling individual lanes using the Studio tool. The approach uses individual lanes geometries and seem to give good results, but involves a lot of mapping effort.

An attempt to style individual lanes using Mapbox Studio

If anyone is interested to try their hand at styling roads to such level of details, there is a sample intersection that has been traced by Chetan_Gowda and Fa7C0N on the OSM sandbox in Manhattan. If you are using Mapbox Studio, you can directly start styling the data by adding this tileset to a new style. Alternatively, you can use a geojson of the data to use in any other styling tool or to just explore the tags used.

Looking forward to seeing any interesting experimental outputs :)

OSM data in MapMyIndia

Posted by PlaneMad on 10 December 2016 in English (English)

In India, MapMyIndia is one of the biggest aggregators of commercial map data, including running their own fleet of mapping cars, so it was quite interesting to find OSM data in their map for areas i'm familiar with and have mapped on the ground.

new OSM vs MMI

Its not all OSM though, will need to dig more into how they mix the data.

Finding the local experts

Posted by PlaneMad on 6 December 2016 in English (English)

Planning a trip to a remote area and realized it would be really cool to meet other mappers in the region where i'm traveling. Wish there was an easy way to broadcast a message to the top/recent contributors in a location. Right now the easiest way seems to be looking at the the list of top users when editing in iD and sending them message.

Any other tools that could help? Very few users are on any community communication channels here in India.

Experiments with an airport style

Posted by PlaneMad on 23 November 2016 in English (English)

Some late night weekend experiments resulted in this Airport map style.

Runway and taxiway lights

Terminal buildings

Airport boundaries

My laptop seems to heat up a bit trying to render it, but its great to see the detailed results of all the intricate work of the mappers (hooray runway and taxiway areas!). If you update your airport on OSM, you should see the result on the map in a few minutes. My previous experiment with adding runway lights to maps looked like this

PS: Feel free to build on top of the style, you can download this style.json and upload it into Mapbox Studio for a live map.

Location: Indiranagar 1st Stage, Indiranagar, Bengaluru, Bangalore Urban, Karnataka, 560001, India