Obviously but very importantly:
After comparing Tiger 2017 for 16 US states until now, using shp2cygnus, a tool that I written at Telenav to be able to compare big datasets in a automatic way, to identify roads that are present in the dataset, but not in OSM
After posting on the talk-us, some people told that it would be more useful to run this tool on other datasets, from state or local authorities.
In this article, I want to teach you how to create your own translation file, so that if you have a shp file, you can use Cygnus to compare this with OSM, using this link http://cygnus.improve-osm.org
If you have a shp were the size is bigger then 50*50 km, you can send me a email and I can process it for you.
But you need to learn how to create your own translation file.
So, first step.
We will use as a example Philadelphia
Each city or local authority should have a open data portal.
After a google search for “Philadelphia Open data”, I found this site
Search for either street or road
Click the data-set, and identify the shp, that you need to download
Extract the archive and open the shp into JOSM.
If we look at the tags, we see that they don`t have any connection with what we are used to, like highway=residential, tertiary, etc
To be able to understand how to translate the shp to osm, you need the Street Centerline Metadata
Click Download, and you will see, at least for the Class, what is the highway type.
To see how you can create the translation for osm, you can look here for the OSM highway tags
After doing this, run this script, and then load the output.osm file into JOSM.
python ogr2osm.py -t translation_philadelphia.py –add-timestamp –add-version –positive-id input_shapefile.shp -o output.osm
It will not be perfect, this is after the first try.
Comparing this with osm data I see that I have to much yellow roads (tertiary)
Also, the trunk roads are actually motorway on OSM
We look at the shapefile and identify that Class=4 should be highway=residential, instead of highway=tertiary
We run again the converter
And we get now a more better result, more accurate with what we have in OSM.
If we are happy with the result, we need to save the osm XML file to PBF, so that we can use them with Cygnus.
We do this by installing the pbf plugin in JOSM
Save the file as Pbf
We next go to the http://cygnus.improve-osm.org website, and load the pbf file.
Also, you can select some tags of interest, for me, this was oneway.
In the end you should see something like this
You can download the translation file for Philadelphia from here
Comment from mvexel on 31 October 2017 at 17:37
The Cygnus web interface links to my diary entry that points out these things in big capital letters, but it cannot be stressed enough!