OpenStreetMap

Diary Entries in English

Recent diary entries

This is good !

Posted by jimko7 on 1 August 2015 in English (English)

Just started using this, mainly because my NEXUS 7 only has GPS and WiFi, and I needed an offline map for Venezuela. Now I am editing my part of Caracas ! Awesome work here, glad to be part of this...

Improving the OSM map - why don't we? [8]

Posted by marczoutendijk on 1 August 2015 in English (English)

Where do we leave our Garbage?

Taginfo is a great tool to see where and how a given key is used on the map. It also gives you some nicely formatted tables with statistical data of all the tags (a tag is a key=value pair).
Did you know that the most used key is source=*?
On 25 july 2015 it appeared 162.428.193 times with a total of 143.491 different values. You can find the most common tags here.

But I was more interested in keys that appear just once in the database, because I expected many of those "solo" keys to be erroneous. To find that out, I downloaded the taginfo database (there is a link on the taginfo page to do precisely that). Be warned: after downloading and expanding that database, you have a 5 Gb file in Sqlite format to handle! But doing so, I could do my research with more details and faster than using the tools on the taginfo site. I opened it in my Sqlite client and after 10 minutes: I had 74.569.089 records on my computer to research!
For every record in the database you have numerous tables with information available, one of them gives the information of all the keys that are in the database:
and this helped me to find what I was looking for: the count_all field.
Below is this "keys" table with the first 20 entries: The count_all field is the one I needed and after the necessary code I produced a table with all the keys that appeared once (had a value of count_all=1).
Here is the beginning of that table, after I sorted it (well, my computer was so kind to do it for me!). Rather weird names for a key, don't you think? What would "+++" denote? Or "129/"?
The first entry (source:name) starts with a space character! If you enter that string (or any of the others) into the search field of taginfo, you can get all the details about that key: its value, how many times used (1) and where it is used if you click on the tab "map". You can also click on the overpass link to see its precise location.
So, for that first entry I did all that and it turned out to be this: somewhere down-under in Australia. Try it for yourself!

Keys in a database are not supposed to start with a space character, but the OSM database accepts anything and does not do any check on what you enter, save for the length (max 255). Also keys are supposed to contain alphabetic characters and may contain digits as well. Some special characters are allowed also, like e.g: "_" and "-".
But a key with just numbers? What is that? Let's see for 09200: It seems to be the postal code for a village in France. But then it should have been:
addr:postcode=09200
addr:city=Montégut-en-Couserans

A lot of the (faulty) keys I found are of the uppercase/lowercase type:
Name when name was meant for instance. Almost any regular key (amenity, shop, tourism, highway, landuse etc) appears in a misspelled version in the database (tourims, land-use etc). Also added interpunction (name; or name, or name-) counts for quiet a number of those one-time-only keys.
All in all 19.037 keys appear only one time in the database and out of a total of 54.382 keys, that is more than a third!

Not all of those keys are "wrong", but too many of them are, and will never be used again.
Is that a problem? Not really I think. It does not consume very much of disk/memory space, certainly not if we compare that to the huge amount of data that is also in the database. But sometimes it leads to unexpected results with software that consults the database.
So, the answer to "Where do we leave our Garbage" is: just where it is.
But if you ever come accross such a situation, please correct it and remove what is not necessary or redundant.

Long-standing cycleway rerouting

Posted by MMN-o on 1 August 2015 in English (English)

Along Umeälven there is a cycleway which was broken off some years ago due to constructions of new buildings. There's also a waterway=stream there that has peaked my interest earlier due to a totally failed urban exploration adventure. The stream begins on the other side of Botniabanan and comes out towards Umeälven.

It was a long time ago this new way route was built and it really feels good to write it off from my checklist of "things I should probably do sometime".

Location: Öst på stan, Centrala staden, Umeå, Västerbottens län, Norrland, Sweden

Knowledge on Open Street Map

Posted by Lyndon Centinales on 1 August 2015 in English (English)
         I have fun mapping even though I cannot see the place because of the clouds covering the place. But I put some notes and comments about my mappings.

        This is a good tool which is very useful in plotting places and the institutions around the place. It makes us knowledgeable on how to make an accurate details on the place. This mapping is very useful on different purpose especially during calamities. 
Location: D 247, Schaffhouse-près-Seltz, Haguenau-Wissembourg, Bas-Rhin, Alsace, Metropolitan France, 67470, France

Getting To Know Openstreetmap

Posted by Mike Gil Kim on 1 August 2015 in English (English)

I had fun this day mapping my location. Locate my own house and start a new trace? Yeah, it's funny but cool thing to trace roads and some unknown streets. Maybe this could help somehow :) :) smile and :)

Then...and now!

Posted by mvexel on 1 August 2015 in English (English)

OpenStreetMap in 2007 and today...

thenandnow

First experience in editing mapping my house

Posted by cute78 on 31 July 2015 in English (English)

Today is the day that I put my house in the map using this sites. This is really great! cool experience.

open street map

Posted by echay on 31 July 2015 in English (English)

having fun mapping my place this time..
:)

ToDo

Posted by revi^ on 31 July 2015 in English (English)
  • Change Korean (English) style nodes to use proper properties (not sure if this is correct term)
  • Change zipcode (5 digits since 2015-08-01)

private bookmarks on new lane marking for complex layouts and junctions

Posted by Govanus on 30 July 2015 in English (English)

Mapping turn lanes in OpensStreetMap

Posted by andygol on 30 July 2015 in English (English)

Hi, folks!

I want to share with you my blog post about mapping turn lanes

If you have any suggestions, you can write it here in comments


Mapping turn lanes in OpensStreetMap

Complex intersections often involve lane-specific turn restrictions. See for instance these overhead signs on Utah State Route 92, crossing Interstate 15 just south of Salt Lake City.

turn lanes sign

Lane signage on Utah State Route 92. Photo: Garrett.

We need turn restrictions for every individual lane to provide precise directions for drivers. In OpenStreetMap we model turn lane information with two tagging schemes:

Here is a guide on how to map turn lanes with OpenStreetMap's JOSM editor. Note that type=turnlanes:turns is a proposed feature. You can join the proposal process by submitting your review on the relevant talk page.

Mapping Turn Lanes

First, install the turn lane plugin directly from JOSM's settings panel. It provides support for both Key:turn tags and type=turnlanes:turns relations.

As an example, let's look at how to map turn lanes in detail on this intersection alongside US 101 in South San Francisco.

image

Lane-specific turn restrictions along US 101 Exit 425B.

Enable the "Turn Lanes" panel in the "Windows" menu.

josm_open_turnlanes_dialog

Identify the number of lanes on all the roads leading to and from the junction.

image

Add the number of lanes to the appropriate ways as a regular tag - for example, lanes=2.

image

Split the ways that will be parts of relations. Then, for each turn lane restriction, select the nodes and ways involved to define a rule. You should see the junction modeled as shown once the lane count for all the roads have been set.

josm_open_turnlanes_construct_junction

Let's start with the motorway link from US 101 leading into the junction.

exit_to=Oyster Point Boulevard; highway=motorway_junction; ref=425B

Initially this way has one lane which splits into three before the junction. At 141 meters before the junction, add the left lane. At 92 meters, add the lane on the right side. These lanes can be added by clicking the white plus button and setting the start position by dragging the blue marker back from the junction.

josm_open_turnlanes_add_side_lanes

Add a lane to turn left for a small section of Dubuque Avenue. You can pan the model by dragging with the right mouse button.

josm_open_turnlanes_add_side_lane

Now create rules for the thoroughfare from motorway junction #425B with rules for each lane by dragging a route across the relevant junctions and lanes.

josm_open_turnlanes_add_turn_ruls

Add similar rules for all directions where applicable.

Now let's check our work by selecting nodes and reviewing traffic flow. To cycle through all directions press Ctrl+A for an overview of all restrictions on the junction.

josm_open_turnlanes_check_in_out

I hope you find these instructions useful to map detailed junctions in your area. If you have any questions or ideas on mapping turn lanes, drop me a line on Twitter or through my OpenStreetMap profile.

Header photo: Interstate 10 and Interstate 17 Interchange at Night by Alan Stark

Location: Veterans Blvd, South San Francisco, San Mateo County, California, 94080, United States of America

CanVec Import for 085F05 (Fort Providence NWT)

Posted by JamesBadger_CanVecImport on 29 July 2015 in English (English)

I am working on improving the data availability for some of the major northern Canadian arctic communities, as improving this data in OpenStreetMap will also improve the Arctic Web Map project that is using OSM data.

I have downloaded the shapefiles from NRCan and I used ogr2ogr to convert them from EPSG:4140 to EPSG:4326. Then I am importing them a layer at a time using JOSM. I am using the CanVec Feature Catalogue and OSM CanVec Feature Guide for mapping values.

For the vegetation layer "085f05_11_0_VE_1240019_2" (Wooded area classified — polygons) I imported the shapefile into QGIS and used a dissolve operation to combine all the polygons. Then a Douglas generalize filter with a tolerance of 0.0001 was applied to remove redundant vertices. This reduced the vertex count from 363,000 to 40,000. Next I opened that shapefile in JOSM and changed the tags to natural=wood and manually merged the polygons with identical polygons in the neighbouring imported tiles.

I will continue importing one layer at a time until this NTS tile is complete.

Location: Loop A, Northwest Territories, Canada

Mapping Mexico with INEGI, you and...Cygnus

Posted by mvexel on 29 July 2015 in English (English)

Mexico released a huge amount of open data not too long ago.

Huge: Mexico's statistical institute INEGI goes open data @INEGI_INFORMA (via @rodowi — Alex Barth (@lxbarth)

A lot of this data is geospatial, so I say yummie! Alex Barth wrote about this data, that comes from the Mexican national statistical agency INEGI, on his diary before, with a nifty map to show how rich this data is:

inegi-mapbox

(My mediocre animated GIF skills really don't do it justice - check out Alex's blog post to see an interactive map.)

So now the question becomes: how do we get some (or all?) of this data into OSM? This is not straightforward - OSM already has rich data in many places in Mexico we would definitely want to keep.

Here at the Telenav OSM team, we have come up with an answer to this question. We call it Cygnus - The Bringer of Balance. Let me explain in a few visuals what Cygnus does.

Consider this area in the Aguascalientes region. There is some OSM data there:

base osm

If we look at the Bing aerial images, we can clearly see that there's an entire village there that is not mapped though!

base osm with bing

But INEGI has most if not all the roads in this village in their now open dataset Conjunto de Datos Vectoriales de Carreteras y Vialidades Urbanas.

After converting the original data attributes mapped to OSM-appropriate tagging, saving the result as an OSM file, and loading it into JOSM, it looks like this:

cygnus-osm-cvu

OK, that is nice, but we still have two separate layers that are unconnected, and even if we merge them, we will still have to manually resolve duplicate ways and connections between the ways from OSM and those from the INEGI data.

This is where Cygnus comes in - a new conflation technology we developed at Telenav specifically to tackle this.

Cygnus, as the Bringer of Balance, takes as its input a base OSM file in PBF format, as well as what we call an 'enhancing' file, also in PBF format. It will then compare and conflate the two inputs and output one JOSM XML file that can be merged with OSM base data straight away. This detail shows the merged layers with all the INEGI 'imported' ways connected to the pre-existing OSM way:

cygnus merged

Even though Cygnus does a pretty amazing job merging OSM data with an 'enhancing' layer, you will still need to check the result before you upload. Take this example here:

cygnus miss

The highway=secondary was the pre-existing OSM data, and the highway=residential; oneway=yes came from INEGI data. It is clear from Bing imagery that the two ways should be connected, yet they are not. Cygnus has a (tweakable) distance threshold it uses when it decides if two ways should be connected or not. In this case, the INEGI way was too far away, so it remained disconnected.

There are a few other things to consider when you work with a Cygnus-produced change file:

  • Cygnus will never degrade existing OSM data
  • When both OSM and the enhancing layer have the same way, Cygnus will always keep the original OSM geometry, but it will optionally import name and other useful tags.

We are currently working on an import plan for INEGI data that will make heavy use of this new technology. More about this very soon! In the mean time, watch our SOTM US talk on the INEGI data and OSM in Mexico.

Restoring measurements from crashed database of Tower Collector

Posted by Kolesár on 29 July 2015 in English (English)

I'm an OpenCellID contributor. I use Tower Collector application on Android phones for recording cell data. I have recorded data for more than 500,000 locations.

One day one of my phones has shut down on a trip after 80 kilometers which I will never do again. I have checked Locus where the tracklog stopped: a few kilometers behind. Started Tower Collector, it showed zero locations! Oh my god. I had another trip previous day which was not uploaded yet.

This device was rooted, started root browser, checked the application's data directory:

    /data/data/info.zamojski.soft.towercollector

In directory "databases" I have seen an empty measurements.db (a few kB), but there was another file: measurements.db.back with 600 kB! Made a backup copy of the whole directory and resumed my route.

At home I have checked the db. It is an sqlite database, but has been corrupted.

    sqlite> pragma integrity_check;
    Error: database disk image is malformed

I have made a dump of the database:

    echo .dump | sqlite3 measurements.db.back > measurements.sql

There were 2059 measurements for 76 cells, valuable data. How to restore them? Load back to Tower Collector. I did not have time for that for weeks, but continued collecting new data. I was frustrated because this phone did not remember the cells collected before the crash, displayed a most of cells as new. I have also missed the data from that two trips. Some weeks later I have tried to load data.

At first I have created a new database using the recovered data but I have failed many times. I replaced measurements.db with the new one, app crashed (SQLiteCantOpenDatabaseException). Checked directory and file permissions via Root Browser, it showed root as owner of every file, but later I have checked the same thing via adb and it showed totally different owners: every app has a userid and owner should be set correctly.

After setting owner for the database, I had another kind of crash: Tower Collector said "upgrading database" and crashed again. Stack trace had an SQL statement: "CREATE TABLE cells" which failed because cells table already existed. Why does it upgrade? I did not see any difference in schema of old and current database.

Then I started a different way. Prepared only data from the dump: kept only INSERT statements for the following tables:

    INSERT INTO "measurements" ...
    INSERT INTO "cells_archive" ...
    INSERT INTO "cells" ...

Uploaded this file via adb:

    adb push inserts.sql /data/data/info.zamojski.soft.towercollector/databases/inserts.sql

Then restored the last working measurements.db and logged in via adb:

    $ adb shell
    ~ # cd /data/data/info.zamojski.soft.towercollector/databases
    # sqlite3 measurements.db

Here I had an almost empty database, only cells_archive table had 1227 rows. I have truncated this to make history clean:

    # DELETE FROM cells_archive;

Then I imported the SQL file just uploaded:

    # .read inserts.sql

Logged out and tested: app displayed 2059 measurements for 76 cells. Quickly uploaded to OpenCellID and checked newly uploaded measurements there.

Then I merged the new cells captured since the failure. Dumped cells_archive from the previously backed up version of measurements.db, replaced table name "cells_archive" to "cells", loaded into the database using the same way and then deleted them. This database has a trigger which archives rows deleted from table "cells" to "cells_archive" ignoring duplicates.

I had seen 6176 cells before the crash. Since then there were 1227 new, merging resulted 6793 cells, 617 new. The rest were duplicates.

The last step was setting total number of locations to the sum measurements before and after crash:

UPDATE stats SET total_locations = 156440+29641 WHERE row_id=1;

Now I have a database which knows all cells and number of locations since I have started collecting data. I am happy.

Location: Ürögi út, Nagyberény, Siófoki kistérség, Somogy megye, Southern Transdanubia, Transdanubia, 8656, Hungary

Extracting regions from planet.osm ?

Posted by adaviel on 28 July 2015 in English (English)

I've been using Merkaartor on LInux for some years. Usually I import a track, zoom in, then use "download more" to download OSM for that region. But there's a 50,000 item limit, so if I'm not zoomed in far enough, it fails.

Years ago I had read that I could get planet.osm as a default start set, but I never did. Now, when I look, it's huge. Merkaartor can't handle that, at least not with the amount of RAM I have. It can't even handle all of Canada without swapping.

I see that the US is split into states, but all of Canada is one big file. Is there any easy way, preferably command-line on Linux, that would let me split out a region from the Canada OSM - one province, or a smaller area ?

Improving the OSM map - why don't we? [7]

Posted by marczoutendijk on 28 July 2015 in English (English)

How do we deal with multiple values for a key?

We all know this situation: you need to add a telephone number to a node and add the line:
phone=00311198765432
Then you find out that there is a second phone number for that node, but you can't add a second phone= tag because OSM doesn't allow that.
The general question is: how do I tag multiple values for one key?
Let's investigate how mappers have solved that problem sofar. The screenshots all are made with OpenPoiMap.


[1.]
This example is the Eiffel tower in Paris for which four architects worked together, but only one gave his name to the final product!
In the source the names are separated with semicolons:
Stephen Sauvestre;Gustave Eiffel;Maurice Koechlin;Émile Nouguier


[2.] One piece of art created by 5 artists (somewhere in Seattle).
Create a new key with a sequential number attached to it for every member of this group. In this specific case I would have started numbering with artist_number_2 because the first one is already in artist_name. Even better, I would have started with artist_name_1 and used it for Andrew Keating and would have omitted artist_name altogether.


[3.] This example is to show how to map multiple sets of related tags to one node. In this case we have man_made=mast which has attached to it 4 (mobile phone) antennas at different heigth and each working with a different technology.
An underscore could have been used as in the previous example, but there seems to be a tendency to tag situations like this with a key:N notation, where N is running over the natural numbers.


[4.] Here we see a combination of both methods. Adding a number (with underscore) at the end of the key to count them or adding the number after the colon. Again, in the case of the fuel I would have started with fuel:diesel:1 for the Biosolar.

Any different opinions on this subject?

All GPS-tracks in an area?

Posted by geoeki on 28 July 2015 in English (English)

Hi there,

is there somehow a possibility to visualize all GPS-tracks that were gethered for the same area? For example I use JOSM, I define my area of interest and for that specific AoI I want to fetch all available GPS-tracks. Hope that was clear!

Thanks!

Location: Alservorstadt, Alsergrund, Vienna, 1090, Austria

Removing phone booths in Belgium

Posted by M!dgard on 28 July 2015 in English (English)

Update: The mechanical edit described in this diary entry has been discussed on the Belgian mailing list. You should never do an edit like this without prior consultation with and consent of the relevant community/communities. Also make sure to read the Automated Edits code of conduct if you plan on making an automated edit. OpenStreetMap is generally not welcoming those, even when they follow all rules.

All Belgacom/Proximus telephone booths in Belgium are removed from the streets. With changeset #32926155 those that had operator=Belgacom or Proximus have also been removed from OSM.

The remaining phone booths before their removal. Most of them are near Brussels.

I used the following Overpass query:

/* Find all Belgacom/Proximus phone booths in bbox */
(
  node[amenity=telephone][operator~"[Bb]elgacom|[Pp]roximus"]({{bbox}});
  <;
  >;
);

out meta qt;

This fetched all phone booths and also any ways they are connected to. No relations were matched, which was good. Then, in JOSM, I did the following searches to obtain phone booths that are member of a way:

  • type:way (no phone booths were tagged as ways)
  • amenity=telephone child selected

I removed all tags on those 4 nodes.

Then I searched all remaining amenity=telephones and removed the nodes.

Some stats:

  • There were 320 Belgacom/Proximus phone booths left in OSM in Belgium.
  • 316 had operator=Belgacom, 2 belgacom and 2 Belgacom NV
  • 3 phone booths had covered=yes, 1 had covered=no.

Note that at the time of writing there are still 320 other amenity=telephones left in Belgium. (Exactely the same number as I removed!) They haven't been tagged with operator=Belgacom and should be manually surveyed and removed if necessary.

You are invited to add a note like verified that this phone still exists 2015-07-28 to any phones that you have surveyed, to prevent mappers from armchair-mapping them away. (They shouldn't, but just to be sure.) An operator tag is appreciated as well.

Search for amenity=telephones in Belgium

/* Find all phone booths in Belgium */
area["name:en"="Belgium"]->.belgium;
(
  node(area.belgium)[amenity=telephone];
);

out qt;

Starting up again

Posted by Mapping49er on 26 July 2015 in English (English)

Two things got me back into mapping. One I am thinking of retiring and this will give me a lot more time to do it. And two we recently acquired a puppy dog (A Coton de Tulear) that needs taking for walks so I have been exploring local pathways to use for said walks. In any event I have also been a fairly regular user of an iphone/ipad app called Galileo for quite some time now and I love maps.

I realised that it must be well over a year since I looked at doing any mapping. JOSM is not on my current computer (replaced 18 months ago). I do however have loads of photos, routes and speech commentaries that I have meant to use in doing map updates. Always happens when I am on holiday and I never got time to apply them on my return. Places like Ireland, San Francisco, Athens, Sidney, Queensland and Singapore are obviously all the poorer for not having my map updates applied onto OSM!

So first step was to downloaded JOSM which I did yesterday 25/07/15. Some quick reading on how to use - somehow seems easier this time round and then off on a long walk to gather some data. This is an enjoyable and healthy way to do mapping. I like walking and exploring with a purpose and actually find it very relaxing. However the battery on my iphone ran out half way through so I will need to revisit some of the walk. Not too unhappy about that either! I specifically wanted to correct one of the local footpaths which is incorrectly shown on OSM and unfortunately my battery had run out before I got to the relevant bit.

As a result of the above walk however I did work out how to upload traces in .GPX format to OSM. Been meaning to do that for ages and I have a lot of traces to upload. Additionally when using the photos I took on this walk for a location fix I discovered that it did not match with what JOSM was saying. On reading up it seems that I need a plug in to correct this . It appears to work out the correct offset for you when you position objects on your map to line up with the imagery. I haven't tried it yet.

I then started doing some updates - simple things like house numbering - automatic allocation can't handle infills such as the three houses behind ours which all have the same number but designated A B and C to give them unique addresses. Occurred to me that just getting my local town (pop. 6200) up to scratch is a considerable amount of work. I also did some research on data sources for this exercise such as .gml files from the Land registry (another plug in I believe) and a uk post code map. I failed completely after some hours researching in getting what is said to be freely available post code amps as a layer to use on my maps.

So as a result of all this my list of things to follow up got bigger and bigger - am I looking at taking on an unpaid full time job. :) List is :

• Get offset on Bing maps sorted out.
• Get plug in to handle .gml files available from land registry (INSPIRE index polygon data.)
• Work out how to get more layers such as electoral boundaries , district council boundaries etc.
• Work out how use tags better (a lot of reading) - such as how to represent a house barge (I live on a river)
• Look at a tags for entering statistical information freely available from the Office of national statistics such census date.
• Start looking at writing code to help with some of the above - I have an IT background but promotion has meant not doing any coding for quite some time and I miss it!
• Find out about adding photos to the map
• Find someone (preferably local) who I can chat / work with on this.

No doubt this list will keep getting bigger!

Location: Burnham-on-Crouch CP, Maldon, Essex, East of England, England, United Kingdom

Post-Boxes

Posted by Stuart H 42 on 26 July 2015 in English (English)

Added a few post-boxes recently. Roberts postbox site is excellent for finding postboxes that are not yet mapped. Its unusual to know what you don't know. Learning a bit more about the appropriate tags too.

Then hopefully I'll get back to walking around and adding a few more footpaths. I wonder what other people think the OSM lacks that makes a OS map more useful - and if its something we could add easily. I think the OS will win for walking in the wilds guided only be a map and compass; but OSM should win for towns; and should be as good if GPS guided. Thoughts?

Older Entries | Newer Entries