Recent diary entries
Am seeking names for three monuments in Ashgabat traffic circles that do not appear to have name plaques. The traffic circles at the intersections of Atamyrat Nyyazow and Gorogly, Ataturk and 10 yyl Abadancylyk, and Galkynys and Beyik Saparmyrat Turkmenbasy are unidentified...but they must have names! I think I've identified all other monuments located in traffic circles in this city.
After the usual Saturday grocery shopping (at the newly reopened supermarket in the Bagtyyarlyk shopping center, which was closed for months for unknown reasons), I collected the names of the last monuments in traffic circles along Dowletmamed Andalyb kocesi for which no names had yet been collected. All the monuments are now named in OSM! They are (the occasional descriptions below come from the local newspaper):
Andalyb and ... Hoja Ahmet Ýasawy: Šahyr binasy (Poet's Monument) // 18 meters tall, depicts a blossom inside of which are an ink well and giant quill pen, symbols of poetic inspiration ... Aga Berdiýew: Döredjilik binasy (Creativity Monument) // 20 meters tall, symbolic tongues of flame, 30 meters in diameter. ... Magtymguly: Erkanalyk binasy (Open Spaces Monument) ... Görogly: Alaw binasy (Flame Monument) // three steel columns reaching upwards in the shape of flames, representing a communal hearth, prosperity and sufficiency, evincing the Turkmen people's deep respect for "dastarhan", the tablecloth of abundance ... Galkynyş: Öşüş binasy (Development Monument) ... Atamyrat Nyýazow: Jebeslik binasy (Solidarity Monument) ... Oguzhan: Dowamat binasy (Constance Monument) // Spherical construction of six columns in the shape of the moon, symbolizing the six sons of Oguz Han. ... Ýunus Emre: Ebedilik binasy (Eternity Monument) ... 10 ýyl Abadançylyk: Zemin binasy (Earth Monument)
Spent part of a lazy Saturday morning checking out map notes left by other mappers in Ashgabat, editing corrections into the map based on a) their suggestions, b) my verifications from ground truth.
So I found the ruins of another sawmill in a forest. OK I had known about it for some time, though I was not sure it was much left or not. On an old map from the 40s (Ekonomiska kartan) it was visible and on an orienteering map from the 80s it was marked as a ruin. So I figured there might be something interesting there.
On my last mtb tour I went to look for it. I started to look for the path that was supposed to be through the forest. This turned out to be a mistake. There were note many signs of any path and I more or less had to carry my bike through parts of the forest. When I reached the water I finally saw an old path. I started to cycle on it, but after perhaps 50 meters it disappered again. Then the terrain got worse; wet mud combined with high grass with old dead trees on the ground. I was about to give up several times but always thought that if I would have given up, the whole thing would be for nothing. So I kept going.
Finally the ground became smoother and I found myself on an old road of sorts. And after a few meters I saw a pile of old broken bricks. Then I saw concrete foundations sticking out among the trees; I had found it! There were not much apart from the concrete foundations. And since there were so many mosquitoes trying to feed on me I did not want to stay for too long. I wanted to search for any old railway tracks, but the high grass made that difficult.
I took a few pictures and tried to outline the concrete structure with my gps. Then I followed the nice and even road out from the forest. I plan to go back someday, during autumn when there is not so much grass and mosquitoes. Then I will use the road directly and save myself 20 minutes of bike carrying.
A few years back within the Tendring District of England I started to place Notes on OSM when local government granted planning permission permitting development of new dwellings, roads or change of use of buildings i.e. an office building becomes a residential property. It’s a semi automatic utility which might feature in a future diary entry but for now let’s focus on OSM Notes.
I’ve created quite a few Notes and they’ve become difficult to manage. I needed a visual map highlighting notes that have not been reviewed for years so I, and others, can focus on returning to the oldest Notes updating and closing accordingly. After some thought I created this available at UMAP.
The rest of this diary is about how that’s produced.
I use a Raspberry PI, a credit card size always on computer running a Linux based OS. A cron job runs every Saturday and downloads from OSM all the open notes in the area I’m interested in. A Python program runs after the download sorting through the notes separating them into three CSV files, one for notes not edited within that last year, another for notes over 6 months old and another for notes edited within the last 6 months. These CSV files are currently manually loaded into my UMAP as layers but that can also be automated.
Now the detail
Downloading OSM Notes
There is an OSM Note API described in detail here
First we need the coordinates of the area you want to download. The easiest way I’ve found to do this is click on EXPORT (top left) on OSM, then select Manually Select a different area adjusting the displayed box to the area you want to extract notes – KEEP IT SMALL. The numbers displayed in the grey box are you’re bbox coordinates LEFT, BOTTOM, RIGHT & TOP as defined by the Notes API.
I then execute a wget command as follows.
wget -O /media/networkshare/raspberry/notes.xml "http://api.openstreetmap.org/api/0.6/notes?bbox=0.9277,51.7653,1.3019,51.9489&limit=10"
-O defines my output file
.xml as the file extension downloads notes in XML format
&limit=10 only 10 notes downloaded – maximum is 10,000.
Now I have a file called notes.xml listing all the notes in my area of interest.
Processing using Python
A screen shot of the Python Code is shown below The input and output file names are configurable as are the two date fields. In the sample above I’ve set the code to extract notes older than 365 days into the first file, notes between 365 and 183 days into file two and notes not edited in the past 183 days into the third file. The code produces CSV files for easy importing into UMAP. Each note also includes the username of the last person who edited the note and also the last comment and a clickable link through to the actual note hosted on OSM.
After executing the code using your input file notes.xml three new files (as defined by you) will exist ready for importing into UMAP.
Import into UMAP
I’m not going to explain the full process of creating a UMAP here, only the import process and the finer details of interaction and remote data. Click the import button (arrow as shown below) and then set the input file, file type, the layer and click REPLACE if you want your new data to replace the existing data.
The CSV file contains, in this order, 1. Longitude 2. Latitude 3. Note ID 4. Note Status 5. Note Date (last edit) 6. OSM User who made the edit 7. The Note text with commas and line spacing removed by the utility.
When a user clicks on a note a box appears which UMAP allows you to control the content and format. To change the formatting select Manage Layers, Edit (one of your layers), Interaction Options and format the Popup content template as shown below.
Automating the entire process
The download of data from OSM and running the utility are already fully automated. The one last piece I haven’t yet completed is “uploading” the data weekly to UMAP. This is actually easy if you have some hosting space as UMAP supports Remote Data. To complete this section you just need to Manage Layers, Edit (one of your layers), Remote Data and set the location of the three csv files which will be dynamically loaded as required. I’ve tried to use Google Drive for this purpose but annoyingly google drive changes the file name each time a revision is uploaded. A job for another day.
I hope that’s been of interest. I can make the code available to those interested, just get in touch.
Past street art:–
KeepRight is a data consistance and quality assurance tool for OSM. It's been around for years and years (since at least 2009). I used it ages ago and forgot about it. But it's still around, still updating, still checking OSM. Some of the checks don't make sense everywhere, so use your head and mark things as false positives if needed. If you're looking for some mapping & gardening, open it up, have a look at an area and fix up the map.
Every day I have been adding and fixing OpenStreetMap data. I have learnt and contributed in creating data of the highest possible quality in collaboration with the OpenStreetMap community.
Over this year I have created, edited and modified around 44,000 changesets. 😃
It has been a wonderful experience, during this time I learnt everything from mapping objects to using JOSM and various plugins.
In this year I worked on several Mapbox projects, such as:
- Make Ayacucho the best map in Latin America
- Import buildings
- Map bus route in Ayacucho - Peru
- To align roads in Taiwan
- To solve misalignment issues Data in Taiwan
- Offset database for Bing satellite imagery in Taiwan
- Map turn lanes in OpenStreetMap
- To solve To-fix task
- Use the To-fix plugin in the Tiger delta task
- Make a map, eliminate Malaria
As I got a clear understanding about the OpenStreetMap data, I realized that how my mapping is contributing in making of the best map of the world.
HOW CAN YOU IMPROVE THE MAP?
1. OSMCha is a tool of changeset level notification, giving an overview of how many objects were affected in a changeset. A set of suspects words automatically flag some suspicious changes. Custom filters can be used with changeset comment, source, and other combinations to look for suspicious edits. You can read this for more information:
- Improving OSMCha
- An open database of inconsistent edits observed on OSM from OSMCha
- Validating the map - Part 1
- Monthly roundup - common errors and unexplained edits observed
- Validation Scoop: Inconsistent edits observed
2. To-fix is a micro-tasking tool that breaks large data curation tasks into smaller jobs that are systematic and repeatable.
3. OSMLint is a tool identify common geometry and metadata problems OpenStreetMap data. OSMLint processes vector tiles with turf.js and TileReduce to produce geojson files of detected data errors.
These are few of the tools that have help me contribute to this beautiful map of the world! 🗺
river gets narrow for a small segment for no apparent reason
should fix this and loop elsewhere on the rio grande: http://www.openstreetmap.org/#map=14/34.9269/-106.6742
Usually when meeting old timer GIS users in academia or government, there are a bunch of questions I get asked about how OSM data fits into the more traditional GIS model where data is organised into shapefiles and layers.
Since I could not really find a simple article which explained the difference, spent a few minutes today to come up with a (possibly) easy to understand benefits table for someone in Government. Its not technically accurate, but could quickly help pitch the idea for opening up more data.
Its still very rough, feel free to contribute any suggestions/improvements that could make this useful.
This is what most of Podder Lane looks like today (1st photo below) and what the last 10 yards looks like (in my experience, the 2nd photo is an extreme example of the 'normal' condition of unadopted roads):–
The modern Podder Lane was originally the farm-track that gave access to Podder Farm from Mapperley Plains, and is a quarter of it's original length. A 3m-high hedge runs unbroken all down the north side of the street. There are only 5 bungalows that open on to the south side and — in spite of the 1847 Act, which declares that every house in the realm must have a number — like many unadopted streets, not one of these bungalows has a number, only a name.
The entire area was originally part of Thorneywood Chase — hunting grounds for the King & followers, a part of ancient Sherwood Forest, home to the legendary Robin Hood, and the reason that Nottingham City has stags as supporters on it's crest (modern Nottingham is a Unitary Authority; it became a City in 1897 by Grant of Queen Victoria; the Crest stags (granted 1908) were originally (1898) ‘Foresters’, which is to say “Robin Hood”; the arms were officially recognised in 1614; the motto “VIVIT POST FUNERA VIRTUS” translates as “Virtue Outlives Death”):–
Mapperley Plains runs along the ridge-line at the top of the hill that rises all the way from Lambley Lane. Podder Farm is now long-gone and, with hindsight, never had much chance of surviving. The farm can be seen on old maps (in JOSM use
NLS - OS 1:25k 1st Series 1937-61). The modern cycle lane/footpath that connects Denbury Court with Gedling Country Park crosses the top of the no-longer-existing farm-track, at the point where the farm-buildings began, just where the cycle track leaves the trees. It is as if the old tracks continue to haunt the land, and there is more of that...
Podder Lane used to run all the way & connect to where the footpath meets Chedington Avenue (and yes, both are on the old maps, as is the public footpath that connects to Mapperley Plains). The Regency Heights developer wanted to use Podder Lane to get his deliveries in & out, but that road is a private road & the folks already living there (who own the land that the road is on) all flipped the developer the finger. The developer was not best pleased.
At that stage the lane had previously supplied a car scrapyard & (I believe) a Rugby club. The lady in the last house told me that the rest of Podder Lane was owned by a mushroom farm, and that they sold it to the developer, who promptly de-commissioned it as a road (the Google Satellite photos suggest that the developer did not bother to even lift the tarmac).
Podder Farm essentially received a death sentence as soon as Digby Coal Company (Gedling Pit) was established in 1899. The pit spoil was carried by aerial ropeway & deposited over large parts of the hill, including Podder Farm's fields. The pits closed in 1991, and 5.71 acres (23,169m²) of Podder Farm land were sold in 2011 for £4m GBP by the City Council to Taylor Wimpy (pdf). That land is currently being prepped ready for new houses. Meanwhile, much of the rest of the hill was desolate wasteland, and potentially dangerous if not stabilised. Gedling Council have re-sold part of it to the public as the Gedling Country Park and, since masses of new houses require require tarmac so that their co-owners can go to & fro a bypass is being built through the lower parts (observing the size of the garages I often think of modern houses as being co-owned).
Now, you may go into the OSM-Data world and visit places 'together with a friend'. As you move around, you will see your company next to you, also moving and watching. If you just start “OSM go”, your user name will be the name of your country. Or call www.osmgo.org?user=myName. Use a nickname or even better, use your OSM-name. A 2nd-click any place you want to visit and select the icon of “OSM go” to enter. Your friend may follwow you, using the slippy map (see below).
There is a 'chat' implemented in “OSM go”! Press key C and enter text in the popup dialog. The actual chat texts will be shown in the text box at the top left. There you will also see if an other user is dropping in or leaving. If you like to test it with me (-karlos-) just send me a time, I may be there and guide you. So don’t be afraid if you use “OSM go” and see a moving smile. Some visitors and me had already a lot of fun doing this. Some user of “OSM go” may have been shocking surprised, sorry.
Usually, you will see the OSM default world map with additional layers:
- A number of city icons, you may mostly know as 'Demo areas' from the wiki page Simple 3D buildings. A klick at one of them will show the map menu. There you may select none of the existing 3D renders. The arrow at right will zoom in to the place or zoom out to the world map.
There are the usual map zoom controls, a search control to find a place on earth by text and a control to zoom to your actual location. The cursor keys, mouse- or touch-drag will slip the map. The keys plus/minus and the mouse weel will zoom. A double-click/-touch will zoom in, a single-click/-touch will zoom out. A 2nd-mouse-click at any place or a long touch will popup the map menu as descripted above.
With the menu top right you may activate some “OSM go” specific layers:
“OSM go” shows all users as an icon. Active users will be shown as a smily. A klick on one will show the map menu. If you zoom in by the arrow, you may even see the user move its actual position across the map. If you enter “OSM go” yourselves now, you will arrive next to your OSM-friend. If a user starts “OSM go" or gets passive, you will get an message by the map.
Layer “You” will get active, if you klick on the “location” control at bottom left. Your browser will ask you to use your actual location, show an icon and will zoom in to it. Also the location, determined by your IP address will be shown.
“Visits” will show a lot of red cycles: Places, other users did visit recently. Form the very last visit, the home of the visitor is shown in blue. Of course, a click on a cycle will bring the map menu to start a 3D renderer.
If you visit the map with an given user name (by adding ?user=myName to the URL) only the layers “OSM go” and “Visits” are active.
The map code/function isn’t final. It would be nice, if someone will help me using Leaflet accurate. Like: how to use the enter key for text search. As avatar I used an creepy human eye first, then a glass eye. There should be a way to select or even download an individual avatar, like the eye of 2001-HAL or whatever. ** 'OSM go' uses a lot of URL parameter. I would like to replace them by a map menu, but I don’t know how to do it - yet.
- There is a lot of gaps to fill, like more roof shapes.
- There should be a 3rd person view with an avatar like in “Pokemon GO”.
- The primary intention, to make a “game” to help OSM is still present. In the last days, I played Pokemon to get inspirations. May be: Find new shops or changed places, take pictures to enable arm chair editing the tags of the places.
- I consider to recode “OSM go” in C++ (or Shift ) to have native applications - and use WebAssembly to run it in browsers.
Hi, I share here a 3D digital elevation model of Mount Everest I've made, showing the main climbing routes and localities, with Landsat image backgound.
See and browse it at:
Hope you enjoy it.
Made in QGIS using:
-Nasa Shuttle Radar data SRTMGL1 GeoTiff image for contour lines and 3D relief model, obtained from https://gdex.cr.usgs.gov/gdex/ (https://wiki.openstreetmap.org/wiki/SRTM#Official_versions);
-Background Image LANDSAT 4 Geo Tiff LC81400412016324LGN00.tif Date:2016/11/19. Courtesy of the NASA EOSDIS Land Processes Distributed Active Archive Center (LP DAAC), USGS/Earth Resources Observation and Science (EROS) Center, Sioux Falls, South Dakota. Online resource: USGS Global Visualization Viewer - http://glovis.usgs.gov/
-Contour lines made with Raster plugin from GdalTools;
-Qgis2threejs (https://github.com/minorua/Qgis2threejs), very frienldy to use (just confirm project CRS is set to EPSG:3857);
-Map data (location points and lines) from OpenStreetMap.
Thanks to members of brazilian OSM community for many tips, specially to brazilian OSM contributor http://www.openstreetmap.org/user/cassioeskelsen for helping when I was struggling with parameters, he works with and knows a lot of GIS.
This derived work I've made is free to copy and share under CC-BY-SA 2.0. It's only for non-comercial use, meaning educational.
Keeping up-to-date, relevant maps, is a challenge for many organizations, especially if they don't have the in-house capacity, or the resources to systematically maintain geo-spatial datasets that are useful across multiple departments or end-users. This is not an uncommon scenario in many municipal governments in the Philippines.
Over the last several months, the MapAm❤re Initiative in San Juan, have been collaborating with local actors and promoting Free software, especially OpenStreetMap, to communities who are seeking to make the most of what's possible with Open data.
Last Monday, we've successfully concluded a City Mapa-thon for DRR to help the local government, in particular the City Disaster Risk Reduction Management Office in creating and updating the map features necessary for their risk reduction and resiliency programs.
87% of the people who registered for the mapa-thon made it to event. Thank you to everyone who chose to spend their Monday afternoon with us, helping out the city of San Juan.
Thank you, too to the City DRRMO, for hosting the event and making their facilities available for the volunteers.
A big thank you to our generous benefactors who sponsored the pizza and drinks. And a shout-out to Mapillary, for the swags we raffled after the mapa-thon. Maraming salamat!
Mapa-thon edits. Click to view data and details on Overpass Turbo. © OpenStreetMap contributors.
The mapa-thon achieved partial completion of the update/identification of barangay-level DRR facilities (mostly in the first district, prioritized because of population density). The mapa-thon participants were mostly newcomers and beginners to OSM editing, and we invested a significant part of the activity to training them how to use the iD editor. Meanwhile, and apart from coaching the learners, the advance mappers also took part in fixing https://github.com/OSMPH/papercut_fix/issues/13.
We also made use of the photos we captured during our Mapillary run early last month. It was a useful reference for mappers during validation, and when trying to determine location or features.
Mapa-thon Part Deux?
We've proposed a possible follow-up mapa-thon on 10th June, hopefully with the same group (to recoup our training investment) before the new school term starts and finally finish working on the remaining barangays. See: https://github.com/mapamore/events/issues/7
Data © OpenStreetMap contributors (ODbL); Image © MapCraft
The training segment is often mentioned as the least enjoyable portion of the activity, but is a necessary :imp:. We can only strive to make it less boring, and more engaging. It's proper training that makes it possible to avoid things like the screen grab below from happening in the first place, but then there's Murphy's Law. So experienced mappers also play a very important role in validation to ensure quality edits, and in coaching, to show them the ropes.
Change set with inadvertent error Data © OpenStreetMap contributors (ODbL); Image © OSMCHA
With Open data, other applications can add value to the data that mappers contribute and with the OpenStreetMap database acting as the primary repository of the same data. Update once, and make the updates available for everyone else.
The map data may be used off-line, on mobile devices. This OsmAnd screen shot shows the same area, with fire hydrants shown. Useful for fire fighters and emergency responders.
This Umap shows city hydrants that is retrieved dynamically from the OpenStreetMap database. Orange dots represent high-pressure hdyrants.
I took a few photos, and shared them here.
The City Mapa-thon [GeoBadge][geoBadge[ issues to participating mapa-thoners.
I've created a map legend for the map style that I use. It's a set of map data that can be appended to a rendering database to create a map legend in a blank bit of map (actually in the middle of Australia).
There are currently two parts - linear features and POIs. As far as the map is concerned these are "real POIs" (though they're never added to OSM itself of course - just added to the rendering database) so you need to zoom in to see some of the POIs such as the one for vending machines, which only appears in this map style from zoom level 19. You could use it with other map styles, but some of the features are dependent on this lua script.
Here's a preview of what the "roads" part of the legend looks like:
but to use it properly follow the link and move around.
Don't misunderstand me; I like civilisation, I really do. I like that my grand-daughter Micaela can walk down the street without needing to actively fear every man that walks past, or worry about being pounced on by a sabre-toothed tiger, or a cave-lion. There are just so many benefits, like amoeba-free water plumbed direct into the home, lots of shops with shelves full of food good to eat, and maps of the area freely available. It's all excellent stuff, even if it's just the Matrix.
So why do I miss wild woods? With wolves, and deer running free? Possibly it is the Austrian blood from my mother calling to me, or perhaps because I have finally reached the edge of Nottingham's suburban housing (Spring Lane), but at my last mapping session I was able to stand within Gedling Country Park and gaze from the high sierra south across a vista of naturally-seeded trees (please forgive my whimsy) and gain a hint of what the long-gone Sherwood Forest might have looked like:–
However, make the most of it, for the Gedling Access Road (GAR) is coming (GAR Diary), and many of those trees are lambs awaiting the slaughter so that tomorrow's civilisation can embed itself yet more firmly into today. That brown scar beyond the trees in the photograph below is land being made ready for the Arnold Lane interchange with the GAR:–
The developers have agreed 2 years to complete the GAR, starting spring 2017. Apart from a couple of decades of development blight, nothing has been seen until this work on the interchange.
I reached this part of Nottingham in my mapping schedule two weeks ago & realised that the whole area was due for dramatic change very soon. There were a couple of things that I wanted to photograph before they were gone, and gave myself yesterday (Sunday 28 May) to do it.
1. Chase Farm + Cottage
Chase Farm is possibly named for being built within Thorneywood Chase (originally owned by the King & stocked with red & fallow deer, and thus the area had a history of hunts, horses & dogs + poachers such as Robin Hood). It is one of the two farms that has been blighted by the GAR (Glebe Farm is the other). Unlike Glebe Farm, which still has horses in the eastern fields & an energetic lady that visits them, Chase Farm has been entirely deserted, as has all the fields that it once farmed. The access track for the farm ran from Mapperley Plains; the council has had to block that track due to fly-tipping at the farm. Both farm & cottage are now sad sights:–
2. Mapperley Tunnel
The Pepperpots' tunnel approach lay deep within a gorge of trees, with the former track-bed up to 20 feet (7m) below the top of the cutting. If you decide to explore it yourself then be warned that, once off the official tracks, there are zero fences to prevent a precipitous fall to the floor. Also, do not be a fool like myself & wear light-coloured trousers & street-shoes; Clarks are comfortable shoes & remind me fondly of Street in Somerset, but are mostly useless for exploring muddy forests (if it has been raining recently then probably best not to bother, as the access is down steeply-pitched slopes; you may get down but not back up).
Until I surveyed it I did not realise that there are two cuttings that run parallel to each other. The first I followed is to the north & seems to lead to a blank, dead-end. The second cutting to the south leads to the tunnel entrance, and most dark & spooky it was. There is already an exploration into the tunnel available on the internet (and Wikipedia), but I only went 10 foot inside at the most!
I have started to creating polygons and correcting road system/POIs in Pánd, Hungary. Pánd is a midsize village with a population of around 2000 people. I have got local knowledge in this area therefore I decided to perfect OSM here.
Keep on updating openstreetmap guys. It is getting better and better. #makeopenstreetmapgreatagain
Doing more TIGER verification, today. Changing the name "Ducks Head" to "Duck's Head Road" So I am wondering why they have chosen such a strange name as I look at the map and see the referenced duck in the map.