Recent diary entries
On the schedule for the Friday and on Saturday morning was the kick off party, registration, let's map!/OpenStreetMap in your organization sessions, and coffee break.
Kick off party
Thanks to a delayed flight I ended up going to the Mapbox Garage. The entrance is on the rear, so the taxi driver was confused getting there. Since I was there early, I helped with the setup, and schlepping the alcohol over from the store nearby.
The party got too loud, but I was able to catch up with a few people. We ended up running out of bottled water, and the taps were inconvenient. I walked back with a few others staying at the Washington Plaza hotel.
Registration went smoothly. Conference t-shirt just said State of the Map, not State of the Map US, which seemed odd. I think most of the conference people handling registration were paid staff, which was a difference.
There was a welcome talk which I thought was rather good at the time, but seems it wasn't very memorable, because I can't actually remember much of what was said!
The conference had over 500 people check in at registration, a big growth from the 2009 SOTM-US which had about 50 people.
First session, coffee break
I ended up talking with the people from Amazon for all of this session, so missed the talks. I'm hopeful that they'll be able to commit some EC2 credits to do some dev work and performance testing. Of course, I was the same way after previous conferences and nothing came of it.
It doesn't sound like they're willing to commit to helping any osm.org infrastructure with resources in any ongoing manner.
What if hackers, artists, activists and communicators join their paths to generate social change?
https://www.youtube.com/watch?v=vtDqjwQIL50 (in spanish... activate captions in your language)
"... enhances and promotes: collaboration, mutual understanding and synergy..."
"... inhabitants, activists, artists, developers, designers, pointing to a sense of citizenship that extends from our neighbourhood to the mainland..."
"... creating accessible and effective tools of free use and simple to apply that generate citizen participation and autonomy..."
"... a free radio, a common library of documents (photographs and films of the public domain), blogging citizen systems, mapping the skills (of citizens) in OpenStreetMap and a messaging system to enhance dialogue through technology..."
I will be publishing more info of progress...
Last night I was working on the statistics display system for MapRoulette and realized that I don't know what to display.
In the rewrite of MapRoulette, we knew that me trics would play a large role in the project, so we added in lots of statistic capturing capability, as well as piwik support for even more metrics.
We could track what challenge a user has worked on, where those challenge are, where specific tasks are, how difficult the challenges are, how a user classifies tasks, how long they spend on maproulette, even how long they spend (generally) on each task.
Similarly, we could collect a ton of metrics for challenges. How many users work on it, are there a few "super-users" or is it widely distributed? Are people saying the tasks are fixed, skipped or false positive, etc. We can even find out how long users spend in aggregate on the challenge, or even drill down to the tasks and find out when people walk away from them.
But amongst all the possibilities- what do MapRoulette users really want to see? What intouerests them? Stats about themselves? Stats about other users? Stats about challenges?
Tell me what kind of stats (if any) you'd like to see in MapRoulette?
I etarkakavo to insist that sucks Never mind! Good time with this idea in my mind bursting. Town main figures for all these fancy the idea. Certainly succeed to get the amotittu telling everyone to cooperate say. Monetary costs, I do not care. I can afford. Situation favors. Further details -http://markjamesadams.jimdo.com/
Today I went to a pubic consultation on the proposed A14 road upgrade (it's a section of road in Cambridgeshire UK) . The consultation was hosted by the Highways Agency ( they look after and manage roads and traffic in the UK) and showed the route and detailed junctions on Ordinance Survey Maps, But I was pleased to see they had a PC set up which showed some of the route layered onto good old openstreetmap as "people can see whats what with our clear and named streets". I said I was the mapper of this and that on our map and they asked a few questions about OSM and they seemed impressed with OSM. I left thrilled that a big national organisation takes our stuff seriously.
Is this a bug in the renderer or in the data: Look at Moscow in the humantarian renderer a.k.a. layer
I mostly finished analysing how much it costs to me to keep the data up to date and rendering the maps. I will have to change the map design a little, but at the end the project seems useful. all the details in the following links:
You can see the rendered map here:
This is our first hike of 2014, also the very first time that I use OpenStreetMap. What I am planning to do is to design ~20km route for the hike and then overlay our actual route on top of it. Hopefully, it's all possible with this map...
The Moabi development team is excited for State of the Map US this weekend. We are sharing a preview of the new Moabi (to be fully launched on Earth Day), and presenting our work on Sunday at 4pm, OpenStreetMap as Infrastructure, sharing the stage with the USGS National Map Corps project, and NPS Park Tiles. Hope to see you there! And if you want a demo any time this weekend, find one of the team, Sajjad, James, Leo, Chippy (virtually) and myself.
First why Moabi?
Moabi-DRC is an independent mapping initiative that collaboratively monitors land use in the Democratic Republic of the Congo. Our community works towards a more Transparent, Equitable, and Sustainable future for the environment and people of DRC. You can use Moabi DRC to explore, share, and create projects on a wide range of issues from REDD+ to community mapping and more.
Why OSM as Infrastructure?
OpenStreetMap's render stack, editor and web application can be used to power collaborative mapping efforts beyond OpenStreetMap. OpenStreetMap's software is unique and powerful as infrastructure for building communities of contributors. What happens when OpenStreetMap software is reused for new data sets and communities beyond OpenStreetMap.org?
We've been working on customizations like...
Preset Editor for iD
Tile management through GitHub and a OSM TileAPI
Map Story Building in OSM
Showcase Map Sites in Jekyll/GitPages
So much more this weekend, see you!
The OSM dataset is a rich database of information about the world. Not only can the data be used to render beautiful and useful maps, it can also be used to do some nifty calculations in conjunction with other open datasets that exist. One such potential use is in cleaning up and improving elevation datasets such as the public domain SRTM or ASTER datasets. Both of these datasets offer elevation coverage over much of the world but they are limited in resolution (SRTM is 90 m per pixel, ASTER is 30 m per pixel).
Although these elevation datasets can be useful for very basic things like drawing 25 m contour lines on topographic maps, if you try to use these elevation models for more sophisticated things like drainage calculations, you will get very weird results due to a number of issues. First, almost no rivers are 30 m wide or more, so the river channel can't be modeled at all. Second, noise in the elevation datasets often results in river valleys with "bumps" in the river that make it back up and flood large areas that in the real world would really flood because there is a stream draining the water out of the valley. Lastly, in many areas streams, drainage ditches, and other such things often run in close proximity to buildings and other such features. In these areas trying to fix the elevation to correctly predict drainage ends up changing the elevation of buildings as the pixels are so large the whole neighboorhood must be raised or lowered to make the drainage calculations work. The example shown below shows a couple of these issues, and other areas suffer from them in much more signifigant ways.
The original ASTER data at 30 m per pixel.
In order to fix the problems outlined above, and allow for other useful operations it is therefore worthwhile to upsample the horizontal resolution of these elevation datasets. The GRASS GIS system has tools like r.resamp and r.proj which can do things like cubic interpolation which provide nice smooth datasets at higher resolutions (in my example I am using 3 m per pixel, a 10 fold step up from the ASTER data I started with).
The data resampled to 3 m per pixel using r.proj with cubic interpolation.
This resampled data looks much more visually pleasing and if things like contour lines were computed from it they would be smoother, etc, but it still does not necessarily accurately reflect the drainage network topology for flood simulations. This is where the the OSM database comes in.
Because we map streams in OSM and because they are often traced from aerial imagery with resolution on the order of .1 meters per pixel, even very small streams and canals can be recorded with their exact position and shape accurately recorded. Furthermore, we can measure things like the width or depth of the waterway to further improve our data about the feature. This high precision stream path can then be "carved" into the higher resolution elevation model to allow the stream to cut through the small "bumps" intorduced by the cubic resampling. In the example below a 5 pixel wide (i.e. 15 meters wide) channel is cut into the dem everywhere there is a river or stream in OSM. The stream is first "leveled" by iterating over all the pixels in the stream and for each one setting it to the minimum of its own value or the 8 pixels surrounding it (the 3x3 neighborhood). During this leveling step if the pixel is on the stream centerline is is carved down 5 meters below the minimum neigborhood value, if it is along the edge of the stream it is only carved 2 meters below the minimum. Finally, after the carving is done the whole map is run over with a 5x5 neighborhood average to smooth out the river channel into something roughly U shaped to approximate a channel carved out by water, but still ensuring that the center of the channel will be free from major bumps that impede the flow of water in the flooding calculations. The result can be seen below, notice that not only can we now see the irrigation lines in the fields in the center of the image, we can also begin to see the rough cut in erosion pattern in the mountainous regions as well.
The final 3 m elevation model with the stream network from OSM carved into the surface.
The final result is quite nice, both visually and topographically. This is just a first step in this process to demonstrate the basic idea. I plan to do much more in terms of varying the width and depth profiles of the waterways to more accurately model the drainage system and I also want to look at integrating other sources of elevation data from the OSM database such as natural=water which shows a level contour line in the elevation profile at high resultion, natural=cliff and barrier=retaining_wall which indicate "jumps" in the elvelvation model, and also things like road and railway embankments, etc. The 3 m per pixel chosen is just small enough to nicely represent the width of a built up road or rail line or to represent roads "sunk" down a few inches from the surrounding grade due to things like curbs, etc. I hope to hear suggestions on other things from OSM I could use, or how the OSM data itself could be improved to better allow for these kinds of analyses.
EDIT: As requested in the comments below, here is the 'difference' calculated with r.mapcalc between the upsampled DEM and the carved DEM. The values in the "flats" i.e. anywhere that is not a river range from about -1 to 1 m and the river are as deep as 7 meters in the places where they cut through a "bump" caused by the cubic resampling process.
The "difference" between the 3 m DEM and the carved DEM.
This is where I was standing
Just learning how to use this program, having some difficulties. Wish me luck please!
So i like geography so for art class I learned the GPS sensor.
when i went on a road trip for spring break during spring break, I left my gps on and stored the values into sqlite database from the phone.
I then created a dataset of latitude, longitude, and time into 540,127 rows that I wish to use to create a visualization.
Today I worked on this project and borrowed a fast computer at the school, converted the rows from terminal sqlite query to (.txt and .html) form.
I am learning to program with Android for the course and so I found myself at the Google for fusion tables. About one hour ago I was able to figure out how to embed 100,000 (is limit on free acount?) onto the Google Map interface.
However, I want to do more and I hope Someone can offer me some advise or ideas.
Thank you for taking the time to read my story,
Open Data for Resilience Initiative - Disaster Risk Management - John Crowley @jcrowley email@example.com
- Collective memory of deep history - recalling hazards of particular locations
- OSM as collective memory
- Geologic cycles can be quite long - thousands, millions or years
- Underlying nature of risk is changing - cities growing at 5%. Data describe a very dynamic reality
- Understanding dynamic risks requires better data
- Need for better data - smaller grid squares - beyond 10km grid down to building polygons
- Open Data for Resilience Initiative Field Guide
- Govt data often exists, but need to be collated and made open
- Fractured over many ministries
- Political barriers
- Proprietary formats
- Worse: PDF scans of "data"
- Collection on paper, then entering back to OSM using JOSM
- Building survey form - standard form
- Teaching community to build their own data, not outsiders
- Quality assurance
- Teach people to improve data collection while they're doing it
- InaSafe - plugin for QGIS - visualize impact models
- gfdrr.org - OpenDRI Field Guide 1.0 CC-BY
- Performing analysis and getting it to village-level govt requires a lot of printing
- The map is a collective memory not only of what is or once was, but what might one day no longer be.
- What could be, what could be built back stronger?
Building a Community - HOT in Indonesia - Kate Chapman
- Mapping for preparedness
- InaSafe - impact modeling software
- People are core to the community
- Train people -> those people train others
- Recruiting posters - new interns had geography background
- Technical literacy, technical problems (JOSM doesn't run, firewalls)
- People excited, but don't know how to get started -> train the trainers
- Train the trainers - little to do with mapping, more about how to teach, build adult engagement
- 50% of Scouts are in Indonesia
- learnOSM - step by step guides
- World Bank GFDRR
- Field Papers
Inside the Eye of a HOT Activation - Dale Kunce
- 10000 buildings mapped within 24hrs
- Coordination through Skype
- HOT creates maps where Red Cross/Red Crescent volunteers are going
- Using NGA imagery to create HOT tasks
- Imagery difficult to get while hurricane is in area (clouds)
- Use old (Bing) imagery to map what was there (pre-mapping)
- HOT Tasks http://tasks.hotosm.org
- Start JOSM - http://learnosm.org/en/beginner/start-josm/
- http://osmand.net/ - Android client, download osm file
- Need help documenting, tracing, software - Harare, Zimbabwe
MapGive - A coordinated campaign for action - Joshua S Campbell DOS
- Humanitarian Information Unit - research and analysis of humanitarian emergencies
- Maps are often taken for granted or assumed to exist, when more often they do not
- @mapgive mapgive.state.gov
- Connective power of internet has fundamentally changed economics of information creation
- Lower the bar for new mappers to join
- Crowdsourcing in government: build relationships with volunteer and technical community, build trust in communities - share imagery - engage local communities - enhance the data
- American Spaces - outreach centers around the world
OpenStreetMap as Infrastructure - Elizabeth McCartney, USGS; Mikel Maron, Crowd Cover
- National Map Corps - Volunteered Geographic Information at USGS (project suspended 2008)
- 2010 project revived
- Volunteers from 4H, Scouts, retired people
- Users are peer reviewers after editing 25 points
- Moabi - collaborative mapping project, DR Congo, forest monitoring
- Looking for open source mobile OSM editor
I Imported Chicago - Ian Dees @iandees
- Move to new city, new job -> found open data portal in Chicago -> discussed with local OSM community
- Still did it wrong - didn't talk to global OSM community
- License was not compatible - require user to take down data on request
- Convince open data people of Chicago to switch license to MIT
- 3 months to import, 1.5 years start to finish calendar time
- Easier for others to add data once building shapes imported (restaurants, businesses, etc.)
- Import using JOSM easier than scripting in this case
Open Data and Cities - R.E. Sieber @re_sieber
- What happens to participation when anyone can participate any place?
- Need grad students
- How can non-experts be empowered by technology
- Empowerment of marginalized people and democracy
- Open Data - data should be freely available for everyone to use, reuse and republish without restrictions
- Licensing challenges of accessing municipal data
- VGI - Volunteered Geographic Information is the widespread engagement of large numbers of participants involved in the digital creation of geographic information. Participants are usually non-experts and have little formal coordination with each other.
- How well do City Open Data and OSM play together? Not well, but getting better.
- Mapdust - bug tracker for OSM
- Accuracy is not the first objective. Accuracy is dependent on its use.
- Credentials provide the accuracy - citizens cannot check every point
- Eyeballs provide the accuracy - OSM contributors refine the data
- Neoliberalism - push in cities to deregulate and privatize
- Govt has less money, VGI looks enticing
- Andrew Keen's warning - relying on amateurs/volunteers is a problems, govts shed employees and replace with volunteers, if volunteers don't collect enough data, there are no employees to fill gap.
After joining this community, making my first edit, and getting some nice welcome messages, I found that my password no longer worked for some reason. I got very busy at work and kept putting off coming back until today as I'm pretty much changing ALL of my passwords due to the Heartbleed bug.
Now that I'm back in, I've made several updates to Crestline, California and some of the surrounding communities. While most of these were entries for restaurants and other businesses, I did find one incorrect piece of mapping in the Valley of Enchantment where Log Lane was shown to stop short of meeting the town's main drag, Waters Drive (for any fans of "Star Trek: Enterprise," the "Carbon Creek" episode from the second season did some filming on Waters).
It looks like a lot of this area has not had a lot of contribution as far as businesses go so I am glad to get back in here and add a few things for everybody. It's a nice place to visit so I hope my additions will encourage people to come up here...and, bring money...our local businesses need it! ;-)
If you for chance read my previous diary entry, I registered on GiveIt100 and documented with a video a changeset made each day in a different country. I followed some basic criteria: each day in a different continent (counterclockwise order); if I missed a day I'd map in the same continent for two days; map in a country where I didn't map before.
So, straight from January 1st, I got to April 10th and in the last video I did a changeset in San Mateo, CA, where lives the developer of GiveIt100 (I previously mapped in USA, I know!).
The complete project is visible on https://giveit100.com/@sabas/ro277m
Having the NaturalEarth shapefile half filled, I should paint it green completely some time...
Someone with a planet file at hand could do a ladder of users ranked by how many countries has been visited (similar to the hydc user page)..
Thanks to Karen and Finbarr for their work!
I cannot help but share two images of a place I stumbled over today while mapping a little. A decaying house with a half collapsed outhouse at its side - but some flowers were well attended:
JOSM seems to get translated at transifex and launchpad, you can file bugs against JOSM at josm.openstreetmap.de and github, you can file bug against a lot of OSM things at trac.osm.org and github, too.
It doesn't matter when all resources are handled equally, but it is not so nice when you look at the wrong place…