OpenStreetMap

New demo for changeset upload available

Posted by mmd on 4 July 2018 in English (English)

the changeset upload is known to take quite some time for larger changesets, sometimes resulting in timeouts and unclear overall status. Luckily, JOSM already covers some of those issues via its chunked upload, still there's always room for improvement.

Test period ended

Thank you for your interest. The test period on a dedicated server has come to an end. There will be a separate announcement once this feature is available again for testing. Thanks everyone for participating in the tests!

Upload

(Image by zerebubuth, original source(defunct), mirror)

Comment from MikeN on 7 July 2018 at 19:49

I was able to make a few tests, quite impressive! One error test case I uploaded resulted in a proper error message from JOSM.

Is the test server running cgimap or golang?

Comment from mmd on 9 July 2018 at 18:51

Thanks a lot for taking the time to test different scenarios and providing some feedback here. Much appreciated.

This project started in December 2017 as a complete redesign of the current Rails based implementation with a special focus on backwards compatibility and performance. It leverages mass database operations wherever possible. My main motivation to start this project was probably my dissatisfaction with the current performance.

The idea to move the changeset upload to cgimap is not really new: it was first mentioned in some 2011 EWG chat protocols and later appeared in the GSoC 2017 + 2018 proposals, which unfortunately nobody accepted as a challenge. This project is pretty much independent of any GSoC, though. zerebubuth was helping quite a bit to fit the new implementation into the current cgimap, and getting it technically "ready for deployment".

PS: Everyone can still help out! The more testers we have, the more potential issues we can discover at an early stage! Thanks to all testers providing feedback so far.

Comment from spiregrain on 24 July 2018 at 22:42

Has this been implemented in Production? I find iD on osm.org is not allowing uploads, presenting an error message with raw HTML visible as follows:

Sometimes like this: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> Application error The OpenStreetMap server encountered an unexpected condition that prevented it from fulfilling the request (HTTP 500) Feel free to contact the OpenStreetMap community if your problem persists. Make a note of the exact URL / post data of your request. This may be a problem in our Ruby On Rails code. 500 occurs with exceptions thrown outside of an action (like in Dispatcher setups or broken Ruby code)

and sometimes like this: <!doctype html> We're sorry, but something went wrong: Web application could not be started body{font-family:Arial,Sans-Serif;font-size:13px;color:#222;margin:0}.column{max-width:1000px;margin-left:auto;margin-right:auto;text-align:center}header{border-bottom:1px solid #e3e3e3;margin-bottom:45px}footer,header{margin-top:50px}footer{font-size:14px;color:#7f7f7f;border-top:1px solid #e3e3e3;padding:40px 0}h1{font-size:30px;margin-top:30px;margin-bottom:10px}.subtitle{margin-top:0;margin-bottom:110px;font-size:20px}#operator_info{display:none}#show_operator_info{font-size:17px;font-weight:400}.left{text-align:left;padding:8px}h3{margin-top:30px;margin-bottom:10px;font-size:23px}ul{padding-left:16px}a,li{color:#1781bf;text-decoration:none}.error,a,li{font-weight:700}.error{background:#e6f3fc;border-radius:5px;padding:7px 12px}.error.block{display:block}.bold{font-weight:700!important}pre{margin:0;overflow-x:auto;white-space:pre-wrap;word-break:break-all}dt{margin-top:16px;font-weight:700}dd{margin-left:0}.plain{color:inherit;font-weight:inherit}#content{overflow-y:scroll;height:800px} We're sorry, but something went wrong. The issue has been logged for investigation. Please try again later. Technical details for the administrator of this website Error ID: bcafa58d Details: Web application could not be started by the Phusion Passenger application server. Please read the Passenger log file (search for the Error ID) to find the details of the error. You can also get a detailed report to appear directly on this page, but for security reasons it is only provided if Phusion Passenger is run with environment set to development and/or with the friendly error pages option set to on. For more information about configuring environment and friendly error pages, see: Nginx integration mode Apache integration mode Standalone mode <!-- You are free to modify the footer as you see fit, but we kindly ask of you to preserve the following text. Thank you. --> This website is powered by //www.phusionpassenger.com">Phusion Passenger®, the smart application server built by Phusion®. function showOperatorInfo() { document.getElementById('operator_info').style.display = 'block'; }

Comment from mmd on 25 July 2018 at 04:39

No, it’s not in production. You’re getting some Rails issue here, probably due to the server move. https://help.openstreetmap.org/questions/64900/huge-error-when-saving

Comment from mmd on 22 September 2018 at 09:09

Testing continues on the OSM Dev server now: https://upload.apis.dev.openstreetmap.org/

See this link for details.

Login to leave a comment