OpenStreetMap
#PDCSurabaya Destroyed Surabaya (and clarification below)
Posted by everyone_sinks_starco on 8 January 2017 in English. Last updated on 10 January 2017.= Update: See the comment section for clarification from HOT OSM Indonesia. Thanks bro/sist, they’re do what I thinking about during writing of this rant =
My first entry is full of rants and criticism to HOT OSM Indonesia team, the people behind #PDCSurabaya event, who allowed their participant to corrupt and demolished much of Surabaya’s data integrity on OpenStreetMap.
Despite all of “hard work” they made, I have discovered that before I partially fixed them (Gedung Keuangan Negara, schools and post office in Central Surabaya, name a few), many of already-good map data in Surabaya on OSM was lost or mangled. Building polygon ‘merged’ into area polygon as part of relations, and relations have much non-standard basic entries (address, school ownership and others, but I appreciate data additions about buildings although it is inaccurate), making it very difficult to simplify for better rendering on much-universal OSM data-based applications. Also, all third- (kodya), fourth- (kecamatan) and fifth-level (kelurahan) administrative borders are wiped (addition: not just wiping, they REALLY corrupted them. Querying locations around the Surabaya returned with empty Enclosing Features, and showing maxlat uncaught exception error on browser’s inspect tool. This is never happened outside Surabaya where administrative borders are preserved). Polygon quality are mixed, mostly poor.
If HOT OSM wishes to make another PDC on other cities in Indonesia, PLEASE RESPECT OLD DATA BEFORE EDITING! It is a valuable basis and example to be copied for the project, not egoistically wiped them for your mangled data, which for me, needs more clarity. Government or individuals must openly provide data to them, to ease their work, especially on administrative border. If you want good example, see what I mostly have done in Denpasar and Amlapura (my hometown). Unfortunately I have no time to do mapping recently due to my own real-life issues.
To be honest, they should go outside the home for REAL survey.
And yeah, OSM Indonesia should expand beyond their disaster preparedness-related agenda, as OSM community in other countries RARELY made OSM just for disaster-related mapping. It is disastrous.
Location: the first entry where I have fixed building/landuse polygon amalgamation issues arising from #PDCSurabaya data demolition party.
== Everyone Sinks Starco ==
Discussion
Comment from escada on 9 January 2017 at 10:59
You could contact the Data Working Group to ask them to assist you in reverting the situation back (i.e. to the situation before the PDCSurabaya event).
Comment from everyone_sinks_starco on 9 January 2017 at 11:02
@Escada: ah thanks for the suggestion. Where I can contact any of Data Working Group members, if I can?
Comment from escada on 9 January 2017 at 12:02
Just send an email to data@osmfoundation.org
In general, they prefer that you can show that you have tried to contact the other mapper, that there was some changeset discussion, discussion on a forum etc.
This might be hard for a small (I assume) community as yours and with (propably) one time mappers from the event. So just send them an email and ask what you can do.
Comment from everyone_sinks_starco on 9 January 2017 at 12:14
Thank you very much! As one of lots of Indonesian part-time mappers who prefer data quality over quantity, this suggestion probably helps.
Comment from everyone_sinks_starco on 9 January 2017 at 12:16
At last, this is a lesson to everyone potential participant of any mapathons. Put quality above quantity.
Buat orang Indonesia, mohon pas ikut mapathon, prioritas kualitas data dibanding kejar jumlah polygon gedung.
Comment from everyone_sinks_starco on 9 January 2017 at 12:32
Again added ones, about the changeset discussion/on forum, I don’t really got information on their activity. One mapper from the event wiped administrative division borders for no reason, no discussion (from original mapper)
Also, it done behind closed doors, and I (and the mapper who made that borders) also unaware with it.
Comment from Iyan on 10 January 2017 at 05:34
Hello everyone_sinks_starco, my name is Yantisa Akhadi, I’m the Project Manager of Humanitarian OpenStreetMap Team Indonesia. First I would like to thank you for the feedback on our project in Surabaya, we already communicate this issue to our team in Surabaya and we will bring this in our team meeting as well to ensure that it can be addressed properly.
I would like to give you a bit of background about the project and how it was done. This project come under the request of Pacific Disaster Center (PDC) and Badan Nasional Penanggulangan Bencana (Indonesia Disaster Management Agency or BNPB) to collect critical infrastructure data and sub-village boundary (RW) in Surabaya. In the start of the project we also coordinate the effort with Badan Penanggulangan Bencana Daerah Provinsi Jawa Timur (East Java Provincial Disaster Management Agency or BPBD Jawa Timur) and Institut Teknologi Sepuluh Nopember (Sepuluh Nopember Institute of Technology or ITS).
In this project we deployed 16 surveyor which systematically collect the data directly from the ground and local village (Kelurahan) office starting from October 2016. We also have 4 data quality assurance which supervise their work, backed up by 2 Mapping Supervisor with more than 5 years mapping and data validation experiences in OSM. We also have Project Coordinator and Program Manager which continuously monitor the progress.
In mapping boundaries, we try to reflect the condition on the ground based on our interview with local village officer in each Kelurahan. These boundary is drawn directly by Kelurahan official and we digitize it in JOSM. On the missing boundary issues, it is related to the licensing where previous boundary data is done using unverified import (more about this is discussing https://lists.openstreetmap.org/pipermail/imports/2016-October/004643.html). We understand that this is a serious issues and we are committed to fix it.
Once the project finished in February we will have a workshop for government, NGOs and academic institutions so that they can use the data beyond disaster management. This is also the reason we involve ITS in first place so that they aware of this effort and can use it for city planning and development purposes.
You are very welcome to visit our project office in Surabaya (it is at Jl. Manyar Kerta Adi 3 No. 21) or if you live in Bali you can also have a coffee with Mhairi O’hara, our Program Manager for this project who lives in Bali. Please contact me through e-mail yantisa@hotosm.org so that we can schedule meet-up or through Skype regarding the follow up of your feedback.
Thank you.
Marilah kita bersama-sama meningkatkan kualitas data OSM di Indonesia.
Comment from everyone_sinks_starco on 10 January 2017 at 05:41
@Iyan, well, thank you very much for the clarification and the information about the project. Hope it can be resolved soon. Alongside that, I hoped locals there (either participant or not) are encouraged to add places or amenities on the OSM data.
I glad the team clarified this “data demolition” issue and committed to expand their project beyond disaster preparedness programmes.
== Updated ==
Comment from Iyan on 10 January 2017 at 06:58
Yes, we have a socialization and mapathon with ITS in October-November 2016, we hoped after the project they can continue mapping in Surabaya. Almost all of our data entry personnel also locally recruited from Surabaya.
Feel free to contact me or our team (team.id@hotosm.org) if you have further questions/clarifications.
Comment from harrymahar on 10 January 2017 at 09:39
Hi @everyone_sinks_starco, please let me Introduce myself. My name is Harry Mahardhika and I am Project Coordinator in #PDCSurabaya project. I need to clarifiy and make some statement regarding your diary about our project.
First of all, I think your diary title is provocative. The tittle directly accused HOT Indonesia destroyed OSM Data in Surabaya. All of your diary did not prove any evidence of OSM data in surabaya really has been destroyed by our project. Your only using your assumption without digging deeper about HOT Indonesia and this project. As Iyan, my manager, has explained to you that we already tell OSM user in working group before the project in Surabaya started. We explained that we would like temporary delete the administration boundary in Surabaya regarding the license issues from the previous author and will be replaced it with the better and valid one. Why I can say that? because our boundary administration in Surabaya has been collected by directly asked each village representative in Surabaya and got their permission to publish it in OSM.
Secondly, I see many of your sentences show some accusation to us.
(Despite all of “hard work” they made, I have discovered that before I partially fixed them (Gedung Keuangan Negara, schools and post office in Central Surabaya, name a few), many of already-good map data in Surabaya on OSM was lost or mangled. Building polygon ‘merged’ into area polygon as part of relations, and relations have much non-standard basic entries (address, school ownership and others, but I appreciate data additions about buildings although it is inaccurate), making it very difficult to simplify for better rendering on much-universal OSM data-based applications. Also, all third- (kodya), fourth- (kecamatan) and fifth-level (kelurahan) administrative borders are wiped (addition: not just wiping, they REALLY corrupted them. Querying locations around the Surabaya returned with empty Enclosing Features, and showing maxlat uncaught exception error on browser’s inspect tool. This is never happened outside Surabaya where administrative borders are preserved). Polygon quality are mixed, mostly poor.)
Why do even quote the word of hard work in your first sentence? Our Team has been mapped surabaya since October and still going until today. They going to field everyday, met people in the field, asking them the information, visit the official villages representative. For us, that is REAL survey
How you can said that our polygon relation is bad and wrong? We make that relation based on wiki OSM article. If you have better source than that please let us know. :))
Lastly, I would like to make a statement that we always respect old data in OSM. if the data is wrong we fixed it, if the data need more information we add it, of course we are not always right in this case that is why we still need suggestion and report from other user. We really appreciate if our mistakes delivered directly to us. Iyan has give you our email to disscuss or know more detail about our activities in Indonesia us or you can join in our Facebook Community if you have not join yet in Komunitas OpenStreetMap Indonesia. We always encourage our community to make OSM data quaility in Indonesia better in the future and really like support from them.
Mari bersama membangun bukan menjatuhkan satu sama lain. Salam,
Harry Mahardhika
Comment from everyone_sinks_starco on 10 January 2017 at 10:07
@Harry, I’ll reply using Bahasa Indonesia. Fellow Indonesians always talking in Bahasa Indonesia.
Maaf kalau bahasanya memang sangat menjatuhkan dan kasar. Saya sih sebenarnya mengritik kualitas data yang diberikan oleh anggota tim PDC Surabaya, tapi memang apa daya, saat membuat diari ini bahasanya yang terlintas saat pembuatannya memang kelewat tajam dan langsung, terutama soal pemakaian istilah “data demolition derby” - istilah yang lebih menohok ketimbang “unneeded data alteration”.
Bisa dilihat di history edit saya untuk beberapa lokasi di Surabaya (terutama GKN dan sekolah) tempat PDC dilaksanakan, dimana saya sudah memperbaiki kesalahan yang dilakukan sebagai contoh cara pembuatan zona landuse dan building yang baik.
Kemarin salah satu sesama anggota OSM, Farrah, juga mengritik penambahan-penambahan data baru yang dilakukan saat PDC Surabaya berlangsung, terutama di bagian Universitas Airlangga dimana ia menuding data yang diterapkan adalah data lama dari peta Bing, dan hilangnya batas-batas administratif Kota Surabaya. Hal ini juga melandaskan saya untuk membuat diari ini.
Kekhawatiran terkait tujuan pembuatan PDC Surabaya dan hal-hal lainnya, sebenarnya sudah dijawab oleh Iyan, dan jawabannya lebih diplomatis dan lebih saya pahami, dan enak dibaca dibanding jawabannya mas Harry, yang mungkin tersinggung dengan isi diari saya pertama, yang memang sangat kasar dan menyinggung institusi secara langsung.
Dan dengan ini, saya memohon maaf yang sebesar-besarnya kepada keluarga besar OSM Indonesia berserta para pihak yang terlibat di PDC Surabaya atas terbitnya diari bermasalah ini.
Trims.
Sesama mapper OSM saling membantu bukan menjatuhi.
==Everyone Sinks Starco==
Comment from everyone_sinks_starco on 10 January 2017 at 10:12
Ralat - karena lembar komentar OSM Diary ga ada fitur editnya….
“Bisa dilihat di history edit saya untuk beberapa lokasi di Surabaya (terutama GKN dan sekolah) tempat PDC dilaksanakan, dimana saya sudah memperbaiki kesalahan yang dilakukan sebagai contoh cara pembuatan zona landuse dan building yang baik.”
Tambahan: mungkin belum 100% sempurna jadi tambahan-tambahan berdasarkan guide OSM Wiki juga dipersilahkan
Comment from harrymahar on 10 January 2017 at 10:26
Terima kasih atas responnya,
Kalau ada kesempatan main aja ke kantor HOT di Surabaya ya biar bisa melihat kegiatan kami. Sekalian nanti bisa mungkin memberikan tambahan ilmu buat kami dari sisi teknis bagaimana memetakan yang baik dan benar di OSM.
Coba saya minta tolong, lain kali kalau itu berkaitan dengan institusi HOT Indonesia silahkan email ke team.id@hotosm.org atau kalau itu secara langsung dengan kegiatan HOT di PDC Surabaya ke email saya di harry.mahardhika@hotosm.org
Anggota OSM yang mas maksud itu Farras, dia mahasiswa universitas airlangga dan yang punya batas administrasi surabaya sebelum ini. Minta tolong kasih tau dia kalau ada sesuatu yang dirasa ganjil terkait surabaya bisa langsung hubungin saya atau ke kantor HOT di surabaya.
Alamat Kantor HOT : Jalan Manyar Kerta Adi 3 No. 21, Kel. Manyar Sabrangan, Kec. Mulyorejo, Surabaya
Komentar saya memang bukan untuk enak dibaca karena saya hanya mencoba memberikan informasi yang mas belum tau ketika nulis diari ini. Secara pribadi saya memaafkan dan kalau ada jawaban saya yang buat bingung anda saya juga mohon maaf.
Salam
Comment from Dewi Sulistioningrum on 11 January 2017 at 05:24
Hi everyone_sinks_starco
Terimakasih sudah memberikan contoh bagaimana seharusnya editing data yang baik di dalam OpenStreetMap. Terkait dengan batas administrasi di Surabaya yang telah Farras upload, kami telah mengirimkan email kepada Farras untuk membuat artikel wiki mengenai Import Data. Ini sangat penting dilakukan karena batas adm adalah hal yang sangat penting jadi sumber data dan bagaimana metode yang digunakan harus jelas. Juga diberitahukan kepada mailing list Import Data OSM. Tetapi Farras juga tidak bisa memberitahukan sumber data batas adm yang telah diupload, jadi batas administrasi Surabaya tersebut saya hapus, karena tidak bisa dijadikan referensi untuk pemetaan batas RW yang kami lakukan. Kegiatan yang kami lakukan akan memperbaiki data batas administrasi yang baru dengan tingkatan RW dari hasil verifikasi ke kantor kelurahan di seluruh Kota Surabaya. Tapi harap bersabar, karena batas tersebut baru akan diupload ketika semua batas telah lengkap dan tidak ada kesalahan.
Terkait dengan pencarian penamaan surabaya pada pencarian di website osm, itu bukan karena terhapusnya batas administrasi di Kota Surabaya, tetapi karena pada bulan Oktober ada user yang menghapus admin_center Surabaya, saya akan memperbaikinya.
Saya juga sudah melihat di wilayah Denpasar, Anda mengupload Batas Kecamatan Kota Denpasar, dan saya lihat Anda juga tidak membuat artikel mengenai Import Data batas tersebut. Kalau Anda belum tahu bagaimana cara melakukan import data, silahkan pelajari disini Import Guidelines.
Ada beberapa jalan yang penamaannya tidak ditambahkan kata “Jalan” dan area militer tidak boleh dipetakan. Jika Anda menggunakan “validation tools” pada wilayah good example di Denpasar, masih terdapat banyak warning and error.
Sebelum kami melakukan kegiatan PDC Surabaya, saya telah melakukan perhitungan statistik dan melihat data-data yang sudah dipetakan di Kota Surabaya, dan kami tidak pernah melakukan perusakan data, kami menambahkan informasi tersebut dengan survey lapang yang dilakukan oleh 16 orang surveyor dari Bulan Oktober 2016 - Februari 2017. Sebelum mereka pergi ke lapang, mereka kami berikan pelatihan OpenStreetMap, kami melakukan pemetaan di Surabaya bukan sepenuhnya hasil dari Mapathon. Mapathon ITS hanya dilakukan 3 hari, dan hasil pemetaannya lainnya didigitasi oleh 16 surveyor yang telah berpengalaman, kemudian kami melakukan survey lapang untuk melengkapi objek-objek penting yang telah disepakati. Setelah data-data tersebut di upload ke dalam OSM, data tersebut di validasi oleh 4 orang Quality Assurance.
Terimakasih Anda telah memperbaiki beberapa data yang ada di Surabaya, untuk menghindari konflik data, saya mohon Anda tidak mengedit data tersebut karena ini terkait dengan project yang kami lakukan. Jika terdapat kesalahan, Anda dapat mengirimkan email ke saya.
Terimakasih Dewi dewi.sulistioningrum@hotosm.org Mapping Supervisor PDC Surabaya
Comment from everyone_sinks_starco on 11 January 2017 at 09:25
^^ Nah penjelasan kedua ini juga saya mengerti.
Ngomong-ngomong soal mengapa batas administrasi dibuat bukan melalui import guidelines, masalahnya sederhana, ribet. Belum tahu dimana saya akan mendapatkan datanya karena keterbatasan kontak dan keterampilan untuk membuat data-data tersebut. Mungkin di Pemkot ada tetapi masalah yang ada adalah komunikasi saja.
Untuk batas administrasi kota Denpasar, sumber yang saya sadur berasal dari situs Pemkot Denpasar. Data tersebut memang bersifat domain umum, tapi belum 100 persen benar (masih memakai referensi visual).
Soal error penamaan jalan raya, nanti bisa dikerjakan selepas ini.
Sekian penjelasan dari saya, jadi mohon maaf bila atas konflik data kemarin, dan terlambat reply karena kesibukan real-life.
== Everyone Sinks Starco ==
Comment from everyone_sinks_starco on 11 January 2017 at 09:30
Tambahan: untuk kawasan militer masih tergolong “umum” di sebagian lokasi karena situasi di dunia nyata. Jalannya masih boleh dimasuki orang biasa, sementara satu contoh lain sudah tidak boleh (tidak untuk umum). Dan sebenarnya boleh dipetakan asal tidak menyebut fasilitasnya.
Comment from Dewi Sulistioningrum on 11 January 2017 at 12:55
Segala objek yang diupload ke dalam OSM yang bukan bersumber dari citra satelit, survey lapang dan knowledge, itu dinamakan Import Data. Jadi sangat penting untuk mengikuti peraturan OSM yang telah ada, agar tidak menimbulkan kesalahan dalam upload dan memastikan bahwa data tersebut memiliki lisensi ODBL. Batas administrasi terutama di Indonesia merupakan hal yang sangat penting dan objek kritis untuk dipetakan.
Peraturan import data memang dibuat untuk ribet, agar mapper OSM tidak sembarangan memasukkan data yang belum jelas sumber datanya dan metode apa yang digunakan, karena setelah data tersebut terupload, semua orang dapat mengunduh data OSM dengan mudah. Jadi saran saya, jika Anda tidak bisa memenuhi peraturan mengenai Import Data OSM, sebaiknya dihapus saja batas administrasi di Denpasar.
Salam
Dewi Sulistioningrum
Comment from everyone_sinks_starco on 11 January 2017 at 13:08
Mungkin bisa dijabarkan cara-cara importasi data yang baik dan benar dalam bahasa Indonesia? Tadi saya sudah baca prosedurnya tetapi yang saya khawatirkan adalah salah prosedur. Beberapa bulan yang lalu saya menerima data peta administratif Kabupaten Karangasem tetapi sayangnya tidak sesuai dengan saya harapkan (data bisa di-import tetapi yang diberikan bukan dalam bentuk yang diharapkan (shapefile), tetapi dalam bentuk image), walaupun data tersebut merupakan domain publik (digarap pemerintah).
Menurut saya impor data lebih gampang dilakukan di akhir ketimbang di awal. Untuk batas kodya Denpasar sih, kalau memang memungkinkan sih, mungkin terserah mbaknya. Datanya masih tentatif, sementara, jadi saya agak mengambil risiko ketidaktepatan data ketimbang tidak ada.
== Everyone Sinks Starco == == PM aja buat lanjutannya biar ga kepenuhan ==