osmph / papercut_fix Goto Github PK
View Code? Open in Web Editor NEWTracking data fixing requests for the OSMPH community
Tracking data fixing requests for the OSMPH community
I just discovered that the previously blocked user "Joey Samson" are again vandalizing the map with non-existent or speculative edits related to planned LRT lines. I just undid his latest edit that added a fake LRT-1 station (https://www.openstreetmap.org/changeset/58882760#map=16/14.5893/120.9824) and warned him. I think he should be blocked longer than the previous one.
Modus operandi of user (and sock puppets):
Kindly fix Tarlac's borders to include the town of Anao (erroneously located within Nueva Ecija):
http://www.openstreetmap.org/node/198510040#map=13/15.7327/120.6517
Thanks.
Related: #12
EAA22 has been noted adding landuse=residential
to buildings in Batangas City.
I left a comment in one change set, and sent a private message but there has been no response. Mapper continued to edit. I tried reaching out to local contacts, but failed to find someone who know anyone from the Batangas City Planning and Development Office.
The Batangas CPDO Mappers are the same group reported in #12
@maning 's suggestion is to revert, but I suggest we defer until next week, to give them time to respond to attempts to contact.
Kindly leave for comments in changesets, and send DMs.
Quick overview of the project. Specific tasks will be prepared soon
The armed conflict in Marawi City, Lanao Del Sur started on May 23, 2017 between terrorist groups and Government troops. After five months of fighting, the Government has officially announced today the end of all military operations. This conflict has 359,000 people and has left the city heavily damaged and destroyed particularly inside the main battle area. As OSM volunteers we have seen how our efforts have been useful and helpful during a crisis. In the case of the case of the war Marawi, we could help out in digiziting satellite imagery and provide maps that will support Government, NGO’s, Aid organizations and other related groups in their work that is focused on the assistance of its residents and in the recovery, reconstruction and rehabilitation of Marawi City.
Complile list of areas in the Philippines where DigiGlobe is not aligned with Bing.
It doesn't mean DigiGlobe is wrong, only that it needs to be verified
I noticed these guest houses added by the user Rodrigo Domanico, which are unusual for their locations (outside of urban and/or tourist sites) and frequency, and usually tagged with names of individuals.
Could be a salesperson adding prospects? I left a comment in one recent changeset, but the user is on maps.me.
Overpass Turbo: http://overpass-turbo.eu/s/rlo
Continuing from #13.
Update: new workflow.
10K overlapping/crossing buildings as of March, 2018
Using OSMLint, we found 10K overlapping buildings in the Philippines. 😱 I created a maproulette task to fix this. We need everyone to help!
Shift + V
).Fixed crossing/overlapping buildings. https://github.com/OSMPH/papercut_fix/issues/43
. Changeset source: OSMLint; Maproulette
Status
Date | N (% change) | Tasks (% change) | ⏹ (1k items) |
---|---|---|---|
2018-03-24 | 10,513 | 3,560 | ⏹⏹⏹⏹⏹⏹⏹⏹⏹⏹ |
2018-05-06 | 7,672 (-25.34 %) | 3,299 (-7.33%) | ⏹ ⏹⏹⏹⏹⏹⏹⏹ |
2018-05-28 | 7,619 (-0.69 %) | 3,209 (-2.73%) | ⏹⏹⏹⏹⏹⏹⏹⏹ |
I've noticed that webwires' "rewiring" of Metro Manila, Cavite, Iloilo and Capiz left a significant mess, specifically the deletion of important POIs such as bus stops and mangling of highways and public transit data. A set of reverts have been done in December 2017, but are mostly focused on road routing and admin boundaries if I'm not mistaken.
Please take note that the user in question is deleting and recreating data (shown here), which is a very bad practice.
As expected with the release of a new version of the game, there are a flurry of new "parks" being added around. Here are some Overpass Turbo queries to try
I've gotten into an unproductive edit skirmish, so I'm withholding edits for now, but so far has found these "parks":
Some suspicious change sets that needs to be reviewed
A user named "Panko kale Ty" added false information on the map connected to radio stations and shopping malls (see his list of changesets here). He is suspected of being a permanently banned Wikipedia user based on his editing patterns, who is known for using sockpuppet accounts to evade bans and blocks.
TODO:
delete and rollback edits (modify edits to reflect accurate information, if necessary)
Areas that he edited
I've reverted his edits except in Isabela and Nueva Vizcaya.
This was first reported in #33 , but now I have details from sheinna, one of the mappers:
Unfortunately, we may have to revert or redact the data
"Hello again, Jehovah's Witnesses do not use the "cross". So please set the category of ALL KINGDOM HALLs to 'Place of Worship'. Some of us JWs who uses this app, would really appreciate it. Thank you~"
Note 1334752
The commenter appears to be using Maps.Me, and the app may have been rendering the POI differently. On OSM carto, errors are likely due to missing or typos in the denomination tag.
A user got in touch privately, requesting for help in validating the following changesets:
As usual, I advised them to file a ticket via Papercut-fix, instead of reporting this issues directly to fellow contributors. They haven't seem to have gotten around doing it so I'm filing this myself because of the potential concerns that may arise from the issues they reported.
Hello. May I please request your help. I had recently tried uploading in JOSM a changeset containing about 8,900 objects using 1 request. The uploading dialog was on display for several minutes and never confirmed the upload as successful. Impatient, I cancelled the upload. To verify if the upload was not done, I checked OpenStreetMap History under Boston, Davao Oriental area to see my changeset uploaded:
http://www.openstreetmap.org/changeset/51213250
But I was suspicious it might have contained errors since I had cancelled the upload. So I tried updating the data in JOSM and reuploading the changeset using 2 requests:
http://www.openstreetmap.org/changeset/51214187 http://www.openstreetmap.org/changeset/51214266
Upon updating the area in JOSM, there were several conflicts detected especially duplicate nodes and ways. I tried using applying 'Fix' using the Validator. The conflicts, however, which numbered to about 1,900, were still present and I could not upload the fixes applied.
https://www.openstreetmap.org/changeset/57385006
Reported by: TagaSanPedroAko
Issue: New mapper re-tagged highways in the AOI as trunk. Changeset comment indicated it's for their "thesis"
Action: Full revert. See https://www.openstreetmap.org/changeset/57404911
Left a comment to the mapper, and encouraged them to use the development servers to play with OSM data instead.
Many farm "irrigation canals" are currently tagged as [canal]. "Canal" in its strict definition should be wide enough to be passable by ships. Some are tagged as [drain], which is too vague since all waterways drain water. We should most likely use [ditch] for such irrigation canals, whether cemented or not.
This user, "Lian Spurgeon Las Pinas has been mass editing mall expansions around Metro Manila, mostly unverified ones, resulting to the deletion of numerous features that still exist on the ground until proven otherwise on the ground. I already commented on the user's edits, but the user seems to be not willing to explain anything, including sources. A closer look on one deleted building beside SM City Manila seems to raise an alarm the user is a sock of "Joey Samson", which has been involved in similar vandalism activity, mostly dealing with future or hypothetical real estate projects which has not been verified or just plain fantasy. I already reported "Lian Spurgeon Las Pinas" to the Data Working Group, citing possible evidence of sockpuppetry.
See http://osm.org/go/4sduuOLqh-?layers=N&m=
Many POIs names in this area are capitalized. Sent the mapper a welcome message, and mapper has responded positively; that he'll edit them again, soon.
From my recent trip in Cordillera, I found out that Chico River and its tributaries needs a lot of data improvements. Chico River is an important river to the struggles of the Kalinga people. The main river channel was initially mapped from low-resolution Landsat imagery, new imagery is now available from various sources.
This task aims to improve the data in OpenStreetMap by mapping:
waterway=river
way and the riverbank as waterway=riverbank
.To dos
way
relation
Reference overpass query
Most of these Bottled/Mineral/Purified Water shops may be currently tagged incorrectly as :
amenity=drinking_water
amenity=water_point
shop=beverages
shop=purified_water
shop=water_refilling
These objects will be retrieved via Overpass Turbo, and reviewed individually, and replaced with shop=water
, as appropriate.
The appropriate entry in the local convention page has been updated.
According to this Overpass Turbo query, there are over 100 nodes in the country that uses this tag to indicate a crossing or road junction to orient people about turn offs for navigation.
These nodes are currently placed along or near these intersections, but are not on the actual node that connects the ways.
Reviewing the wiki, I found that a more appropriate tag is available: junction=yes
.
I've contacted the user who made these edits, and requested he consider editing and updating these tags.
This Overpass Turbo query https://overpass-turbo.eu/s/sME retrieves objects tagged with, for review:
tourism=artwork
tourism=attraction
tourism=guest_house
tourism=viewpoint
historic=castle
amenity=shelter
View regional summary counts using this query https://overpass-turbo.eu/s/sMF
For reference, add this to the changeset comment, https://git.io/vFCea
Btw, query returns all edits tagged as such, not necessarily just MapsWithMe/Maps.Me user edits.
Kindly, review (and edit, where necessary) the objects. Very often, the objects had been tagged incorrectly (many, street/place names).
As of the following date, the database had:
The contributors efforts are appreciated but sadly, their app doesn't have any way to send feedback to them to help them learn tag correctly.
Check out top tags used by Maps With Me users in the Philippines :
For many users of this app, the viewpoint and artwork tag is being misused to represent POIs not found in the default tags they support.
I placed a request to cleanup data in Batangas City after several users made mass editing around the city, whicn touched existing data, like renaming of several POIs and named buildings to the building type "commercial", added building types (i.e. commercial and residential, or any variant) and POI names as names on buildings (which only clutters the map), added redundant tags to buildings or converted them to landuse, and added redundant/capitalized tags (i.e. Classification, Education) to schools, colleges, and universities. The users also made also significant mapping in rural areas, which I do not have to worry about, but they require cleanup, especially schools and day care centers, which may contain the capitalized or redundant tags "Classification" and "Education".
All the mapping seems to be done only at weekdays, except on holidays, and it was presumably some mapping led by the City Government of Batangas, that I look at many users who mass edited Batangas City as city government employees. I messaged them or commented on their changesets to disclose their editing background, but they still do not reply.
I laid out tasks to clean up data around Batangas City, which will involve close inspection of new edits to ensure they do not damage existing data or cause clutter and manual revert of past edits found to damage data or cause clutter. Original details for the cleanup task is found at this email in the talk-ph mailing list
We have ~2k unmapped villages in OSM. Let's improve these areas! I'm still specc'ing a workflow, collecting ideas here.
There are contributors adding extra strings (usually their names) to the feature names.
This user, "MembersOnly", are seen making fantasy edits in the pattern of "bryanpiczon", and is again causing troublesome edits. Some fake edits by "MembersOnly" I reverted include an addition of a fake island near Catbalogan, and adding a fake connection of HVDC Leyte-Luzon to a 69,000 volt line and Bac-Man Geothermal Power Plant. Please keep a monitor of that user, and revert any edit that we must believe to be fake.
Why should we remove imagery boundaries in OSM:
To edit:
Remove imagery boundaries. https://github.com/OSMPH/papercut_fix/issues/6
The following accounts are associated with single user adding fantasy edits.
Next steps
References
Post-war imagery on the main battle area has been made available through WESTMINCOM as requested by @schadow1 . However publishing requires declassification from the Intelligence Services, Armed Forces of the Philippines (ISAFP). Schadow1 Expeditions already possesses the imagery dated 2017-11-09 for building status classification purposes only. However publishing to the web as imagery for high resolution public/limited view tracing has been halted prior clearance from ISAFP.
Building classification has been initiated through Schadow1 Expeditions and is available for download in ODbL.
Aftermath of the Battle of Marawi
The town of Kumalarang is currently covered by Zamboanga Sibugay's borders. Kindly fix Zamboanga del Sur's borders to include Kumalarang:
http://www.openstreetmap.org/#map=12/7.7656/123.1643
Thanks.
We have lots of recent, and much improved imagery thanks to the recent availability of DigitalGlobe for tracing into OSM.
To help make better data (and maps), let's make the most out of the Imagery Offset Database
If you're also utilizing the DigitalGlobe imagery, you may sometimes notice alignment issues. If you're using JOSM, one thing you can do is to align DigitalGlobe with Bing, and store the offsets to the Imagery Offsets Database - this would allow us to have a (more or less) standard alignment settings for future use.
The plugin lets you open a custom URL in default browser (default shortcut: SHIFT+H) with data from selected node or location of center of the screen.
In settings to preferences/utilsplugin2-tab or customurls.txt in JOSM folder, add an entry:
Name | URL |
---|---|
Nominatim |
http://nominatim.openstreetmap.org/reverse?format=xml&lat={#lat}&lon={#lon}&zoom=13&addressdetails=0 |
Please read the Imagery offset quickstart on how to use, and align imagery using this tool.
The browser will display local information about the area:
You may copy the display name "Holy Spirit, Kapalaran Su…etro Manila, Philippines"
and use value when storing the offset to the database:
And you're done!
31K overlapping/crossing buildings as of May 05, 2017
Using OSMLint, we found 31K overlapping buildings in the Philippines. 😱 I created a tofix task to fix this. We need everyone to help!
Fixed crossing/overlapping buildings. https://github.com/OSMPH/papercut_fix/issues/13
. Changeset source: OSMLint, Tofix
Has anyone noticed recent edits in Los Baños with the following (incomplete) tags:
repair=*
material=*
level=*
There appears to be an organized mapping effort out of UPLB? Check it out on OSMCha.
A user named "John Castillo Soberano", presumably the same user as "Panko kale Ty" added false information on the map connected to radio stations (see a list of changesets OSM history, OSMCha). Similar to the Panko Kale Ty account, it is suspected of being a permanently banned Wikipedia user based on editing patterns, who is known for using sockpuppet accounts to evade bans and blocks.
TODO:
Areas that the user edited
^^ from talk-ph
Tools to use:
Tags to use on hospital grounds:
name=*
amenity=hospital
healthcare=hospital
The buildings are to be tagged as:
building=hospital
building:levels=*
The old amenity=hospital
tag is still valid, and widely used. Recently, more specific tags has been accepted for use: healthcare=hospital
The town of Laak is erroneously located within Davao del Norte's borders, instead of Compostela Valley:
http://www.openstreetmap.org/node/198492714#map=10/7.7294/125.9129
Kindly fix Compostela Valley's borders to include Laak.
Thanks.
I've been working through some unresolved notes in PH, mostly notes left by anonymous users that are still open 6 months after they've been opened.
You can find details here: Stats about added OpenStreetMap Notes for Philippines
. There's a curious jump in the use of notes back in August, which I'll also look into later.
The template comment I leave recommends the use of YAPIS or On OSM. The former requires an OSM account, the latter leaves anonymous notes on OSM.
Hi there. Thank you for your helping make OpenStreetMap(OSM) better.
You may use YAPIS for a step-by-step guide to adding details yourself. By doing so, the feature is added directly to the map, instead of just leaving a note for other mappers to work on. You will need an OSM account to complete the process.
We encourage you to register for a free account, but if you don't want that, you may still leave the details using On OSM and let other mappers add them for you. However, we couldn't make guarantees about how soon those details will get on the map.
Regards,
Thoughts? Comments or suggestions?
In recent edits in Batangas City, supposedly an LGU-led effort, I noticed they were tagging barangay halls as:
name=*
office=government
See this comment I left in one of the change sets.
name=*
amenity=townhall
townhall:type=village
In addition to the basic tags, the following are tags are recommended to be added
is_in:*=* (or addr:*=*)
contact:*=*
building=public
building:levels=*
office=government
government=administrative
admin_level=10
name=Bacong Barangay Hall
amenity=townhall
townhall:type=village
is_in:hamlet=Lusbak
is_in:province=Bohol
is_in:town=Anda
is_in:village=Bacong
building=public
building:levels=2
office=government
government=administrative
admin_level=10
Use a closed way to digitize the building where possible. If not, use a node.
Are there objections to this?
I noticed intentional vandalism in this change set: https://www.openstreetmap.org/changeset/58367651
Could someone review this, and their other edits?
P.S.
I'm away from my desk. Will review when I get back, asap.
Issue raised by Maning in Telegram.
I left a few changeset comments, but I'm fixing this now without waiting for a response from the editor.
For reference, the OSM policy regarding private information: Limitations on mapping private information
Major concerns about these edits:
Other concerns:
Overpass Turbo query for edits in the last 7 days in this particular area.
Fix all POIs known (based on name) as funerary homes, and fix any mis-tags.
The correct tag is shop=funeral_directors
but some objects are mapped as tourism=museum
😮 , amenity=funeral_home
, shop=butcher
, historic=memorial
, etc.
The following Overpass Turbo query is used to find these objects:
// fetch area “Philippines” to search in
{{geocodeArea:Philippines}}->.searchArea;
// gather results
(
// query part for: “name~/funeral/i”
node["name"~"funeral",i](area.searchArea);
way["name"~"funeral",i](area.searchArea););
// print results
out body;
>;
out skel qt;
After downloading the data in JOSM, objects are reviewed individually and updated accordingly.
ThreeSixty Pharmacy is a popular drugstore/convenience store hybrid chain in the Visayas region. They are often erroneously tagged as "360 Pharmacy."
Overpass Turbo query to retrieve the data.
Here's how a typical outlet looks like:
OSM changeset hashtag: https://git.io/vFyp0
@maning and other previously traced roads from public domain 1:250K Topographic Maps. Let's improve the data from Bing imagery.
Bing
.Improve roads from previously traced 1:250K topographic maps. See: https://github.com/OSMPH/papercut_fix/issues/5
This seems to be a new user, but there are problems regarding his edits. This user has deleted many significant features around the Molino area in Bacoor, and the Ecological Park (and St. Jerome Emiliani Institute?) are now gone. Please keep an eye for his edits, and revert any changeset that are deemed harmful because it is a mass deletion without a detailed explanation or rationale. The edits by this user are marked for review, so we can catch up with those if we can.
Kindly review the following changesets, and roll-back if appropriate. Tick the checkbox for each changeset when you've completed the review process, and if necessary any roll-back action.
Hello. I have noticed that for a long time, the borders of Pampanga province doesn't (fully) include the municipalities of Macabebe and Masantol situated to the southeast near Manila Bay. Here is the link to a note I added. The river appears to be the border between Pampanga and Bulacan. In fact, the Consuelo village nearby is tagged as located within Masantol:
https://www.openstreetmap.org/?mlat=14.8330&mlon=120.6797#map=12/14.8331/120.6797&layers=N
If you have time, could you please fix those borders? Thank you.
I did a quick 👓 ball of all existing pre-conflict 🛰️ imagery available. DG Standard wins. Although there are clouldy areas south of main city, this can be complemented by using DG Premium or ESRI. Alignment for all images is slightly different but ~<5 meters.
For all pre-conflict mapping I propose we use DG Standard. Another pass of review welcome!
Location: https://www.openstreetmap.org/edit?editor=id#map=15/7.9965/124.2958
Alignment from existing GPX
Recency based on building changes
According to this query, we have Philippine data in OSM that's attributed to Google. The Legal FAQ states that we cannot trace from these sources.
Loaded – nodes: 3574, ways: 31, relations: 0
@maning proposed course of action:
For reference, data from this query is available as a gist.
#As part of a proposed revision of Philippine road classification system ([further details at this WikiProject Philippines subpage on the OSM Wiki), I already started reclassification of many sub-national roads in parts of the Philippines, starting in La Union and Batangas.
The quick guide for classification is:
The new classification system ("Philippines v2") will now consider official designation as the factor, but other factors, particularly usage/importance and physical features will remain part of the possible road class to select. Consistency must be also considered in classifying roads. and proportionality must be considered also when selection the best classification.
This planned road reclassification will be mostly prioritized on provinces (or areas of) where the road system is badly mapped.
Could someone help with reviewing the edits made by ErnieSarayno? Mapper is new, and I don't think they were intentionally made wrong.
Most of these edits were made more than 3 months ago, affecting mature and major features (5869 nodes, 174 ways), but significant issues include duplicate highways, and use of descriptive names (i.e., "Maasim to Kiamba Highway".)
Overlapping "Maasim to Kiamba Highway" drawn over the mature feature "National Highway" using a different highway tag.
Their edits on OSMCha.
Overpass Turbo query of their edits: https://overpass-turbo.eu/s/sSE
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.