mapping icon indicating copy to clipboard operation
mapping copied to clipboard

[Netherlands] Reviewing osmlint-osmium and osmlint data issues

Open vladaboitsik opened this issue 5 years ago • 18 comments

Background

As part of on-going work to improve the quality of OpenStreetMap data, we recently used osmlint-osmium and osmlint for detecting issues related to road network data in Netherlands. In total, there were 2432 issues detected across 10 types of linters. Here ypu can find our page in OSM Wiki

Timeframe

We plan to start reviewing detected issues by the end of next week, and editing OpenStreetMap data to fix valid issues.

Tools

We will use existing OpenStreetMap editing tools, and using the #hashtag mbx_netherlands_roads

Editor: iD or JOSM Satellite Imagery: Bing, Maxar, Esri Street Level Imagery: Mapillary, Other open sources if available

Contact Person

We welcome feedback, suggestions, and insights from local mappers. If you have questions about this work, or a specific edit by our team, please reach out to Natalia at Natallia ([email protected]) or post a comment in a changeset.

Linter Output

Issue Netherlands Total Data
Crossing Highways 370 crossinghighways.geojson.zip
Missing Role 54 tr-missingroletr.geojson.zip
Impossible Angle 45 impossibleangle.geojson.zip
Impossible Oneways 356 impossibleoneways.geojson.zip
Island Highways 206 islandshighways.geojson.zip
Mixed Layer 21 mixedlayer.geojson.zip
Missing Type Restriction 14 tr-missingtyperestrictiontr.geojson.zip
Excessive Roles 12 tr-excessiverolestr.geojson.zip
Invalid Roles 15 tr-invalidroletr.geojson.zip
Crossing Highways Buildings 1339 crossinghighwaysbuildings.geojson.zip

Examples

Impossible angle or what we usually call “dragged node”. Link to example you can find here

изображение

Also found unconnected roads. To be routable, they should be connected into the road network. You can find example here

изображение

And here

изображение

@legain @Andygol @abrohood @shvrm

vladaboitsik avatar Oct 12 '20 13:10 vladaboitsik

For Crossing Highways Buildings you may want to exclude situations where the crossing highway and building already have a different layer.

SanderH avatar Oct 12 '20 15:10 SanderH

False Positives: Impossible Oneways

Terminating on valid entrances

Way 755626484, and similar:

When a oneway way terminates on a node with entrance tagging, then it is not an impossible oneway. In this case the node is a parking garage entrance (amenity=parking_entrance). This is valid.

Another one: this one terminates on entrance=yes, which is fine if the inside path is not known or simply not drawn.

jdhoek avatar Oct 12 '20 16:10 jdhoek

Crossing Highways Buildings

This geojson looks incomplete. It is possible the rest of the country doesn't have any warnings, but statistically unlikely.

incomplete-crossing

jdhoek avatar Oct 12 '20 17:10 jdhoek

False positives: Island Highways

If a way has access=no|private like here, then ignore it.

This one is connected though: to an aeroway=taxiway. Good enough for the local air force.

Weird though. Your linter is not picking up this one. Also valid and an island.

Isolated bridges may mean that the ways leading up to them are unknown, or are not mappable. This is common with agricultural tracks crossing streams. For boats and other water-based transport classes these bridges are useful to know of, even though they are not connected to the grid. You are correctly ignoring this one, but trigger on this one. Is the highway class used as well?

jdhoek avatar Oct 12 '20 17:10 jdhoek

Invalid Roles

All positives. I think I fixed them all.

jdhoek avatar Oct 12 '20 17:10 jdhoek

I looked at a few crossing ways (but did not fix them yet)

  • _fromWay=6580066 _toWay=847219233: Footpath that is in reality in an underpass. However, is has no tunnel=yes nor layer=-1 on it.
  • _fromWay=844520775_toWay=6578188: service road and footway cross in node 7237680991 - I don't see what's wrong here
  • _fromWay=849596141_toWay=849596138: path and track cross without node. Node should be added
  • _fromWay=9384097 _toWay=439934173: Overpass does have bridge=yes but no layer=1.
  • _fromWay=115092546 _toWay=368047826: Dragged node near here. (Funnily, I walked here today)
  • _fromWay=386499111 _toWay=32571464: Tunnel but without layer=-1 on this footway
  • _fromWay=7375104 _toWay=518815429 Dragged node
  • _fromWay=841744724 _toWay=730040112 & _toWay=776264047 Just no connecting nodes -_fromWay=59741855 & _fromWay=81782103 _toWay=757690385 upper way (twice) has no bridge=viaduct nor layer=1
  • _fromWay=106357515 _toWay=60465269 & _toWay=7392129 overpass footway has bridge=yes but no layer=1

Just to name a few. Is this helpful?

IIVQ avatar Oct 12 '20 18:10 IIVQ

Thanks a lot to everyone who took part in reviewing linters results! In the near future we are going to review it again and continue our activity in the Netherlands. When we download new json files, they'll be posted here.

vladaboitsik avatar Jan 21 '21 09:01 vladaboitsik

Our team is going to continue to review linters results in Netherlands soon. There were 874 issues detected across 9types of linters. Json files could be found below in the table.

Issue Netherlands Total Data
Crossing Highways 302 crossinghighways.zip
Crossing Highway Bridges 5 crossinghighwaysbridges.zip
Missing Role 45 missingroletr.zip
Impossible Angle 12 impossibleangle.zip
Impossible Oneways 295 impossibleoneways.zip
Island Highways 178 islandshighways.zip
Mixed Layer 16 mixedlayer.zip
Missing Type Restriction 15 missingtyperestrictiontr.zip
Invalid Roles 6 invalidroletr.zip

Your questions and feedback are welcomed!

vladaboitsik avatar Jan 25 '21 10:01 vladaboitsik

You could make use of dutch aerial photos: https://www.beeldmateriaal.nl/ Available via PDOK: https://www.pdok.nl/introductie/-/article/luchtfoto-pdok

JohnProv avatar Jan 25 '21 12:01 JohnProv

@jdhoek Thank you!

vladaboitsik avatar Jan 25 '21 13:01 vladaboitsik

The links to the linter data files above are all broken or not viewable by people outside of your organisation.

jdhoek avatar Jan 25 '21 13:01 jdhoek

@jdhoek sorry, now it should works.

vladaboitsik avatar Jan 25 '21 14:01 vladaboitsik

Our team finished review of all detected issues, that's why for this moment this ticket is closed. If we're going to review one more time, we'll announce it for community first.

vladaboitsik avatar Feb 01 '21 11:02 vladaboitsik

Netherlands is reviewed on permanent bases from the start of September. Once a week there's a upload of data and team close these issues.

For 2 weeks we reviewed 203 items and fixed 122 of them.

Screenshot from 2021-10-05 12-15-41

We'll continue our work and will update this ticket with metrics about our fixes.

sonyahilchik avatar Oct 05 '21 09:10 sonyahilchik

For October the team reviewed 231 items and fixed 58.44% from them.

Screenshot 2021-11-25 at 14 21 08

We'll continue our work and will update this ticket with metrics about our fixes.

sonyahilchik avatar Nov 25 '21 13:11 sonyahilchik

For November the team reviewed 305 items and fixed 68.44% from them.

Screenshot 2021-12-07 at 14 23 18

sonyahilchik avatar Dec 10 '21 08:12 sonyahilchik

@sbelemey Editors and PDOK have 7.5cm imagery available since last year. You can also use Esri's 'enhanced' imagery (essentially the same imagery with some filters applied) which should be available in most places, though on some zoom levels may show older imagery (so be careful).

(Edit: assumed vladaboitsik was still active, seems to not be the case)

danieldegroot2 avatar Apr 26 '22 10:04 danieldegroot2

Hello, @danieldegroot2! thanks for information! We mostly use PDOK satellite for mapping in Netherlands.

Best regards, Sergey

sbelemey avatar Apr 26 '22 13:04 sbelemey