Piero Bosio Social Web Site Personale

@Notme @ISibboI We are not unique in battling these scrapers; Wikipedia, KDE, Gnome, OpenWRT, Arch Linux and many other projects have the some issue.

@Air_Quotes_Comedian Weird. We don't require login for directions.

@gme Anubis is great, but not ideal for us. We have reasonable technical mitigations in place, but it is unfortunately an arms race (and time/resource blackhole)

@Don_Clemente Just dumb scrapers. They want our data, so maybe we /should/ redirect them to the latest full history planet file, it is only 245GB ;-)

@justin No. Background: https://diff.wikimedia.org/2025/04/01/how-crawlers-impact-the-operations-of-the-wikimedia-projects/ and https://cloud.google.com/blog/topics/threat-intelligence/disrupting-largest-residential-proxy-network

@geospacedman @ISibboI They are scraping the website pages: /ways/, /nodes/ and /relations/. All this data is published on planet.osm.org already.

@ISibboI Correct. Not an ounce of brain. It has been going on for months, but it is just getting worse. Waste of their resources/time and ours.

https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

We need YOUR help! 🫵

Are you maintaining (or have you spotted) a website / app using old or incorrect tile.openstreetmap.org tile URLs? There are tens of thousands out there, and they need to be updated.

Please check your projects, shared examples, and help us fix them: https://github.com/openstreetmap/operations/issues/737 ❤️🗺️🌐