Frequently /me [from DE] thinks about #Datensparsamkeit
-
Frequently /me [from DE] thinks about #Datensparsamkeit
The officially best [en] explainer is
https://martinfowler.com/bliki/Datensparsamkeit.html
@mfowlerI became a Carteret Islands person once.
Looking at my shell neclace.My wish for christmas is that you read it and carefully think about all the things you publish in terms of accessibility but also formats and size.
An example:
For @clemensg I did the yearly #ActivityPub #Atlas -
it comes with millions and millions of geohashed places for OSM, wikidata, official sources and, well openaddresses [.io]They publish primarily in texts with lines of geojson.
The whole planet is about 46 GB … … …An exmple:
DE in this "format" is about 3.2 GB
DE in CSV would be maybe 1.5 GBIf we normalize and publish it compressed, it is [incl geohashes] about 800MB.
If we now compress the geohashes, expanding it clientside the3.2 GB becomes
250 MB …Maybe we can't save tons of powerplants like banning bitcoin would.
But together we can save lots of energy.
#geojson 💣 -
System moved this topic from General Discussion