@dcoderlt I worked on USA medical contract data dumps. Terabytes of JSON files, linked one to another, cannot keep everything in memory but need to do lookups. Have to do streaming parsing and caching, ugh. Malicious compliance at its best (government mandated these dumps, nobody wanted to release their data, so they made it as hard to parse as possible).
Rytis Slatkevičius
@rytiss@mastodon.social