A coworker recently sent me an 8GB
Uncategorized
2
Posts
2
Posters
0
Views
-
A coworker recently sent me an 8GB .json with a phpmyadmin export of a DB dump.
And more than 4GB of it were tables I did not need. Oof.
-
undefined oblomov@sociale.network shared this topic
-
A coworker recently sent me an 8GB .json with a phpmyadmin export of a DB dump.
And more than 4GB of it were tables I did not need. Oof.
@dcoderlt I worked on USA medical contract data dumps. Terabytes of JSON files, linked one to another, cannot keep everything in memory but need to do lookups. Have to do streaming parsing and caching, ugh. Malicious compliance at its best (government mandated these dumps, nobody wanted to release their data, so they made it as hard to parse as possible).