Salta al contenuto

Piero Bosio Social Web Site Personale Logo Fediverso

Social Forum federato con il resto del mondo. Non contano le istanze, contano le persone

Ciao @stefano!

Senza categoria
4 2 0
  • Ciao @stefano! There where a lot of discussions about S3 storage solutions for FreeBSD. @dexter mentioned that you choose SeaweedFS for „reasons“. Can you tell a little bit about it and why not Garage or MinIO?

  • Ciao @stefano! There where a lot of discussions about S3 storage solutions for FreeBSD. @dexter mentioned that you choose SeaweedFS for „reasons“. Can you tell a little bit about it and why not Garage or MinIO?

    @hackacad @dexter Hi Sven! Sure: initially I started managing the BSD Cafe's Mastodon media storage using Minio inside a FreeBSD jail on a server with traditional disks. When the media grew to around 200 GB (and it's a lot of small files), I realized that the performance wasn't great, so I decided to try both Garage and SeaweedFS. I set up two identical jails on the same host, one with Garage and the other with SeaweedFS, then I started copying the existing media using rclone, from one jail to the other, starting with Garage. Initially, everything was fine, but I realized that at around 60 GB, Garage started to fully utilize the machine's 6 cores and slow down noticeably. I left it running all night anyway, but in the morning it had copied just over another 10 GB. I stopped the process. I performed the same operation on SeaweedFS and the copy went smoothly and without issues until the end, at full performance. The approach of creating volumes and small external index files with offsets is decidedly suitable for this type of use. I tried some more times - same result. It has been up and running for a few months now without any problems. Furthermore, its modular structure allows you to replicate everything (for disaster recovery, backup, etc.) in "almost" real-time: you can connect a filer from one SeaweedFS setup to another (completely separate) and it will begin to replicate everything that is present and stay in sync. For this reason, I decided to continue using it and have implemented the same setup for the illumos Cafe as well.

  • @hackacad @dexter Hi Sven! Sure: initially I started managing the BSD Cafe's Mastodon media storage using Minio inside a FreeBSD jail on a server with traditional disks. When the media grew to around 200 GB (and it's a lot of small files), I realized that the performance wasn't great, so I decided to try both Garage and SeaweedFS. I set up two identical jails on the same host, one with Garage and the other with SeaweedFS, then I started copying the existing media using rclone, from one jail to the other, starting with Garage. Initially, everything was fine, but I realized that at around 60 GB, Garage started to fully utilize the machine's 6 cores and slow down noticeably. I left it running all night anyway, but in the morning it had copied just over another 10 GB. I stopped the process. I performed the same operation on SeaweedFS and the copy went smoothly and without issues until the end, at full performance. The approach of creating volumes and small external index files with offsets is decidedly suitable for this type of use. I tried some more times - same result. It has been up and running for a few months now without any problems. Furthermore, its modular structure allows you to replicate everything (for disaster recovery, backup, etc.) in "almost" real-time: you can connect a filer from one SeaweedFS setup to another (completely separate) and it will begin to replicate everything that is present and stay in sync. For this reason, I decided to continue using it and have implemented the same setup for the illumos Cafe as well.

    @stefano @dexter
    That sounds promising.
    Thank you for the review. I will start looking into SeaweedFS al a sucessor for my MinIO set up.

  • @stefano @dexter
    That sounds promising.
    Thank you for the review. I will start looking into SeaweedFS al a sucessor for my MinIO set up.

    @hackacad @dexter let me know your impressions after testing!


Gli ultimi otto messaggi ricevuti dalla Federazione
Post suggeriti