Salta al contenuto

Piero Bosio Social Web Site Personale Logo Fediverso

Social Forum federato con il resto del mondo. Non contano le istanze, contano le persone

Ciao @stefano!

Senza categoria
6 3 0
  • Ciao @stefano! There where a lot of discussions about S3 storage solutions for FreeBSD. @dexter mentioned that you choose SeaweedFS for „reasons“. Can you tell a little bit about it and why not Garage or MinIO?

  • Ciao @stefano! There where a lot of discussions about S3 storage solutions for FreeBSD. @dexter mentioned that you choose SeaweedFS for „reasons“. Can you tell a little bit about it and why not Garage or MinIO?

    @hackacad @dexter Hi Sven! Sure: initially I started managing the BSD Cafe's Mastodon media storage using Minio inside a FreeBSD jail on a server with traditional disks. When the media grew to around 200 GB (and it's a lot of small files), I realized that the performance wasn't great, so I decided to try both Garage and SeaweedFS. I set up two identical jails on the same host, one with Garage and the other with SeaweedFS, then I started copying the existing media using rclone, from one jail to the other, starting with Garage. Initially, everything was fine, but I realized that at around 60 GB, Garage started to fully utilize the machine's 6 cores and slow down noticeably. I left it running all night anyway, but in the morning it had copied just over another 10 GB. I stopped the process. I performed the same operation on SeaweedFS and the copy went smoothly and without issues until the end, at full performance. The approach of creating volumes and small external index files with offsets is decidedly suitable for this type of use. I tried some more times - same result. It has been up and running for a few months now without any problems. Furthermore, its modular structure allows you to replicate everything (for disaster recovery, backup, etc.) in "almost" real-time: you can connect a filer from one SeaweedFS setup to another (completely separate) and it will begin to replicate everything that is present and stay in sync. For this reason, I decided to continue using it and have implemented the same setup for the illumos Cafe as well.

  • @hackacad @dexter Hi Sven! Sure: initially I started managing the BSD Cafe's Mastodon media storage using Minio inside a FreeBSD jail on a server with traditional disks. When the media grew to around 200 GB (and it's a lot of small files), I realized that the performance wasn't great, so I decided to try both Garage and SeaweedFS. I set up two identical jails on the same host, one with Garage and the other with SeaweedFS, then I started copying the existing media using rclone, from one jail to the other, starting with Garage. Initially, everything was fine, but I realized that at around 60 GB, Garage started to fully utilize the machine's 6 cores and slow down noticeably. I left it running all night anyway, but in the morning it had copied just over another 10 GB. I stopped the process. I performed the same operation on SeaweedFS and the copy went smoothly and without issues until the end, at full performance. The approach of creating volumes and small external index files with offsets is decidedly suitable for this type of use. I tried some more times - same result. It has been up and running for a few months now without any problems. Furthermore, its modular structure allows you to replicate everything (for disaster recovery, backup, etc.) in "almost" real-time: you can connect a filer from one SeaweedFS setup to another (completely separate) and it will begin to replicate everything that is present and stay in sync. For this reason, I decided to continue using it and have implemented the same setup for the illumos Cafe as well.

    @stefano @dexter
    That sounds promising.
    Thank you for the review. I will start looking into SeaweedFS al a sucessor for my MinIO set up.

  • @stefano @dexter
    That sounds promising.
    Thank you for the review. I will start looking into SeaweedFS al a sucessor for my MinIO set up.

    @hackacad @dexter let me know your impressions after testing!

  • @hackacad @dexter Hi Sven! Sure: initially I started managing the BSD Cafe's Mastodon media storage using Minio inside a FreeBSD jail on a server with traditional disks. When the media grew to around 200 GB (and it's a lot of small files), I realized that the performance wasn't great, so I decided to try both Garage and SeaweedFS. I set up two identical jails on the same host, one with Garage and the other with SeaweedFS, then I started copying the existing media using rclone, from one jail to the other, starting with Garage. Initially, everything was fine, but I realized that at around 60 GB, Garage started to fully utilize the machine's 6 cores and slow down noticeably. I left it running all night anyway, but in the morning it had copied just over another 10 GB. I stopped the process. I performed the same operation on SeaweedFS and the copy went smoothly and without issues until the end, at full performance. The approach of creating volumes and small external index files with offsets is decidedly suitable for this type of use. I tried some more times - same result. It has been up and running for a few months now without any problems. Furthermore, its modular structure allows you to replicate everything (for disaster recovery, backup, etc.) in "almost" real-time: you can connect a filer from one SeaweedFS setup to another (completely separate) and it will begin to replicate everything that is present and stay in sync. For this reason, I decided to continue using it and have implemented the same setup for the illumos Cafe as well.

    @stefano hey, garage project participant here, interested by the setup that you had for your garage instance, if you still have your config file around. Was it a single node? Which version?

  • @stefano hey, garage project participant here, interested by the setup that you had for your garage instance, if you still have your config file around. Was it a single node? Which version?

    @halfa Hello! Yes, I still have it (the last release, I performed several tests):

    root@bsdmmedia01:/bsdgarage/weed # garage -V
    garage cargo:1.1.0 [features: k2v, lmdb, sqlite, metrics, bundled-libs]

    root@bsdmmedia01:/usr/local/etc # cat garage.toml
    metadata_dir = "/bsdgarage/garage/meta"
    data_dir = "/bsdgarage/garage/data"
    metadata_snapshots_dir = "/bsdgarage/garage/snapshots"
    metadata_auto_snapshot_interval = "6h"
    db_engine = "lmdb"

    = true

    replication_factor = 1

    rpc_bind_addr = "0.0.0.0:3901"
    rpc_public_addr = "0.0.0.0:3901"
    rpc_secret = "XXX"

    [s3_api]
    s3_region = "garage"
    api_bind_addr = "0.0.0.0:3900"
    root_domain = ".s3.garage.localhost"

    [s3_web]
    bind_addr = "0.0.0.0:3902"
    root_domain = ".web.garage.localhost"
    index = "index.html"

    [k2v_api]
    api_bind_addr = "0.0.0.0:3904"


Gli ultimi otto messaggi ricevuti dalla Federazione
  • I grandi del movimento di qui hanno spostato il presidio per la Flotilla a domani pomeriggio. "Con questi dirigenti non vinceremo mai" cit. Nanni Moretti

    per saperne di più

  • I am doing a survey of supply chain attacks, and I find it very annoying how 95% of the analysis is on payloads rather than compromise vectors.

    Yes, you are a very smart reverse engineer and you figured out a very clever payload. Yes, rolling out phishing-resistant auth is a slog. No, this is not how we make actual progress.

    </rant>

    per saperne di più

  • qualcuno sulla flotilla sta ascoltando Lauryn Hill, grandi

    per saperne di più

  • Finally: I believe the relay does not collect any posts with a particular hashtag if no one has subscribed to it yet. For that reason, when I searched for "https://relay.fedi.buzz/tag/squirrel" and opened the resulting account, it had zero posts. How could there be no posts on all of the Fediverse??

    But if I follow that account, any *new* posts with "" should then be relayed through it, and I'll see them in my home feed.

    per saperne di più

  • Questa ve la devo raccontare:
    Mi telefona un cliente per cui gestisco un sito web, per dirmi tutto allarmato che l'ha chiamato un suo collaboratore dicendogli che il sottoscritto gli ha detto che il loro indirizzo di posta elettronica era scaduto.

    Il pregresso:
    Sempre il cliente mi manda una mail da lui ricevuta stamattina con l'indicazione che la casella mail stava per scadere, chiedendomi se era spam, lo fa sempre perché lui non riesce a riconoscerle e allora chiede a me.
    io rispondo così:

    Ciao.
    Visto il mittente (webmaster@u18brandenburg.de) direi proprio di si.
    Segna come spam e cestina.

    Il collaboratore (fenomeno) ha letto quello che ha voluto e ha capito ancora peggio, poi ha avvisato il suo capo... che ha chiamato me.

    Il cliente è andato a vedere la mia risposta e ci siamo fatti due risate 😂

    .

    per saperne di più

  • @eccosilvia ma lei lo fa per convinzione, assoluta! Non vedeva l'ora che arrivasse il momento.

    per saperne di più

  • @SteveBellovin one thing that keeps amazing me is the lack of education police in the US get. In Denmark the police academy takes 2 years and 4 months before being allowed out with an experienced colleague.

    per saperne di più

  • Eurozona, a settembre inflazione in aumento al 2,2 per cento
    @news
    https://www.eunews.it/2025/10/01/eurozona-a-settembre-inflazione-in-aumento-al-22-per-cento/
    I dati preliminari di Eurostat registrano un rialzo di 0,2 punti percentuali rispetto ad agosto. 'Mistero' cibo, previsto in calo mentre la BCE sostiene il contrario

    per saperne di più
Post suggeriti