does anyone use Forgejo and have issues with larger repositories?
Uncategorized
5
Posts
3
Posters
7
Views
-
does anyone use Forgejo and have issues with larger repositories? i a local copy of FreeBSD's ports.git (1.8GB on disk) where a normal 'git pull' from poudriere takes ~10 minutes, which doesn't seem right.
this is on an 8-core server with 2 mirrored SSDs, but the pull seems blocked on a single-threaded, CPU-bound git command: /usr/local/libexec/git-core/git --shallow-file pack-objects --revs --thin --stdout --shallow --delta-base-offset --include-tag
do i need to 'optimise' the repo somehow or what am i missing here? because i don't think this behaviour is normal or expected.
-
does anyone use Forgejo and have issues with larger repositories? i a local copy of FreeBSD's ports.git (1.8GB on disk) where a normal 'git pull' from poudriere takes ~10 minutes, which doesn't seem right.
this is on an 8-core server with 2 mirrored SSDs, but the pull seems blocked on a single-threaded, CPU-bound git command: /usr/local/libexec/git-core/git --shallow-file pack-objects --revs --thin --stdout --shallow --delta-base-offset --include-tag
do i need to 'optimise' the repo somehow or what am i missing here? because i don't think this behaviour is normal or expected.
@lw Pre-Forgejo, the #HardenedBSD project tried for a while to use #Gitea. But that fell over sideways with src and ports, especially with scraper bots continuously looking up each and every commit.
At the time, the problem stemmed from the fact that the #golang git package that everyone uses will load the entire repo history just to look up a single commit.
Rinse and repeat for thousands of hits per second, and kaboom!
HardenedBSD currently uses a self-hosted #GitLab Enterprise instance. We're hoping to eventually migrate to #Radicle.
-
@lw Pre-Forgejo, the #HardenedBSD project tried for a while to use #Gitea. But that fell over sideways with src and ports, especially with scraper bots continuously looking up each and every commit.
At the time, the problem stemmed from the fact that the #golang git package that everyone uses will load the entire repo history just to look up a single commit.
Rinse and repeat for thousands of hits per second, and kaboom!
HardenedBSD currently uses a self-hosted #GitLab Enterprise instance. We're hoping to eventually migrate to #Radicle.
@lattera i did wonder if it was perhaps looking at the entire history to decide what to send to the client... maybe related to the fact that poudriere does a shallow clone by default?
this also only seems to affect HTTP pulls, i haven't had any issues with git over SSH.
-
@lattera i did wonder if it was perhaps looking at the entire history to decide what to send to the client... maybe related to the fact that poudriere does a shallow clone by default?
this also only seems to affect HTTP pulls, i haven't had any issues with git over SSH.
@lw ah, yeah, for poudriere, I usually pass in the -D option to do a full clone when creating jails or ports.
-
@lattera i did wonder if it was perhaps looking at the entire history to decide what to send to the client... maybe related to the fact that poudriere does a shallow clone by default?
this also only seems to affect HTTP pulls, i haven't had any issues with git over SSH.
@lw @lattera shallow clones are quite a bit more expensive to compute than full clones (e.g. ¹). Homebrew was directly asked by GitHub to stop using shallow clones because of the load this created². However I don't know of any reason why SSH clones should be speedy while HTTPS ones are slow, that's quite odd and possibly a clue.
Do you happen to have any more verbose logs? E.g. with GIT_TRACE=1 or ³?
¹: https://github.blog/open-source/git/counting-objects/
-
undefined stefano@mastodon.bsd.cafe shared this topic on
Gli ultimi otto messaggi ricevuti dalla Federazione
-
I MAGA e i numeri
@matematica - Il problema non è tanto che sparino numeri senza senso, ma che la gente crede loro
-
@interstar Sure
-
La guerra non è mai la soluzione. Solidarietà internazionalista. Diserzione
@anarchia
Il recente attacco del 28 febbraio condotto da Stati Uniti e Israele contro l’Iran non è un atto isolato, né un incidente della storia. È l’ennesima manifestazione ben pianificata di una logica imperiale che traveste l’aggressione da difesa, la supremazia...Vedi
-
But does working on unpaid solo projects count?
-
Growing convinced we could and should ship new version cooldown in the Go modules ecosystem.
The subdb and MVP get us far, and supply chain attacks are not much of a thing in Go beyond typosquatting, but we want to stay ahead of them.
https://github.com/golang/go/issues/76485#issuecomment-4043378459
-
@evan I'm not warping back to Xarkclanx IV, even if The Beatles are playing a reunion show there. It's just not worth dealing with the decade of spontaneous liquefaction after.
-
@evan just today I flew x-country and part of this trip is a concert Friday night :)
-
@jamesmarshall wow!
