Snapshot of the load ap.space sees from AI crawlers
Meta
1
Posts
1
Posters
5
Views
-
Can you guess when I turned Anubis back on?
- Grey line (left-hand; y-axis) tracks page views
- Blue line (right-hand; y-axis) tracks unique users
You can even see the spike in traffic that brought down the site hard enough that I got my butt in gear to tune Anubis and turn it back on.
Based on the numbers here, there is a thirteen-fold decrease in activity (or a ~92% drop in traffic), all identified by Anubis as bots and blocked.
Selective adjustments were made to the nginx config and anubis bot policy to allow certain bits of traffic through (for unimpeded federation, etc.), but otherwise the site is now quite stable, on a small potato server. :potato:
Default bot policy does let search engine crawlers though (I think), so that is win-win.
Thank you so much @cadey@pony.social, my next stop is your GitHub Sponsors page.
-
undefined nodebb@fosstodon.org shared this topic on
Gli ultimi otto messaggi ricevuti dalla Federazione
-
@evan I am generally against the use of LLM tooling in software development when it comes to wholesale feature and application development.
However that's a personal opinion and not one that I wish to extend broadly to the site and topics discussed therein.
These discussions are welcome on the site 🙂
I say this with the unusual caveat that the AI space is evolving so rapidly that this guidance could change in the future!
-
Is it OK to discuss software that was developed with the assistance of AI/LLMs on ActivityPub.space? For example:
The developer used an LLM for research LLM code scanning for bug fixes LLM PR review LLM code generation (CoPilot tab completion or other) Coding agent wrote entire features or whole app
-
10 March 2026
Fixed permissions on the Mastodon mirror category so it actually works now (oops!)
-
@ozoned hah okay! Let me get that fixed up. I don't think I'm able to preserve the old topics however.
-
I think me moving Fireside Fedi, from video.firesidefedi.live to tubefree.org/firesidefedi might have broken your category. :-)
-
31 January 2026
Added categories for FediCon and FediMTL (listening to those hashtags as well)
-
30 January 2026
Added a new subsection for conferences and meetups, with a new category for FOSDEM Any topics tagged #fosdem, #fosdem26, and #socialwebfosdem and found by this forum or the FediBuzz relay will be automatically categorized there (the category will boost those topics) Additional categories for FediMTL (Montreal; @paige@masto.canadiancivil.com) and FediCon (Vancouver; @reiver@mastodon.social) to follow
-
26 January 2026
I will be out of the country until 2 February. Don't spam my forum kthxbai.
