The #BSDCafe #Forgejo instance ("brew") is constantly under "attack" by scrapers.
Uncategorized
3
Posts
3
Posters
4
Views
-
@announcements FWIW, you can get rid of a lot of those scrapers by catching all the self-identifying ones listed in ai.robots.txt, and on top of that, if anything says
Firefox/orChrome/in the user agent that does not also have asec-fetch-modeheader. Catch those, serve them a empty 200, or a 403, or 418, or heck, a 429, and a lot of the bots will be gone.(Mind you, this also catches Googlebot and Bingbot, which I personally consider a win, but you might want to make an exception for them if you want to appear in search results.)
-
@announcements FWIW, you can get rid of a lot of those scrapers by catching all the self-identifying ones listed in ai.robots.txt, and on top of that, if anything says
Firefox/orChrome/in the user agent that does not also have asec-fetch-modeheader. Catch those, serve them a empty 200, or a 403, or 418, or heck, a 429, and a lot of the bots will be gone.(Mind you, this also catches Googlebot and Bingbot, which I personally consider a win, but you might want to make an exception for them if you want to appear in search results.)
@algernon @announcements thank you!
Gli ultimi otto messaggi ricevuti dalla Federazione
-
@dmoonfire my current SGT puzzles' obsession is Towers, FWIW.
-
@evan 40% of respondents are undernourished
-
@bigzaphod only one thing for it... THUMB WAR WITH THE IDEAS! 👍🏻
-
So, I see that brilliant @cubicgarden person was a guest on @firesidefedi ... I need to catch up!
-
Thanksgiving and Christmas should be six months apart. It's very difficult to have to deal with those people again that soon.
(Due to events in my personal life, this week's #HootinTootinTuesday will be on a Wednesday. My apologies for the delay.)
#Humor #Humour #FunnyMeme #Turkey #TurkeyDay #DadJokes #Thanksgiving #ThanksgivingDinner #Holidays #Dogs
#Dogstodon ##DogsOfMastodon #Dog #Dachshunds #WienerDogs #DogMemes
-
@symbolics I've see records of a purchase of a Xerox Interlisp D-machine by an Italian research institution in the late 1980s. The price tag, which included WAN connectivity and support, was eye watering.
-
Had some pretty extensive implementation ideas in my head for a Tapestry feature for months now. Was excited to finally get started on it.
Woke up feeling like all the ideas are sus and will be a disaster.
My brain isn't playing fair here.
-
@amoroso They were also not widely available. They were very very expensive and I doubt that more than 10k of these machines were ever sold. The hardware was expensive, but the software was also very expensive. The early competition were UNIX Lisp systems like Allegro CL, Lucid CL and then LispWorks. But they and the hardware for them was also expensive (memory). Government money feeded the bubble. Later, after the AI crash a lot of the remaining applications were ported to C++.
