Never too late to set more restrictions for crappy bots.
Uncategorized
2
Posts
1
Posters
1
Views
-
Never too late to set more restrictions for crappy bots.
-
Never too late to set more restrictions for crappy bots.
More in detail, for Apache 2.4, this override in blacklist-user-agents.conf can be very useful:
BrowserMatchNoCase "meta-externalagent" !good_bot
BrowserMatchNoCase "developers.facebook.com" !good_bot
BrowserMatchNoCase "facebookexternalhit" !good_bot
BrowserMatchNoCase "facebookplatform" !good_botBrowserMatchNoCase "meta-externalagent" bad_bot
BrowserMatchNoCase "developers.facebook.com" bad_bot
BrowserMatchNoCase "facebookexternalhit" bad_bot
BrowserMatchNoCase "facebookplatform" bad_bot