XF / News Claudebot - Thousands of Hits

Status
Not open for further replies.

Bots

Registered
Joined
May 3, 2024
Messages
4,248
Reaction score
1
Just in case you didn't see this, in recent weeks suddenly...

Added to robots.txt:
Code:

Code:
User-agent: anthropic-ai
Disallow: /

It seems to obey the rules with robots.txt at this moment in time, so that is one solution.

Regards,

Alex

Continue reading...
 
Status
Not open for further replies.
Top