In-reply-to » Anyone got a link to a robots.txt that β€œblocks” all the β€œAI” stuff?

Hey @movq@www.uninformativ.de !! here’s an article you might find interesting: Blocking Bots with Nginx … this person is actually blocking AI Bots based on a list of User Agents in an interesting way. πŸ‘

​ Read More