In-reply-to » Those of you who have your own sites, might want to give this a quick look: https://spawning.ai/ai-txt

@thecanine@twtxt.net @prologic@twtxt.net @eldersnake@we.loveprivacy.club @mckinley@twtxt.net This page is just a terrible joke. Great writeup, mckinley! Exactly my thoughts, but you forgot to mention that you see zero contents unless you scroll a full page down. Boy do I hate this. Luckily, I did not watch this stupid video.

Why does this generator add tons of *.ext rules when it also has a simple * to catch them all? I’m not a robot.txt expert, but that feels redundant. If I do not have an ai.txt, is their crawler consulting my robots.txt? I could not find an answer to that – in my opinion – obvious question. I don’t want any bots on my site.

⤋ Read More