In-reply-to » Those of you who have your own sites, might want to give this a quick look: https://spawning.ai/ai-txt

@mckinley@twtxt.net Haha, right. They might have figured that everybody is just using * anyway. :-D Evidence from logs suggests “Spawning-AI”.

Yup, @thecanine@twtxt.net, I thought so, too. Reminds me a bit of Google using the least restrictive robots.txt rule when in doubt (at least you could argue for improved searchability; but it smells a bit fishy).

In the logs I see these three 404s in a row from someone claiming to be their bot:

  • /.well-known/tdmrep.json
  • /ai.txt?t=1704481081.54321
  • /.well-known/ai.txt?t=1704481081.54321

I never heard of TDM Reservation Protocol before:

This specification defines a simple and practical Web protocol, capable of
expressing the reservation of rights relative to text & data mining (TDM)
applied to lawfully accessible Web content, and to ease the discovery of TDM
licensing policies associated with such content.

This initiative is a technical answer to the constraints set by the Article 4
of the new European Directive on copyright and related rights in the Digital
Single Market.

⤋ Read More