(#frjxwvq) @Codebuzz I agree. At the end of the day it’s just a text file served by some means, we should get more upset by crawlers that don’t …
@Codebuzz @www.codebuzz.nl I agree. At the end of the day it’s just a text file served by some means, we should get more upset by crawlers that don’t respect our robots.tzt rules 🤣 ⌘ Read more