Finally added validation to discovered peers! The list of now-VERIFIED, discovered peers, with at least one valid message is now at 703 (out of the 1449 unverified - a lot of garbage mentions are out there). https://xandkar.net/twtxt/peers.txt
@xandkar@xandkar.net Oh this is really cool! 👌 How does the verification work? 🤔
If a peer’s URI is downloaded with 200 and at least one message is parsed from it - a peer gets the “verified” badge.
@xandkar@xandkar.net Ahh that’s very similar to the “indexed_feeds” counter on Yarns 👌
Although for some reason your stats are 2x as large… Can you explain this? 🤔
Perhaps because I’m not limiting to just twtxt.net? I seeded with initial peers manually and from there keep spidering out to mentions. Also, there may still be dupes which differ only in nick and/or some alias URI that leads to the same place - need to design a de-dupping pass…
Added my current peer set files here: https://xandkar.net/twtxt/