@prologic@twtxt.net Do you know where I can read how yarn pods works? I fast looked sources (know a little go). It’s scanning and indexing a last parts of twt and working with they in RAM, right? How about archived twts?

@algorifer@twtxt.net Sure so archived Twts are not indexed at the moment….

@algorifer@twtxt.net I’m working on an integrated full text and keyword search engine directly into yarnd which will replace the current (crappy) tag-only search. This will allow us to index an archive (optional, as some archives are rather large) and give us full search capability and do interesting things like pull up old conversations (yarns) from the index (but explicitly as we’ll likely continue to use the cache model with limited size and ttl for good reasons).