wut
@prologic@twtxt.net any idea why I’d be seeing four copies of the same post?
@abucci@anthony.buc.ci Do you see the same on the web? 🤔
@prologic@twtxt.net yes, it turns out I see 13 copies on the web.
I see 13 in Goryon too. I only noticed 4 yesterday, but now that I’m looking again I see 13.
I’ve noticed this behavior before with other feeds.
If you look at the awesome scala weekly twtxt feed, https://feeds.twtxt.net/awesome-scala-weekly/twtxt.txt , it’s wild. “Issue 356”, the recent one I’m referring to, is repeated 13 times. Everything looks fine back to 2022-11-03T21:42:00Z, when “Issue 337” is repeated 13 times. “Issue 336” is repeated 13 times. “Issue 335” is repeated 13 times. Finally, I got bored and stopped counting.
The only conclusion is that this feed is cursed.
@abucci@anthony.buc.ci Yeah this is a bit of a known issue. It’s caused by bad RSS feeds that repeat the same items. We track the last time stamp of the lat item we saw.
@prologic@twtxt.net hash the content?
@prologic@twtxt.net Are you sure that’s the case here? The rss feed looks clean…
Yeah I’m pretty sure. I’ve looked into this once before. Hashing the content would probably work as long as the content itself isn’t changing…
@prologic@twtxt.net But like @marado@twtxt.net said, the RSS feed is clean. And the fact that it’s always 13 repetitions and not an arbitrary number suggests a systematic bug.
@abucci@anthony.buc.ci I’ll look into it again 🤣