My thoughts about pagination (paging)
Following the discussion about pagination (paging) I think that’s the right thing to do.
Fetching the same content again and again with only a marginal portion of actually new twts is unbearable and does not scale in any way. It’s not only a waste of bandwidth but with increasing number of fetchers it will also become a problem for pods to serve all requests.
Because it’s so easy to implement and simple to understand, splitting twtxt file in parts with next
and prev
pointers seems a really amazing solution.
As in RFC5005 there should also be a meta header pointing to the main URL, e.g. current
or baseurl
or something like that. This way hashes can calculated correctly even for archived twts.