Do you k ow what you clicked on before going back?
yarnd
PR that upgrades the Bitcask dependency for its internal database to v2? đ
@eldersnake@we.loveprivacy.club Sweet thank you! đââïž Iâll merge this PR tonight I think.
yarnd
PR that upgrades the Bitcask dependency for its internal database to v2? đ
Seems to be working OK đ€
Pelos vistos antigamente havia uma coisa chamada âbaile tipo Cascaisâ. Mas como o mundo subversivo dos anos 50 e 60 em Portugal nĂŁo estĂĄ bem documentado, hĂĄ zero resultados a uma pesquisa do termo nos motores de busca da Internet⊠resta-me a imaginação para tirar as conclusĂ”es (provavelmente erradas) de como seria tal baile.
On my blog: Real Life in Star Trek, The First Duty https://john.colagioia.net/blog/2024/09/19/first-duty.html #scifi #startrek #closereading
@david@collantes.us Well, I wouldnât recommend using my code for your main jenny use anyway. If you want to try it out, set XDG_CONFIG_HOME and XDG_CACHE_HOME to some sandbox directories and only run my code there. If @movq@www.uninformativ.de is interested in any of this getting upstreamed, Iâd be happy to try rebasing the changes, but otherwise itâs a proof of concept and fun exercise.
@falsifian@www.falsifian.org hiya from the Sunshine State (also known as a never-ending hell, LOL)!
I forgot to git add a new test file. Added to the patch now at https://www.falsifian.org/a/oDtr/patch0.txt
@falsifian@www.falsifian.org this one hits hard, as jenny
was just updated today. :â-(
its replacing the contents of body for some reason.
@david@collantes.us Hello!
@prologic@twtxt.net Hi. i have noticed sometimes when i hit the back button i lose all the surrounding layout and just have a list of twts.
BTW this code doesnât incorporate existing twts into jennyâs database. Itâs best used starting from scratch. Iâve been testing it using a custom XDG_CACHE_HOME and XDG_CONFIG_HOME to avoid messing with my ârealâ jenny data.
I wrote some code to try out non-hash reply subjects formatted as (replyto ), while keeping the ability to use the existing hash style.
I donât think we need to decide all at once. If clients add support for a new method then people can use it if they like. The downside of course is that this costs developer time, so I decided to invest a few hours of my own time into a proof of concept.
With apologies to @movq@www.uninformativ.de for corrupting jennyâs beautiful code. I donât write this expecting you to incorporate the patch, because it does complicate things and might not be a direction you want to go in. But if you like any part of this approach feel free to use bits of it; I release the patch under jennyâs current LICENCE.
Supporting both kinds of reply in jenny was complicated because each email can only have one Message-Id, and because itâs possible the target twt will not be seen until after the twt referencing it. The following patch uses an sqlite database to keep track of known (url, timestamp) pairs, as well as a separate table of (url, timestamp) pairs that havenât been seen yet but are wanted. When one of those âwantedâ twts is finally seen, the mail file gets rewritten to include the appropriate In-Reply-To header.
Patch based on jenny commit 73a5ea81.
https://www.falsifian.org/a/oDtr/patch0.txt
Not implemented:
- Composing twts using the (replyto âŠ) format.
- Probably other important things Iâm forgetting.
HmmâŠ
@lyse@lyse.isobeef.org indeed! There is no âcentral authorityâ acting as witness, and notary. The more I think of it⊠LOL.
@movq@www.uninformativ.de I recognise him, but yes, he has aged quite a bit. I mean, I look at myself in the mirror and canât, often, recognise myself. Ageing is a bitch! đ
compressed_subject(msg_singlelined)
be configurable, so only a certain number of characters get displayed, ending on ellipses? Right now the entire twtxt is crammed into the Subject:
. This request aims to make twtxts display on mutt
/neomutt
, etc. more like emails do.
I mean, really, it couldnât get any better. I love it!
compressed_subject(msg_singlelined)
be configurable, so only a certain number of characters get displayed, ending on ellipses? Right now the entire twtxt is crammed into the Subject:
. This request aims to make twtxts display on mutt
/neomutt
, etc. more like emails do.
@movq@www.uninformativ.de perfect in every way. Configurable too! Thank you!
compressed_subject(msg_singlelined)
be configurable, so only a certain number of characters get displayed, ending on ellipses? Right now the entire twtxt is crammed into the Subject:
. This request aims to make twtxts display on mutt
/neomutt
, etc. more like emails do.
@movq@www.uninformativ.de yes, thatâs perfect! <3
@eldersnake@we.loveprivacy.club I wanted to ask you, are you running Headscale and WireGuard on the same VPS? I want to test Headscale, but currently run a small container with WireGuard, and I wonder if I need to stop (and eventually get rid of) the container to get Headscale going. Did you use the provided .deb
to install Headscale, or some other method?
@david@collantes.us I think we can!
@prologic@twtxt.net I read it. I understand it. Hopefully a solution can be agreed upon that solves the editing issue, whilst maintaining the cryptographic hash.
yarnd
PR that upgrades the Bitcask dependency for its internal database to v2? đ
e.g: Shutdown yarnd
and cp -a yarn.db yarn.db.bak
before testing this PR/branch.
Can I get someone like maybe @xuu@txt.sour.is or @abucci@anthony.buc.ci or even @eldersnake@we.loveprivacy.club â If you have some spare time â to test this yarnd
PR that upgrades the Bitcask dependency for its internal database to v2? đ
VERY IMPORTANT If you do; Please Please Please backup your yarn.db
database first! đ
Heaven knows I donât want to be responsible for fucking up a production database here or there đ€Ł
yarnd
that I think have always been there, but only recently uncovered by the Go 1.23 compiler.
nevermind; I think this might be some changes internally in Go 1.23 and a dependency I needed to update đ€
Can someone much smarter than me help me figure out a couple of newly discovered deadlocks in yarnd
that I think have always been there, but only recently uncovered by the Go 1.23 compiler.
Location Addressing is fine in smaller or single systems. But when youâre talking about large decentralised systems with no single point of control (kind of the point) things like independable variable integrity become quite important.
What is being proposed as a counter to content-addressing is called location-addressing. Two very different approaches, both with pros/cons of course. But a local cannot be verified, the content cannot be be guaranteed to be authenticate in any way, you just have to implicitly trust that the location points to the right thing.
For example, without content-addressing, youâd never have been able to find let alone pull up that ~3yr old Twt of me (my very first), hell Iâd even though I lost my first feed file or it became corrupted or something đ€Ł â If that were the case, it would actually be possible to reconstruct the feed and verify every single Twt against the caches of all of you đ€Ł
@david@collantes.us I really thinks articles like this explain the benefits far better than I can.
@prologic@twtxt.net I know the role of the current hash is to allow referencing (replies and, thus, threads), and it also represents a âuniqueâ way to verify a twtxt hasnât been tampered with. Is that second so important, if we are trying to allow edits? I know if feels good to be able to verify, but in reality, how often one does it?
@movq@www.uninformativ.de could it be possible to have compressed_subject(msg_singlelined)
be configurable, so only a certain number of characters get displayed, ending on ellipses? Right now the entire twtxt is crammed into the Subject:
. This request aims to make twtxts display on mutt
/neomutt
, etc. more like emails do.
@david@collantes.us Oh ! đ€Šââïž
@david@collantes.us Witout including the content, itâs no longer really âcontent addressingâ now is it? Youâre essentially only addressing say nick+timestamp or url+timestamp.
@prologic@twtxt.net I donât trust Google with anything, sorry, pass. Oh, and you need to sign in on your Google Account (or whatever they call it these days).
@prologic@twtxt.net how about hashing a combination of nick/timestamp, or url/timestamp only, and not the twtxt content? On edit those will not change, so no breaking of threads. I know, I know, just adding noise here. :-P
Speaking of AI tech (sorry!); Just came across this really cool tool built by some engineers at Googleâą (currently completely free to use without any signup) called NotebookLM đ Looks really good for summarizing and talking to document đ
@eldersnake@we.loveprivacy.club there has to be less reliance on a single point of failure. It is not so much about creating jobs in the US (which come with it, anyway), but about the ability to produce whatâs needed at home too. Whatâs the trade off? Is it going to be a little bit more expensive to manufacture, perhaps?
@eldersnake@we.loveprivacy.club Yeah Iâm looking forward to that myself đ€Ł Itâll be great to see where technology grow to a level of maturity and efficiency where you can run the tools on your own PC or Device and use it for what, so far, Iâve found it to be somewhat decent at; Auto-Complete, Search and Q&A.
@prologic@twtxt.net Thatâs definitely a little less depressing, when thinking of it that way đ€Ł Be interesting when the hype dies down.
Iâm not the biggest Apple fan around, but that is pretty awesome.
i found this site by searching âthing-fishâ
@sorenpeter@darch.dk I really donât think we can ignore the last ~3 years and a bit of this threading model working quite well for us as a community across a very diverse set of clients and platforms. We cannot just drop something that âmostly works just fineâ for the sake of âsimplicityâ. We have to weight up all the options. There are very real benefits to using content addressing here that really IMO shouldnât be disregarded so lightly that actually provide a lot of implicit value that users of various clients just donât get to see. Iâd recommend reading up on the ideas behind content addressing before simply dismissing the Twt Hash spec entirely, it wasnât even written or formalised by me, but I understand how it works quite well đ The guy that wrote the spec was (is?) way smarter than I was back then, probably still is now đ€Ł
Estava tentado em escolher outra coisa para esta #musiquinta , mas seria enganar-me. NĂŁo consigo pensar em #covers sem me vir esta logo imediatamente Ă cabeça, Ă© como se estivesse enfeitiçadoâŠ
Marilyn Manson - I Put A Spell On You
https://youtu.be/4qkrsodwJGY
@quark@ferengi.one It does not. That is why Iâm advocating for not using hashes for treads, but a simpler link-back scheme.
@falsifian@www.falsifian.org Right I see. Yeah maybe we want to avoid that đ€Ł I do kind of tend to agree with @xuu@txt.sour.is in another thread that there isnât actually anything wrong with our use of Blake2 at all really, but we may want to consider all our options.
@xuu@txt.sour.is I donât think this is a lextwt problem tbh. Just the Markdown aprser that yarnd
currently uses. twtxt2html
uses Goldmark and appears to behave better đ€Ł
@xuu@txt.sour.is Long while back, I experimented with using similarity algorithms to detect if two Twts were similar enough to be considered an âEditâ.
Right I see what you mean @xuu@txt.sour.is â Can you maybe come up with a fully fleshed out proposal for this? đ€ This will help solve the problem of hash collision that result from the Twt/hash space growing larger over time without us having to change anything about the way we construct hashes in the first place. We just assume spec compliant clients will just dynamically handle this as the space grows.
abcdef0123456789...
any sub string of that hash after the first 6 will match. so abcdef
, abcdef012
, abcdef0123456
all match the same. on the case of a collision i think we decided on matching the newest since we archive off older threads anyway. the third rule was about growing the minimum hash size after some threshold of collisions were detected.
@xuu@txt.sour.is I think we never progressed this idea further because we werenât sure how to tell if a hash collision would occur in the first place right? In other words, how does Client A know to expand a hash vs. Client B in a 100% decentralised way? đ€
Plus these so-called âLLMâ(s) have a pretty good grasp of the âshapeâ of language, so they appear to be quite intelligent or produce intelligible response (when theyâre actually quite stupid really).
@eldersnake@we.loveprivacy.club You donât get left behind at all đ€Ł Itâs hyped up so much, itâs not even funny anymore. Basically at this point (so far at least) Iâve concluded that all this GenAI / LLM stuff is just a fancy auto-complete and indexing + search reinvented đ€Ł
Getting a little sick of AI this, AI that. Yes Iâll be left behind while everyone else jumps on the latest thing, but Iâm not sure I care.
Oh. looks like its 4 chars. git show 64bf
@prologic@twtxt.net where was that idea?
i feel like we should isolate a subset of markdown that makes sense and built it into lextwt. it already has support for links and images. maybe basic formatting bold, italic. possibly block quote and bullet lists. no tables or footnotes
the stem matching is the same as how GIT does its branch hashes. i think you can stem it down to 2 or 3 sha bytes.
if a client sees someone in a yarn using a byte longer hash it can lengthen to match since it can assume that maybe the other client has a collision that it doesnt know about.
@prologic@twtxt.net the basic idea was to stem the hash.. so you have a hash abcdef0123456789...
any sub string of that hash after the first 6 will match. so abcdef
, abcdef012
, abcdef0123456
all match the same. on the case of a collision i think we decided on matching the newest since we archive off older threads anyway. the third rule was about growing the minimum hash size after some threshold of collisions were detected.
@prologic@twtxt.net Wikipedia claims sha1 is vulnerable to a âchosen-prefix attackâ, which I gather means I can write any two twts I like, and then cause them to have the exact same sha1 hash by appending something. I guess a twt ending in random junk might look suspcious, but perhaps the junk could be worked into an image URL like
. If thatâs not possible now maybe it will be later.git only uses sha1 because theyâre stuck with it: migrating is very hard. There was an effort to move git to sha256 but I donât know its status. I think there is progress being made with Game Of Trees, a git clone that uses the same on-disk format.
I canât imagine any benefit to using sha1, except that maybe some very old software might support sha1 but not sha256.
@bender@twtxt.net This is the different Markdown parsers being used. Goldmark vs. gomarkdown. We need to switch to Goldmark đ
Apple A16 SoC Now Manufactured In Arizona
âApple has begun manufacturing its A16 SoC at the newly-opened TSCM Fab 21 in Arizona,â writes Slashdot reader NoMoreACs. AppleInsider reports: According to sources of Tim Culpan, Phase 1 of TSMCâs Fab 21 in Arizona is making the A16 SoC of the iPhone 14 Pro in âsmall, but significant, numbers. The production is largely a test for the facility at this stage, but more production is expected ⊠â Read more
@quark@ferengi.one iâm guessing the quotas text shouldâve been emphasized?
@slashdot@feeds.twtxt.net NahahahahHa đ€Ł So glad I donât use LinkedIn đ€Šââïž
@falsifian@www.falsifian.org No u donât sorry. But I tend to agree with you and I think if we continue to use hashes we should keep the remainder in mind as we choose truncation values of N
@falsifian@www.falsifian.org Mostly because Git uses it đ€Ł Known attacks that would affect our use? đ€
@xuu@txt.sour.is I donât recall where that discussion ended up being though?
@bender@twtxt.net wut da fuq?! đ€Ł
@xuu@txt.sour.is you mean my original idea of basically just automatically detecting Twt edits from the client side?
(delete: 5vbi2ea)
.. would it delete someone elses twt?
@xuu@txt.sour.is this is where you would need to prove that the editor delete request actually came from that feed author. Hence why integrity is much more important here.
@falsifian@www.falsifian.org without supporting dudes properly though youâre running into GDP issues and the right to forget. đ€Ł weâve had pretty lengthy discussions about this in the past years ago as well, but we never came to a conclusion. Weâre all happy with.
@movq@www.uninformativ.de it would work, you are right, however, it has drawbacks, and I think in the long term would create a new set of problems that we would also then have to solve.
@david@collantes.us Hah đ€Ł
@prologic@twtxt.net :-D Thanks! Things can come in cycles, right? This is simply another one. Another cycle, more personal than the other âalter egosâ.
@david@collantes.us Weâll get there soonâą đ
@david@collantes.us Hah Welcome back! đ
@aelaraji@aelaraji.com hey, hey! You are my very first reply! đđ» Cheers!
@david@collantes.us âHello backâ from the other corner of the world! đ«Ą
Incredibly upsetâmore than you could imagineâbecause I already made the first mistake, and corrected it (but twtxt.net got it on itâs cache, ugh!) :â-( . Canât wait for editing to become a reality!
Alright. My first mentionsâwhich were picked not so randomly, LOLâare @prologic@twtxt.net, @lyse@lyse.isobeef.org, and @movq@www.uninformativ.de. I am also posting my first image too, which you see below. Thatâs my neighbourhood, in a âwinterâ day. Hopefully @prologic@twtxt.net will add my domain to his allowed list, so that the image (and any other further) renders.
Alright, announce_me
set to true. Now, who do I pick to be my first mention? Decisions, decisions. Next twtxt will have my first mention(s). :-)
I have configured my twtxt.txt
as simple as possible. I have setup a publish_command
on jenny. Hopefully all works fine, and I am good to go. Next will be setting the announce_me
to true
. Here we go!
Everything starts at a âhello worldâ. At least around these parts; the nerdy parts.
@sorenpeter@darch.dk hmm, how does your client handles âa little editingâ? I am sure threads would break just as well. đ
@prologic@twtxt.net, there is a parser bug on parent. Specifically on this portion:
"*If twtxt/Yarn was to grow bigger, then this would become a concern again. *But even Mastodon allows editing*, so how
+much of a problem can it really be? đ
*"
@movq@www.uninformativ.de going a little sideways on this, â*If twtxt/Yarn was to grow bigger, then this would become a concern again. But even Mastodon allows editing, so how much of a problem can it really be? đ *â, wouldnât it preparing for a potential (even if very, very, veeeeery remote) growth be a good thing? Mastodon signs all messages, keeps a history of edits, and it doesnât break threads. It isnât a problem there.đ It is here.
I think keeping hashes is a must. If anything for that âfeels goodâ feeling.
@movq@www.uninformativ.de Agreed that hashes have a benefit. I came up with a similar example where when I twted about an 11-character hash collision. Perhaps hashes could be made optional somehow. Like, you could use the âreplytoâ idea and then additionally put a hash somewhere if you want to lock in which version of the twt you are replying to.
There is nothing wrong with how we currently run a diff to see what has been removed. if i build a merkle tree off all the twt hashes in a feed i can use that to verify a twt should be in a feed or not. and gossip that to my peers.
So.. basically a rehash of the email âunsendâ requests? What if i was to make a (delete: 5vbi2ea)
.. would it delete someone elses twt?
isnât the benefit of blake2b that it is a more efficient algo than sha1 and has the same or similar entropy to sha3? i thought we had partially solved this with some type of expanding hash size? additionally we could increase bit density by using base36 or base64/url-safeâŠ
Hey, @movq@www.uninformativ.de, a tiny thing to add to jenny
, a -v
switch. That way when you twtxt âThatâs an older format that was used before jenny version v23.04â, I can go and run jenny -v
, and âduh!â myself on the way to a git pull
. :-D
@movq@www.uninformativ.de ooooh, nice! commit 62a2b7735749f2ff3c9306dd984ad28f853595c5
:
Crawl archived feeds in âfetch-context
Like, very much! :-)
@movq@www.uninformativ.de to paraphrase US Presidents speech on each State of the Union, âthe State of the Jenny is strong!â :-D As for the potential upcoming changes, there has to be a knowledgeable head honcho that will agglomerate and coalesce, and guide onto the direction that will be taken. All that with the strong input from the developers that will be implementing the changes, and a lesser (but not less valuable) input from users.
@lyse@lyse.isobeef.org I call upon the services of the @yarn_police@twtxt.net to further investigate this oddness!