💡𝚂𝗆𝖺𝗋𝗍𝗆𝖺𝗇 𝙰𝗉𝗉𝗌📱@programming.dev to Programming@programming.devEnglish · 1 year agoDo not Interrupt Developers, Study Saysshiftmag.devexternal-linkmessage-square79linkfedilinkarrow-up1388arrow-down16
arrow-up1382arrow-down1external-linkDo not Interrupt Developers, Study Saysshiftmag.dev💡𝚂𝗆𝖺𝗋𝗍𝗆𝖺𝗇 𝙰𝗉𝗉𝗌📱@programming.dev to Programming@programming.devEnglish · 1 year agomessage-square79linkfedilink
minus-squareFrezik@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up3arrow-down1·1 year agoFWIW, it doesn’t work. The preprocessing for LLM training isn’t going to be fooled by that. It’s just making things harder for everyone to read.
minus-squareSpice Hoarder@lemmy.ziplinkfedilinkarrow-up1·1 year agoHmm, seriously? Does it also ignore zalgo text?
minus-squareFrezik@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up3·1 year agoI’d expect that any trick that becomes popular enough would have a simple workaround. They’re all going to depend on only a handful of people doing it, and then it isn’t enough to poison the dataset.
FWIW, it doesn’t work. The preprocessing for LLM training isn’t going to be fooled by that. It’s just making things harder for everyone to read.
Hmm, seriously? Does it also ignore zalgo text?
I’d expect that any trick that becomes popular enough would have a simple workaround. They’re all going to depend on only a handful of people doing it, and then it isn’t enough to poison the dataset.