Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 6 months agoSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comexternal-linkmessage-square30fedilinkarrow-up1236arrow-down112
arrow-up1224arrow-down1external-linkSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 6 months agomessage-square30fedilink
minus-squareDeceptichum@kbin.sociallinkfedilinkarrow-up16·6 months agoYeah but damn does it get slow. I always find it interesting how text is so much slower than image generation. I can do a 1024x1024 in probably 20s, but I get like 1 word a second with text.
minus-squareferret@sh.itjust.workslinkfedilinkEnglisharrow-up5·6 months agoLanguages are complex and, more importantly, much less forgiving to error
Yeah but damn does it get slow.
I always find it interesting how text is so much slower than image generation. I can do a 1024x1024 in probably 20s, but I get like 1 word a second with text.
Languages are complex and, more importantly, much less forgiving to error