ooli@lemmy.world to Technology@lemmy.worldEnglish · 7 months agoGPU's rival? What is Language Processing Unit (LPU)www.turingpost.comexternal-linkmessage-square16fedilinkarrow-up194arrow-down110
arrow-up184arrow-down1external-linkGPU's rival? What is Language Processing Unit (LPU)www.turingpost.comooli@lemmy.world to Technology@lemmy.worldEnglish · 7 months agomessage-square16fedilink
minus-squareFinadil@lemmy.worldlinkfedilinkEnglisharrow-up1·7 months agoThat with a fp16 model? Don’t be scared to try even a 4 bit quantization, you’d be surprised at how little is lost and how much quicker it is.
That with a fp16 model? Don’t be scared to try even a 4 bit quantization, you’d be surprised at how little is lost and how much quicker it is.