ooli@lemmy.world to Technology@lemmy.worldEnglish · 7 months agoGPU's rival? What is Language Processing Unit (LPU)www.turingpost.comexternal-linkmessage-square16fedilinkarrow-up194arrow-down110
arrow-up184arrow-down1external-linkGPU's rival? What is Language Processing Unit (LPU)www.turingpost.comooli@lemmy.world to Technology@lemmy.worldEnglish · 7 months agomessage-square16fedilink
minus-squareAmaltheamannen@lemmy.mllinkfedilinkEnglisharrow-up1·7 months agoIsn’t it those that cost $2000 per 250mb of memory?? Meaning you’d about 350 to load any half decent model.
minus-squareScott@sh.itjust.workslinkfedilinkEnglisharrow-up2·7 months agoNot sure how they are doing it, but it was actually $20k not $2k for 250mb of memory on the card. I suspect the models are probably cached in system memory.
Isn’t it those that cost $2000 per 250mb of memory?? Meaning you’d about 350 to load any half decent model.
Not sure how they are doing it, but it was actually $20k not $2k for 250mb of memory on the card. I suspect the models are probably cached in system memory.