…Both Intel and AMD optimized their software stacks to get massive speedups in generative AI which has seen AMD’s RTX 7900 XTX get higher performance per dollar than an NVIDIA RTX 4080 in generative AI (specifically Stable Diffusion with A111/Xformers). Considering Stable Diffusion accounts for the vast majority of non-SaaS, localized generative AI right now - this is a major milestone and finally offers some competition to NVIDIA.

  • Mechanize@feddit.it
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    And then here I am, still unable to run StableDiffusion on my 6650xt because pytorch apparently hates it.

    TBF llama.cpp runs like a wonder on ROCm.

    All aside the improvements in the AI ecosystem by AMD are appreciated and overall tangible. Let’s hope they’ll keep it up.