filister@lemmy.world to Linux@lemmy.ml · 7 days agoZLUDA v4 Released For Initial CUDA Support On Non-NVIDIA GPUs - Phoronixwww.phoronix.comexternal-linkmessage-square6fedilinkarrow-up14
arrow-up14external-linkZLUDA v4 Released For Initial CUDA Support On Non-NVIDIA GPUs - Phoronixwww.phoronix.comfilister@lemmy.world to Linux@lemmy.ml · 7 days agomessage-square6fedilink
minus-squarefilister@lemmy.worldOPlinkfedilinkarrow-up1·7 days agoI am really looking forward to having a viable alternative to NVIDIA. I would love buying Intel or AMD and being able to enable CUDA support on the GPU out of the box.
minus-squaregaylord_fartmaster@lemmy.worldlinkfedilinkarrow-up2·7 days agoMe too. I recently switched from an RTX 2080 to a 7900 XTX, which is way more powerful for games, but local LLM performance tanked without CUDA.
minus-squaregeneva_convenience@lemmy.mllinkfedilinkarrow-up1·7 days agoNVIDIA skimps out on VRAM needed for deep learning. If AMD could compete it would be huge as they often include more for cheaper.
I am really looking forward to having a viable alternative to NVIDIA. I would love buying Intel or AMD and being able to enable CUDA support on the GPU out of the box.
Me too. I recently switched from an RTX 2080 to a 7900 XTX, which is way more powerful for games, but local LLM performance tanked without CUDA.
NVIDIA skimps out on VRAM needed for deep learning. If AMD could compete it would be huge as they often include more for cheaper.