donatas@feddit.uk to Selfhosted@lemmy.worldEnglish · 12 days agoSome local LLMs tested on an average gaming PCgithub.comexternal-linkmessage-square9fedilinkarrow-up124
arrow-up124external-linkSome local LLMs tested on an average gaming PCgithub.comdonatas@feddit.uk to Selfhosted@lemmy.worldEnglish · 12 days agomessage-square9fedilink
minus-squaredonatas@feddit.ukOPlinkfedilinkEnglisharrow-up1·12 days ago128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.