donatas@feddit.uk to Selfhosted@lemmy.worldEnglish · 12 days agoSome local LLMs tested on an average gaming PCgithub.comexternal-linkmessage-square9fedilinkarrow-up124
arrow-up124external-linkSome local LLMs tested on an average gaming PCgithub.comdonatas@feddit.uk to Selfhosted@lemmy.worldEnglish · 12 days agomessage-square9fedilink
minus-squareslazer2au@lemmy.worldlinkfedilinkEnglisharrow-up25·12 days ago Average gaming PC. 128GB ram and a 4070 12GB. Doesn’t sound average.
minus-square🦄🦄🦄@feddit.orglinkfedilinkEnglisharrow-up13·12 days agoYeah, not even a 5090? Pf, nice Dwarf Fortress machine I guess.
minus-squaresuperkret@feddit.orglinkfedilinkEnglisharrow-up6·12 days agoA dwarf Fortress machine would have an i9-14900KS, 192GB DDR5 RAM and no graphics card.
minus-squarearchonet@lemy.lollinkfedilinkEnglisharrow-up6·edit-212 days agoI was gonna say, 4x the amount of RAM I have, made me feel inadequate. like, “am I really that poor now? is my 2080 now considered potato gaming?” it’s simply been so long since I’ve gone “ok I need to upgrade” that I’m starting to get suspicious
minus-squaresurewhynotlem@lemmy.worldlinkfedilinkEnglisharrow-up3·12 days ago is my 2080 now considered potato gaming?" I’m going to keep using this 1070 until it fails it I get bored of Skyrim.
minus-squaredonatas@feddit.ukOPlinkfedilinkEnglisharrow-up1·12 days ago128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
minus-squareiAmTheTot@sh.itjust.workslinkfedilinkEnglisharrow-up2·12 days agoNo kidding. Steam survey definitely does not agree with this definition of average lmao
128GB ram and a 4070 12GB. Doesn’t sound average.
Yeah, not even a 5090? Pf, nice Dwarf Fortress machine I guess.
A dwarf Fortress machine would have an i9-14900KS, 192GB DDR5 RAM and no graphics card.
I was gonna say, 4x the amount of RAM I have, made me feel inadequate. like, “am I really that poor now? is my 2080 now considered potato gaming?”
it’s simply been so long since I’ve gone “ok I need to upgrade” that I’m starting to get suspicious
I’m going to keep using this 1070 until it fails it I get bored of Skyrim.
128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
No kidding. Steam survey definitely does not agree with this definition of average lmao