• 0 Posts
  • 325 Comments
Joined 1 year ago
cake
Cake day: March 8th, 2024

help-circle


  • Yeah, this would be the “lacking any agency or responsibility” part of the bafflement about Americans’ views.

    Get a few million people out on the streets (and/or refusing to work) and it turns out it is remarkably hard to run a country at all.

    Americans think of protesting as a small circle of people in front of some building chanting corny slogans. It is not. Look at France. Look at Serbia. Look at Turkey right now, FFS.

    I’m not saying go be a weirdo chanting in a circle, I’m saying block the streets with masses of people, shut down the country, close down the shops, picket official buildings, cordon off vulnerable targets, blot out the goddamn sun.

    You have done nothing as a country yet. The dumbass MAGA morons did more direct political action on Jan 6th than anybody else in the US since, what? BLM? I am astounded at the sense of dejection and powerlessness in the face of fascist ascendancy paired with some weird ritualistic economic self-immolation. You guys are SO. WEIRD. I don’t get it.


  • Yeah, I grew up in an area of survival agriculture, removed from actual famine by say twenty, thirty years, depending on how you count it ending. Living memory in any case. To this day people here will pester you to take food when they have a fruit tree yielding, or when they are picking potatoes. People get together to go pick grapes across all of their small properties and then roughly split the yield based on plot size, even if the yields were somewhat uneven. Friends would show up with fish when they went fishing and you’d do the same.

    You want to prep for the apocalypse, start giving away food and insisting that neighbors come over to visit, then force feed them aggressively, even under protest. Then do that to such an extent it becomes deeply culturally ingrained.

    Will you have a culture where your adult children can’t bear to throw anything away and will perpetually eat leftovers but never stop overcooking? Yes, you will. But you will have learned to survive scarcity.

    But in the meantime, holy shit, get out of the house and start protesting. Have you seen what your government is doing? At least have the decency to lose whatever conflict leads into the apocalyse instead of just sitting there complaining about it on social media.


  • I am screaming into a pillow at the image of Americans prepping for the apocalypse while doing zero things to avoid it.

    Look, I’ve said this a bunch of times around here this week and it seems like I’m trolling, but I’m not. I’ve been spooked for years at finding out that my US friends were absolutely unwilling to engage in any political action but were also consistently sure that a violent revolution or uprising was both inevitable and imminent. The idea that this is a widespread societal thing and that not only has it not been altered by another wave of trumpism but has in fact been reinforced is absolutely wild.

    I don’t know who convinced Americans that they are simultaneously the sole main characters of life but also absolutely absent of any agency or responsibility over what happens, but holy crap, they did an amazing job.


  • There are tons of options. Chromecasts, Apple TVs, Amazon Fire TV, Nvidia Shield are all commercial options and I recommend none of them.

    The traditional broke student choice for this is to just get a laptop that has a HDMI out or the ability to spit out HDMI over USB C and plug that straight to the TV. That I can recommend. Especially if your goal is not to stream the media but to instead play a bunch of locally downloaded files.

    Beyond that you’re going out of your way to set up bigger self-hosting stuff and if we’re talking “upgrading from a VCR to playing offline videos on my TV” it sure sounds like we aren’t there yet.


  • A quick look at US Amazon spits out that the only 24Gb card in stock is a 3090 for 1500 USD. A look at the European storefront shows 2400EUR for a 4090. Looking at other assorted stores shows a bunch of out of stock notices.

    It’s quite competitive, I’m afraid. Things are very stupid at this point and for obvious reasons seem poised to get even dumber.


  • Yeah, for sure. That I was aware of.

    We were focusing on the Mini instead because… well, if the OP is fretting about going for a big GPU I’m assuming we’re talking user-level costs here. The Mini’s reputation comes from starting at 600 bucks for 16 gigs of fast shared RAM, which is competitive with consumer GPUs as a standalone system. I wanted to correct the record about the 24Gig starter speccing up to 64 because the 64 gig one is still in the 2K range, which is lower than the realistic market prices of 4090s and 5090s, so if my priority was running LLMs there would be some thinking to do about which option makes most sense in the 500-2K price range.

    I am much less aware of larger options and their relative cost to performance because… well, I may not hate LLMs as much as is popular around the Internet, but I’m no roaming cryptobro, either, and I assume neither is anybody else in this conversation.



  • I am slightly facetious and mildly hyperbolic.

    But yes, I absolutely hate strangers forcing conversation on me. I find few things more grating and hostile than landing in a foreign country horrendously jet lagged and having a “friendly” cabbie try to extract my life story from me while telling me about their mortgage payments or whatever.

    I once had someone in the US just sit at our bar table unprompted and strike up a conversation and I saw my life flash before my eyes. That’s what psycopaths do. It’s like getting punched right in your social anxiety with spiky brass knuckles.


  • I don’t know how to parse this question and it makes me wonder about humanity at large.

    Like, what’s “being friendly” when assessing entire countries? How do you measure it? Does it apply just to strangers or is it related to having friends there? Does this require you not finding that unsolicited conversation is borderline assault? Because I’m afraid I can’t do that. Is it an institutional thing? I almost got deported from Canada once, so from that baseline I’m pretty sure I couldn’t agree with a lot of responses below.




  • You didn’t, I did. The starting models cap at 24, but you can spec up the biggest one up to 64GB. I should have clicked through to the customization page before reporting what was available.

    That is still cheaper than a 5090, so it’s not that clear cut. I think it depends on what you’re trying to set up and how much money you’re willing to burn. Sometimes literally, the Mac will also be more power efficient than a honker of an Nvidia 90 class card.

    Honestly, all I have for recommendations is that I’d rather scale up than down. I mean, unless you also want to play kickass games at insane framerates with path tracing or something. Then go nuts with your big boy GPUs, who cares.

    But for LLM stuff strictly I’d start by repurposing what I have around, hitting a speed limit and then scaling up to maybe something with a lot of shared RAM (including a Mac Mini if you’re into those) and keep rinsing and repeating. I don’t know that I personally am in the market for AI-specific muti-thousand APUs with a hundred plus gigs of RAM yet.


  • Thing is, you can trade off speed for quality. For coding support you can settle for Llama 3.2 or a smaller deepseek-r1 and still get most of what you need on a smaller GPU, then scale up to a bigger model that will run slower if you need something cleaner. I’ve had a small laptop with 16 GB of total memory and a 4060 mobile serving as a makeshift home server with a LLM and a few other things and… well, it’s not instant, but I can get the sort of thing you need out of it.

    Sure, if I’m digging in and want something faster I can run something else in my bigger PC GPU, but a lot of the time I don’t have to.

    Like I said below, though, I’m in the process of trying to move that to an Arc A770 with 16 GB of VRAM that I had just lying around because I saw it on sale for a couple hundred bucks and I needed a temporary GPU replacement for a smaller PC. I’ve tried running LLMs on it before and it’s not… super fast, but it’ll do what you want for 14B models just fine. That’s going to be your sweet spot on home GPUs anyway, anything larger than 16GB and you’re talking 3090, 4090 or 5090, pretty much exclusively.


  • This is… mostly right, but I have to say, macs with 16 gigs of shared memory aren’t all that, you can get many other alternatives with similar memory distributions, although not as fast.

    A bunch of vendors are starting to lean on this by providing small, weaker PCs with a BIG cache of shared RAM. That new Framework desktop with an AMD APU specs up to 128 GB of shared memory, while the mac minis everybody is hyping up for this cap at 24 GB instead.

    I’d strongly recommend starting with a mid-sized GPU on a desktop PC. Intel ships the A770 with 16GB of RAM and the B580 with 12 and they’re both dirt cheap. You can still get a 3060 with 12 GB for similar prices, too. I’m not sure how they benchmark relative to each other on LLM tasks, but I’m sure one can look it up. Cheap as the entry level mac mini is, all of those are cheaper if you already have a PC up and running, and the total amount of dedicated RAM you get is very comparable.




  • But they fussed about Call of Duty.

    If I’m annoyed about anything it’s that. Gamers are so often using these ostensible customer protection or political affinity issues as a cudgel for what is ultimately a branding preference. This results on excusing some crappy stuff from people they semi-irrationally like (loot boxes on Steam games are fine!, we don’t talk about GenAI on InZOI!) but give extreme amounts of crap to companies they semi-irrationally dislike even for relatively positive things they do.

    I’d mind less if the difference was based on size or artistic quality, but dude, InZOI is from Krafton. I don’t know that the PUBG guys are the plucky indies I want to stretch my moral stances to support.