this post was submitted on 07 Jan 2025
157 points (95.9% liked)
Games
33096 readers
1465 users here now
Welcome to the largest gaming community on Lemmy! Discussion for all kinds of games. Video games, tabletop games, card games etc.
Weekly Threads:
Rules:
-
Submissions have to be related to games
-
No bigotry or harassment, be civil
-
No excessive self-promotion
-
Stay on-topic; no memes, funny videos, giveaways, reposts, or low-effort posts
-
Mark Spoilers and NSFW
-
No linking to piracy
More information about the community rules can be found here.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
They aren't making graphics cards anymore, they're making AI processors that happen to do graphics using AI.
What if I'm buying a graphics card to run Flux or an LLM locally. Aren't these cards good for those use cases?
Oh yeah for sure, I've run Llama 3.2 on my RTX 4080 and it struggles but it's not obnoxiously slow. I think they are betting more software will ship with integrated LLMs that run locally on users PCs instead of relying on cloud compute.
Welcome to the future
Except you cannot use them for AI commercially, or at least in data center setting.
Data centres want the even beefier cards anyhow, but I think nVidia envisions everyone running local LLMs on their PCs because it will be integrated into software instead of relying on cloud compute. My RTX 4080 can struggle through Llama 3.2.