this post was submitted on 11 Oct 2023
477 points (92.5% liked)
Technology
59288 readers
6184 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Wait, you guys don't already have hundreds of gigabytes of memory?
Technically I could upgrade my desktop to 192GB of memory (4x48). That's still only about half the amount required for the largest BLOOM model, for instance.
To go beyond that today, you'd need to move beyond the Intel Core or AMD Ryzen platforms and get something like a Xeon. At that point you're spending 5 figures on hardware.
I know you're just joking, but figured I'd add context for anyone wondering.
Don't worry about the RAM. Worry about the VRAM.
Google drive is my swap space