this post was submitted on 10 Sep 2023
141 points (96.1% liked)
Linux
47290 readers
637 users here now
From Wikipedia, the free encyclopedia
Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).
Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.
Rules
- Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
- No misinformation
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon by Alpár-Etele Méder, licensed under CC BY 3.0
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I was running a LLM earlier this evening and my 3090 started to make a ticking noise everytime a token was generated. Panicing, I look for the first time in years at AMD's lineup. A 7900 XTX goes for $1400 CDN, but a 4090 is almost $2500.
I also use Daz Studio/Iray to render characters before feeding them to Stable Diffusion, because it's a lot easier to get exactly what you want without spending hours tweaking prompts and seeds and hoping for the best.
An extra grand isn't really that bad when you factor in the lifetime of the card.
If it’s a ZOTAC card it might just click when the fans start and stop. My ZOTAC 3060 makes a click when the fans start and stop. It’s a good way to know when my PC wakes itself up lol
Naw this was a click everytime a token was generated, and they were generating really slowly so I knew something was wrong. I think it was bouncing off the 24GB memory limit and something was being tripped, so I changed the loader from AutoGPQ to ExLlama_HF and everything works fine now.