this post was submitted on 05 Dec 2023
107 points (100.0% liked)

PC Gaming

8533 readers
1142 users here now

For PC gaming news and discussion. PCGamingWiki

Rules:

  1. Be Respectful.
  2. No Spam or Porn.
  3. No Advertising.
  4. No Memes.
  5. No Tech Support.
  6. No questions about buying/building computers.
  7. No game suggestions, friend requests, surveys, or begging.
  8. No Let's Plays, streams, highlight reels/montages, random videos or shorts.
  9. No off-topic posts/comments.
  10. Use the original source, no clickbait titles, no duplicates. (Submissions should be from the original source if possible, unless from paywalled or non-english sources. If the title is clickbait or lacks context you may lightly edit the title.)

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] baconisaveg@lemmy.ca 7 points 11 months ago* (last edited 11 months ago) (2 children)

And yet all of the good, open source LLM work is coming out of China. But hey, maybe this will spur some ROCm development so AMD cards don't suck so fucking hard in that space.

[–] bioemerl@kbin.social 9 points 11 months ago* (last edited 11 months ago) (1 children)

AMD is also subject to export restrictions.

[–] baconisaveg@lemmy.ca 4 points 11 months ago (1 children)

I liked your original comment before the edit, it's true. AMD only has consumer grade hardware, which is the main reason the majority of the AI projects don't support it. Code written for CUDA can work on a A100 just as well as a 3090, there's no money in developing software to run on someone's 4 year old gaming PC.

[–] bioemerl@kbin.social 3 points 11 months ago (1 children)

AMD makes a few Mi999 cards that support pytorch with ROCM and are subject to the export ban.

[–] baconisaveg@lemmy.ca 3 points 11 months ago

Not sure how I missed the MI250 series, but thanks.

[–] fruitycoder@sh.itjust.works 3 points 11 months ago

Right? It's really unfortunate that so many of the Chinese people that make awesome stuff get limited because CCP has garnered so much distrust that they won't use AI to advance their surveillance and authoritarian control systems both domestically and abroad.

I mean it was also a shame how much the actions of the NSA weakend trust in West as well.