this post was submitted on 17 Jul 2024
688 points (99.0% liked)
PC Gaming
8783 readers
579 users here now
For PC gaming news and discussion. PCGamingWiki
Rules:
- Be Respectful.
- No Spam or Porn.
- No Advertising.
- No Memes.
- No Tech Support.
- No questions about buying/building computers.
- No game suggestions, friend requests, surveys, or begging.
- No Let's Plays, streams, highlight reels/montages, random videos or shorts.
- No off-topic posts/comments, within reason.
- Use the original source, no clickbait titles, no duplicates. (Submissions should be from the original source if possible, unless from paywalled or non-english sources. If the title is clickbait or lacks context you may lightly edit the title.)
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I would pay extra to be able to run open LLM's locally on Linux. I wouldn't pay for Microsoft's Copilot stuff that's shoehorned into every interface imaginable while also causing privacy and security issues. The context matters.
That's why NPU's are actually a good thing. The ability to run LLM local instead of sending everything to Microsoft/Open AI for data mining will be great.
I hate to be that guy, but do you REALLY think that on-device AI is going to prevent all your shit being sent to anyone who wants it, in the form of "diagnostic data" or "usage telemetry" or whatever weasel-worded bullshit in the terms of service?'
They'll just send the results for "quality assurance" instead of doing the math themselves and save a bundle on server hosting.
Yes, obviously, especially if you are running all open source software.
All your unattended date will be taken (and some of the attended one). This doesn't mean you should stop to attend your data. Even of you're somehow forced to use Windows instead open alternative, it doesn't mean you can't dual boot or use other privacy conscious devices when dealing with your sensitive data.
Closed/proprietary OS and hardware driver can't be considered safe by design)
I replied to the person above "locally on Linux".
Even in Windows, local queries give the possibility of control. Set your firewall and it cannot leak.