this post was submitted on 10 Jun 2024
0 points (50.0% liked)

Technology

59467 readers
4394 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s@lemmy.world
L4s@lemmy.world
L3s@fry.gs
L4s@fry.gs
enu@lemmy.world
0
Andrej Karpathy endorses Apple Intelligence (lemmy.world)
submitted 5 months ago* (last edited 5 months ago) by Z4rK@lemmy.world to c/technology@lemmy.world
16 comments fedilink hide all child comments
 

Actually, really liked the Apple Intelligence announcement. It must be a very exciting time at Apple as they layer AI on top of the entire OS. A few of the major themes.

Step 1 Multimodal I/O. Enable text/audio/image/video capability, both read and write. These are the native human APIs, so to speak.

Step 2 Agentic. Allow all parts of the OS and apps to inter-operate via "function calling"; kernel process LLM that can schedule and coordinate work across them given user queries.

Step 3 Frictionless. Fully integrate these features in a highly frictionless, fast, "always on", and contextual way. No going around copy pasting information, prompt engineering, or etc. Adapt the UI accordingly.

Step 4 Initiative. Don't perform a task given a prompt, anticipate the prompt, suggest, initiate.

Step 5 Delegation hierarchy. Move as much intelligence as you can on device (Apple Silicon very helpful and well-suited), but allow optional dispatch of work to cloud.

Step 6 Modularity. Allow the OS to access and support an entire and growing ecosystem of LLMs (e.g. ChatGPT announcement).

Step 7 Privacy. <3

We're quickly heading into a world where you can open up your phone and just say stuff. It talks back and it knows you. And it just works. Super exciting and as a user, quite looking forward to it.

https://x.com/karpathy/status/1800242310116262150?s=46

top 16 comments
sorted by: hot top controversial new old
[–] restingboredface@sh.itjust.works 0 points 5 months ago (1 children)

I look forward to Apple Marketing coming up with their usual line of nonsense, like a meaningless name for an existing capability that they are claiming to have invented.

[–] helenslunch@feddit.nl 0 points 5 months ago (1 children)

I watched an abbreviated video. Pretty much everything they announced was available on other platforms 5+years ago

[–] gravitas_deficiency@sh.itjust.works -1 points 5 months ago* (last edited 5 months ago)

But now it’s on your iPhone.

I agree that it’s dumb.

It will still make stock go up.

[–] eager_eagle@lemmy.world 0 points 5 months ago (1 children)

"and it just works"

has he even used an llm before?

[–] Z4rK@lemmy.world 0 points 5 months ago (1 children)

He sort of invented it, so you have to think he’s commenting on the concept here, not the implementation.

I have tried a lot of medium and small models, and there it just no good replacement for the larger ones for natural text output. And they won’t run on device.

Still, fine-tuning smaller models can do wonders, so my guess would be that Apple Intelligence is really 20+ small and fine tuned models that kick in based on which action you take.

[–] gravitas_deficiency@sh.itjust.works -1 points 5 months ago (1 children)

An LLM has no comprehension of what it says. It’s just a puppy that is really good at performing for treats. This will always yield nonsense a meaningful proportion of the time.

I don’t care how statistically good your model can be under certain constraints and inputs. At the end of the day, all you’ve done is classically condition your computer.

[–] Z4rK@lemmy.world 0 points 5 months ago (1 children)

It goes a tad bit beyond classical conditioning... LLM’a provides a much better semantic experience than any previous technology, and is great for relating input to meaningful content. Think of it as an improved search engine that gives you more relevant info / actions / tool-suggestions etc based on where and how you are using it.

Here’s a great article that gives some insight into the knowledge features embedded into a larger model: https://transformer-circuits.pub/2024/scaling-monosemanticity/

[–] gravitas_deficiency@sh.itjust.works -1 points 5 months ago* (last edited 5 months ago) (1 children)

That’s great. But that’s not how it’s being marketed and sold to the public. It’s being sold as an oracle (as in crystal ball, not database). And it’s misleading and hurting people as a result.

I’ll reiterate: An LLM has no comprehension of what it says.

It’s a matter of engineering ethics, on multiple levels:

  • the training data in the vast majority of cases is outright stolen
  • it’s being sold as something that it’s not, and the result is causing real damage to people and society in a ton of ways we’re still discovering
  • most people deeply involved in developing LLMs, and basically all of the technical leadership, are categorically ignoring and abrogating any and all responsibility around this “magical” new system they’ve made. We’ve seen this before with social networking. We know where this road leads.

I’m not saying the tech should be banned. That’s obviously idiotic. Neural nets can - and are - used for tons of fascinating and excellent applications. It’s just that my staunch opinion is that LLMs are a terrible application of that the tech at this stage of development, and it’s particularly terrible that OpenAI/Microsoft/etc are aggressively foisting this technology on the public, and simultaneously refusing to take any ethical responsibility for it.

[–] Z4rK@lemmy.world 0 points 5 months ago (1 children)

To be honest, I’m not sure what we’re arguing - we both seem to have a sound understanding of what LLM is and what it is not.

I’m not trying to defend or market LLM, I’m just describing the usability of the current capabilities of typical LLMs.

[–] gravitas_deficiency@sh.itjust.works -1 points 5 months ago

I’m saying that I wish that more people involved with the core development of the technology took the ethical considerations seriously, and communicated those concerns as a first-order issue when they talk about applications like this.

It’s fascinating tech, but the way it’s being employed these days is deeply irresponsible.

[–] henfredemars@infosec.pub 0 points 5 months ago* (last edited 5 months ago) (2 children)

Kernel process LLM

God I hope not. That sounds extremely insecure. Definitely do not do this in the kernel.

[–] Thann@lemmy.ml 0 points 5 months ago (1 children)

Why not just have the LLM replace the kernel?

[–] mriormro@lemmy.world 0 points 5 months ago (1 children)

Why not have the LLM replace the user?

[–] Thann@lemmy.ml 0 points 5 months ago (1 children)

This could really cut down on those pesky bug reports....

[–] DudeDudenson@lemmings.world 1 points 5 months ago

I'm imagining a world where advertisers have to try to raise engagement from AIs in their ads

[–] gravitas_deficiency@sh.itjust.works -1 points 5 months ago

Why do I feel like this is making me Recall another recent awful idea?