this post was submitted on 10 Mar 2024
48 points (90.0% liked)

Android

17683 readers
353 users here now

The new home of /r/Android on Lemmy and the Fediverse!

Android news, reviews, tips, and discussions about rooting, tutorials, and apps.

🔗Universal Link: !android@lemdro.id


💡Content Philosophy:

Content which benefits the community (news, rumours, and discussions) is generally allowed and is valued over content which benefits only the individual (technical questions, help buying/selling, rants, self-promotion, etc.) which will be removed if it's in violation of the rules.


Support, technical, or app related questions belong in: !askandroid@lemdro.id

For fresh communities, lemmy apps, and instance updates: !lemdroid@lemdro.id

💬Matrix Chat

💬Telegram channels / chats

📰Our communities below


Rules

  1. Stay on topic: All posts should be related to the Android OS or ecosystem.

  2. No support questions, recommendation requests, rants, or bug reports: Posts must benefit the community rather than the individual. Please post to !askandroid@lemdro.id.

  3. Describe images/videos, no memes: Please include a text description when sharing images or videos. Post memes to !androidmemes@lemdro.id.

  4. No self-promotion spam: Active community members can post their apps if they answer any questions in the comments. Please do not post links to your own website, YouTube, blog content, or communities.

  5. No reposts or rehosted content: Share only the original source of an article, unless it's not available in English or requires logging in (like Twitter). Avoid reposting the same topic from other sources.

  6. No editorializing titles: You can add the author or website's name if helpful, but keep article titles unchanged.

  7. No piracy or unverified APKs: Do not share links or direct people to pirated content or unverified APKs, which may contain malicious code.

  8. No unauthorized polls, bots, or giveaways: Do not create polls, use bots, or organize giveaways without first contacting mods for approval.

  9. No offensive or low-effort content: Don't post offensive or unhelpful content. Keep it civil and friendly!

  10. No affiliate links: Posting affiliate links is not allowed.

Quick Links

Our Communities

Lemmy App List

Chat and More


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] evo@sh.itjust.works 13 points 8 months ago* (last edited 8 months ago) (3 children)

This is a weird hit piece where the author has all the facts but seems to just not understand them...

The TL;DR (that we knew months ago) is the 8GB of ram in Pixel 8 isn't enough to run the Gemini Nano LLM on device, the 12GB of ram in the 8 Pro is actually needed.

Again, strange to call this a "fail" when Google is the first and only company to really do this and never claimed it was coming to the 8. This is the bleeding edge, of course it only runs on highest spec hardware.

[–] limerod@reddthat.com 16 points 8 months ago

This is a weird hit piece where the author has all the facts but seems to just not understand them...

Actually he does.

The TL;DR (that we knew months ago) is the 8GB of ram in Pixel 8 isn't enough to run the Gemini Nano LLM on device, the 12GB of ram in the 8 Pro is actually needed.

Not quite. If you read further he writes:

The Pixel 8 is fitted with the same Tensor G3 chip fitted to the Pixel 8 Pro, but where the latter has 12 GB of RAM, the Pixel 8 is stuck with just 8 GB of RAM, which appears to be the cause of the system bottleneck on this occasion. This is still somewhat surprising as Gemini Nano comes in two model sizes; one running at just 1.8 billion parameters and the other running at 3.6 billion parameters. It is unclear which of the two models is running on the Pixel 8 Pro, but at least it can support Google's first on-device mobile LLM.

As far as on-device AI models go both are relatively modest, however. Qualcomm, which has just launched a new AI Hub with over 75 AI models compatible with its Snapdragon chips, has highlighted that its Snapdragon 8 Gen 3 can support AI models of up to 10 billion parameters. Even its Snapdragon 8 Gen 2 can support AI modes running at up to 7 billion parameters.

This is significant for two reasons. Firstly, the greater the parameters, potentially the more sophisticated and accurate the model. Secondly, it highlights that it is not just system RAM where the Pixel 8 suffers, but the Tensor G3 is, as we have previously examined, far from being the AI champ that Google’s marketing would lead us to believe. Google has pitched the Pixel series as being all about the AI and defended the Tensor for its lack of outright performance one the pretense that outright performance is less important than AI capability.

The tensor is not strong enough in the 1st place compared to snapdragon 8 gen 3/2

Again, strange to call this a "fail" when Google is the first and only company to really do this and never claimed it was coming to the 8.

True, If you don't count the s24 series. The base model which also has 8GB of limited ram.

The author's point written in the article if you read.. being tensor was made for pixels due to AI demands and its weak performance being ok because it had AI chops. Instead, not only is it not getting some advanced AI based features it's not even equal compared to the competition (s24 series). If Pixel 8, which was launched in October is missing out so early. What else will it miss over the 7 years?

[–] redcalcium@lemmy.institute 16 points 8 months ago

Another article point out that the base Galaxy S24, which also has 8gb RAM, is able to run Gemini Nano.

That said, I will point out that the base Galaxy S24 model comes with 8GB of RAM. Only the Plus and Ultra feature 12GB of memory. Google didn’t exclude the regular Galaxy S24 model from the list of Gemini Nano devices. Then again, the Galaxy S24 series features a much better chipset than the Pixel 8 phones. Maybe that’s what allows a device with 8GB of RAM to run on-device AI via Gemini Nano.

[–] Deceptichum@sh.itjust.works 8 points 8 months ago

So Gemini Nano needs 12gb but Gemma can run on 4gb? Why don’t they just use their Gemma model on this low end device.