this post was submitted on 10 Mar 2024
48 points (90.0% liked)

Android

17683 readers
351 users here now

The new home of /r/Android on Lemmy and the Fediverse!

Android news, reviews, tips, and discussions about rooting, tutorials, and apps.

🔗Universal Link: !android@lemdro.id


💡Content Philosophy:

Content which benefits the community (news, rumours, and discussions) is generally allowed and is valued over content which benefits only the individual (technical questions, help buying/selling, rants, self-promotion, etc.) which will be removed if it's in violation of the rules.


Support, technical, or app related questions belong in: !askandroid@lemdro.id

For fresh communities, lemmy apps, and instance updates: !lemdroid@lemdro.id

💬Matrix Chat

💬Telegram channels / chats

📰Our communities below


Rules

  1. Stay on topic: All posts should be related to the Android OS or ecosystem.

  2. No support questions, recommendation requests, rants, or bug reports: Posts must benefit the community rather than the individual. Please post to !askandroid@lemdro.id.

  3. Describe images/videos, no memes: Please include a text description when sharing images or videos. Post memes to !androidmemes@lemdro.id.

  4. No self-promotion spam: Active community members can post their apps if they answer any questions in the comments. Please do not post links to your own website, YouTube, blog content, or communities.

  5. No reposts or rehosted content: Share only the original source of an article, unless it's not available in English or requires logging in (like Twitter). Avoid reposting the same topic from other sources.

  6. No editorializing titles: You can add the author or website's name if helpful, but keep article titles unchanged.

  7. No piracy or unverified APKs: Do not share links or direct people to pirated content or unverified APKs, which may contain malicious code.

  8. No unauthorized polls, bots, or giveaways: Do not create polls, use bots, or organize giveaways without first contacting mods for approval.

  9. No offensive or low-effort content: Don't post offensive or unhelpful content. Keep it civil and friendly!

  10. No affiliate links: Posting affiliate links is not allowed.

Quick Links

Our Communities

Lemmy App List

Chat and More


founded 1 year ago
MODERATORS
top 9 comments
sorted by: hot top controversial new old
[–] evo@sh.itjust.works 13 points 8 months ago* (last edited 8 months ago) (3 children)

This is a weird hit piece where the author has all the facts but seems to just not understand them...

The TL;DR (that we knew months ago) is the 8GB of ram in Pixel 8 isn't enough to run the Gemini Nano LLM on device, the 12GB of ram in the 8 Pro is actually needed.

Again, strange to call this a "fail" when Google is the first and only company to really do this and never claimed it was coming to the 8. This is the bleeding edge, of course it only runs on highest spec hardware.

[–] redcalcium@lemmy.institute 16 points 8 months ago

Another article point out that the base Galaxy S24, which also has 8gb RAM, is able to run Gemini Nano.

That said, I will point out that the base Galaxy S24 model comes with 8GB of RAM. Only the Plus and Ultra feature 12GB of memory. Google didn’t exclude the regular Galaxy S24 model from the list of Gemini Nano devices. Then again, the Galaxy S24 series features a much better chipset than the Pixel 8 phones. Maybe that’s what allows a device with 8GB of RAM to run on-device AI via Gemini Nano.

[–] limerod@reddthat.com 16 points 8 months ago

This is a weird hit piece where the author has all the facts but seems to just not understand them...

Actually he does.

The TL;DR (that we knew months ago) is the 8GB of ram in Pixel 8 isn't enough to run the Gemini Nano LLM on device, the 12GB of ram in the 8 Pro is actually needed.

Not quite. If you read further he writes:

The Pixel 8 is fitted with the same Tensor G3 chip fitted to the Pixel 8 Pro, but where the latter has 12 GB of RAM, the Pixel 8 is stuck with just 8 GB of RAM, which appears to be the cause of the system bottleneck on this occasion. This is still somewhat surprising as Gemini Nano comes in two model sizes; one running at just 1.8 billion parameters and the other running at 3.6 billion parameters. It is unclear which of the two models is running on the Pixel 8 Pro, but at least it can support Google's first on-device mobile LLM.

As far as on-device AI models go both are relatively modest, however. Qualcomm, which has just launched a new AI Hub with over 75 AI models compatible with its Snapdragon chips, has highlighted that its Snapdragon 8 Gen 3 can support AI models of up to 10 billion parameters. Even its Snapdragon 8 Gen 2 can support AI modes running at up to 7 billion parameters.

This is significant for two reasons. Firstly, the greater the parameters, potentially the more sophisticated and accurate the model. Secondly, it highlights that it is not just system RAM where the Pixel 8 suffers, but the Tensor G3 is, as we have previously examined, far from being the AI champ that Google’s marketing would lead us to believe. Google has pitched the Pixel series as being all about the AI and defended the Tensor for its lack of outright performance one the pretense that outright performance is less important than AI capability.

The tensor is not strong enough in the 1st place compared to snapdragon 8 gen 3/2

Again, strange to call this a "fail" when Google is the first and only company to really do this and never claimed it was coming to the 8.

True, If you don't count the s24 series. The base model which also has 8GB of limited ram.

The author's point written in the article if you read.. being tensor was made for pixels due to AI demands and its weak performance being ok because it had AI chops. Instead, not only is it not getting some advanced AI based features it's not even equal compared to the competition (s24 series). If Pixel 8, which was launched in October is missing out so early. What else will it miss over the 7 years?

[–] Deceptichum@sh.itjust.works 8 points 8 months ago

So Gemini Nano needs 12gb but Gemma can run on 4gb? Why don’t they just use their Gemma model on this low end device.

[–] aniki@lemm.ee 3 points 8 months ago (2 children)

When the pixel 8A specs dropped for the first time in recent memory I have decided to abandon the A series and go back a generation, so I grabbed a refurbished 7 pro and the specs are not even close. The 7 Pro, for less money, shits all over the 8A specs.

Google really, really fucked the dog with the Pixel 8 series. What were they thinking?

[–] Auli@lemmy.ca 4 points 8 months ago* (last edited 8 months ago) (1 children)

Google has screwed up the whole Pixel line. They should have never used a Samsung modem.

[–] aniki@lemm.ee 2 points 8 months ago

I honestly quite love my 6A and while I'm hype for the telephoto on the pro line, I am not excited for how fucking large it is. I really miss the old Nexus line. Google has mostly been iterating sideways until the 8 and now it's just backwards.

[–] pineapplelover@lemm.ee 2 points 8 months ago (1 children)

Ima still get the pixel 8a tbh just for the more years of support.

[–] aniki@lemm.ee 1 points 8 months ago

I never really hold onto phones long enough for support length to be a consideration.