this post was submitted on 19 Sep 2024
82 points (91.8% liked)

Firefox

18058 readers
173 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago
MODERATORS
k_o_t@lemmy.ml
82
Orbit by Mozilla (orbitbymozilla.com)
submitted 3 months ago by neme@lemm.ee to c/firefox@lemmy.ml
83 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] GenderNeutralBro@lemmy.sdf.org 103 points 3 months ago (3 children)

Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.

Hmm.

>locally hosted

>Google Cloud

Hmmmmmmmmmmmmmmmm.

[–] SzethFriendOfNimi@lemmy.world 43 points 3 months ago* (last edited 3 months ago) (1 children)

Sounds like they’re running their own LLM instance on googles cloud infrastructure vs using something like OpenAI via API.

As web dev parlance it makes sense but for marketing it is definitely confusing and they should do better.

[–] sugar_in_your_tea@sh.itjust.works 2 points 3 months ago

Yeah, we "self-host" our app at AWS at work, which means we configure everything ourselves. I "self-host" a VPS at Hetzner for personal projects, and my actual data is actually self-hosted on a machine on my LAN.

[–] Bitrot@lemmy.sdf.org 26 points 3 months ago* (last edited 3 months ago) (3 children)

It’s a thing.

Remember how the cloud is someone else’s server? Now you can buy it (or lease) and bring it home, and it becomes only sorta someone else’s.

Amazon and Azure offer their own on-prem products.

[–] GenderNeutralBro@lemmy.sdf.org 10 points 3 months ago (1 children)

"Locally hosted" means it's running on the local host. In this case, that would mean on the same computer running Firefox.

Calling something that is only accessible over the internet "locally hosted" is outrageous doublespeak.

[–] Bitrot@lemmy.sdf.org 2 points 3 months ago (1 children)

Why does it mean that?

[–] GenderNeutralBro@lemmy.sdf.org 2 points 3 months ago (1 children)

Why does local mean local? I'm not sure I understand your question.

[–] Bitrot@lemmy.sdf.org 10 points 3 months ago* (last edited 3 months ago) (3 children)

If they had said “locally hosted in our datacenter” would you be confused why they didn’t move a rack into your house?

My question is why are you projecting your limited interpretation as a global truth?

[–] mr_satan@monyet.cc 5 points 3 months ago (1 children)

In IT context local is a well establised term. It's either hosted locally, i. e. on machine running the browser or not. A datacenter or cloud are remote machines also by the same well established definition.

[–] Bitrot@lemmy.sdf.org 3 points 3 months ago (1 children)

Ok, now do your own datacenter vs cloud.

[–] mr_satan@monyet.cc 1 points 3 months ago (1 children)

Huh? What is there to do? Datacenter, cloud computing?

[–] Bitrot@lemmy.sdf.org 4 points 3 months ago

And what term might be used to describe the location of the datacenter down the hall, that is not used to describe the one across the country? It’s pretty standard in IT, but also used outside of IT by normal people for things such as describing a pub.

[–] LWD@lemm.ee 4 points 3 months ago (1 children)

The language is confusing, and Mozilla should fix it themselves.

The important takeaway is: data is sent over an IP address controlled by Google, to a remote server, running Google software. No processing is taking place on someone's local computer.

[–] Bitrot@lemmy.sdf.org 2 points 3 months ago (1 children)

IP address can belong to Mozilla, but the rest is correct.

[–] LWD@lemm.ee 1 points 3 months ago (1 children)
[–] Bitrot@lemmy.sdf.org 1 points 3 months ago

Hadn't checked, that is not a hard requirement for the platform - assuming they actually have it in their infrastructure.

[–] GenderNeutralBro@lemmy.sdf.org 3 points 3 months ago (1 children)

If they had said “locally hosted in our datacenter”

Then that would also be an oxymoron.

Local is the opposite of remote. This is a remote server. Remote servers are not local. This is not a matter of interpretation.

[–] Bitrot@lemmy.sdf.org 2 points 3 months ago* (last edited 3 months ago) (1 children)

It is, actually. It is local to them, it is remote to you. They are differentiating from a remote server in someone else’s datacenter. It is not that confusing.

[–] GenderNeutralBro@lemmy.sdf.org 1 points 3 months ago* (last edited 3 months ago) (1 children)

This is a FAQ for end users, about a feature in software running on end users' computers.

It is absolutely doublespeak to call it "local". Are we supposed to invent an entirely new term now to distinguish between remote and local? Please do not accept this usage. It will make meaningful communication much harder.

Edit: I mean seriously, by this token OpenAI, Google, Facebook, etc. could call their servers "locally hosted". It is an utterly meaningless term if you accept this usage.

[–] LWD@lemm.ee 2 points 3 months ago (1 children)

We actually do have better terminology for "local to Mozilla" and "remote to Mozilla"... It's first party and third party.

And, from the looks of it, Mozilla is indeed using Google Cloud Services as a third party, according to their privacy policy.

[–] Bitrot@lemmy.sdf.org 1 points 3 months ago* (last edited 3 months ago)

That’s a given. Google Cloud Platform is managed through the same Google Cloud Console as everything else, which is in Google’s datacenter, even when it it’s running locally - unless you opt for an air-gapped option. It’s how companies can make data locality claims while using the same tools and one of the selling points pushed by cloud services.

[–] LWD@lemm.ee 1 points 3 months ago

Information We Share.

We use third parties to provide the Service to you, and have contracted with these companies requiring them to protect your information (Third-Party Services):

Google Cloud Platform. Google Cloud Platform (GCP) is a cloud-computing platform. We use GCP to manage services that facilitate responses to user prompts and page summarization.

https://orbitbymozilla.com/privacy

[–] smpl@discuss.tchncs.de 1 points 3 months ago

lol, I think we're giving too little credit to the marketing people in tech. I want to read their blogs!

[–] pmarcilus@discuss.tchncs.de 9 points 3 months ago (1 children)

It just started and already have buzzwords floating around

[–] thingsiplay@beehaw.org 5 points 3 months ago

Probably written by an AI?