this post was submitted on 02 Nov 2023
27 points (90.9% liked)

LocalLLaMA

2207 readers
7 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
 

I don't get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit

top 15 comments
sorted by: hot top controversial new old
[–] kakes@sh.itjust.works 19 points 10 months ago (1 children)

Maybe they don't know about Lemmy, or maybe they want to run LLMs locally for reasons other than idealism?

[–] SamXavia@kbin.run 16 points 10 months ago (2 children)

@acec I think it's a mix of reasons why really;

  1. They've been using it for years
  2. A lot of there favourite subs are on there and they are admins of those subs giving them power
  3. A good amount of them don't know about the Fediverse and that they could run a similar sub on the Fediverse
  4. Change, a good amount of Redditors are most likely Autistic and don't want things to change.
[–] drkt@feddit.dk 2 points 10 months ago

of there favourite subs are on there and they are admins of those subs giving them

Resistance to change is not an autistic thing in this context; people just don't want to fiddle with things that work.

[–] EatYouWell@lemmy.world 0 points 10 months ago

Not just redditors, but people in the tech sector.

[–] rufus@discuss.tchncs.de 8 points 10 months ago

We only got about 40000 active users here on Lemmy. Guess most people like to see dozens of posts per day even in a niche community. I like it here. But I guess it's going to be difficult to attract users from /r/LocalLLaMA And as far as I know we haven't advertised there yet. I'm still not sure if we should...

[–] wandermind@sopuli.xyz 5 points 10 months ago* (last edited 10 months ago) (1 children)

Because it's not ideological, they just want to generate porn, which is against OpenAI TOS.

[–] rufus@discuss.tchncs.de 3 points 10 months ago* (last edited 10 months ago)

To be fair, I saw /r/LocalLLaMA referenced in a scientific paper ("bloc97" in the paper about Streaming-LLM) talking about NTK-aware RoPE scaling. Which is kind of an awesome achievement.

And to me it's fascinating that Reddit is generally friendly towards porn. I think they have started to restrict adult content with their API change but so far there are lots of corners where you can even post pictures of your member. And that's not really possible on many of the other big commercial online platforms. I wonder where they're headed in the long term.

[–] Cheers@sh.itjust.works 3 points 10 months ago

Personally speaking, the issue isn't I don't want to rely on them, it's that I can't use them for my use case because it'd be a HIPPA violation.

The alternative is a run a local/cloud version that I control. Discussing the set up process can be done on reddit without endangering patients.

[–] mixtral@sh.itjust.works 1 points 9 months ago

For me, I found only one group about LLM here in search. You can make Lemmy better if share another groups for similar topics since search feature doesn't work well yet.

[–] cro_magnon_gilf@sopuli.xyz -1 points 10 months ago (1 children)

Because reddit is a comfy echo chamber where people are banned for opposing the ruling dogmas in the subs. People love that

[–] corrupts_absolutely@sh.itjust.works 3 points 10 months ago (1 children)

as opposed to any other form of communication where non-conformance is sought out

[–] cro_magnon_gilf@sopuli.xyz 1 points 10 months ago (1 children)

Not sure what you're saying

[–] Maalus@lemmy.world 1 points 10 months ago

That everywhere gets you banned for doing exactly what you said. Hell, lemmy is full of powertripping moderators. There is a log full of bullshit one word explanations for banning people.