this post was submitted on 12 Jan 2024
59 points (77.6% liked)

Technology

59346 readers
7497 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

For those of you who don't want to use a ChatGPT but want a LLM.

all 19 comments
sorted by: hot top controversial new old
[–] sir_reginald@lemmy.world 20 points 10 months ago* (last edited 10 months ago)

As it's to be expected from this website, the article quality is subpar.

They mix third party hosted LLMs, with frontends (KoboldAI, GPT4ALL) and with local models (which BTW, every single one of them is a llama finetune. They've never heard of mistral or others, apparently).

If I hadn't read this website years ago and knew that the quality was already trash back then, I'd say this very article was written by a LLM.

[–] BetaDoggo_@lemmy.world 12 points 10 months ago (1 children)

Very strange article. It lists several front ends, some of which are not open source, as well as some raw models without clearly distinguishing between them. RWKV was mentioned which is cool I guess.

The first option listed should have been huggingchat, followed by the various local UIs, with a separate section discussing the models themselves.

[–] Chewy7324@discuss.tchncs.de 5 points 10 months ago

I feel like most of these "10 alternatives to xyz"-articles are basically a summary of alternativeto.net. Or they've just listed all projects they've found with a quick search. I'm almost certain they didn't install them most of the time.

This also applies to "comparison" sites, which usually are a list of Amazon affiliate links. At this point, I don't trust websites with affiliate links anymore, as they've never actually tried the products. Sadly those spam sites make it difficult to find actually good reasearched tests.

Back to itsfoss, they write many articles, and some are good, but they still are blog spam.

[–] cyd@lemmy.world 11 points 10 months ago* (last edited 10 months ago)

Pretty bad article, but here are my two cents on the actual answer, as of right now:

  • General chatting: OpenHermes
  • General querying, instruction: Mistral
  • Coding: Deepseek-coder

These perform similar to or better than ChatGPT 3.5, in some cases comparable to 4.

For specific niche applications (role playing, nsfw stories, etc), just search on huggingface.co and read the user reviews.

[–] db0@lemmy.dbzer0.com 7 points 10 months ago* (last edited 10 months ago) (1 children)

No mention of the ai horde , seriously? We have thousands of users!

[–] Secret300@sh.itjust.works 4 points 10 months ago

That's dope never heard of it until now

[–] General_Effort@lemmy.world 6 points 10 months ago

It's a bad list.

YSK: There are several things mixed in it.

  1. There are "models" (usually meaning "weights" specifically). The models (weights) are the raw data that contain the wisdom of the AIs.
  2. There is software to "run" these models on your own machine, or to connect to an API.
  3. There are services which run models for you and let you interact via web interface, app, or API. Some services may add text to your prompt, to create a better(?) prompt.

There is a bewildering array of models out there. Mostly, they are specialized and/or merged versions of some popular foundation models (by mistral, meta, and a few others). Without endorsing any service, I find that openrouter.ai and together.ai let you try a fairly large selection. There are other services.

You can find more/better information here: !localllama@sh.itjust.works

[–] Papanca@lemmy.world 6 points 10 months ago (1 children)
[–] abort_christian_babies@lemmy.world 25 points 10 months ago (5 children)

I asked it “how are you?”

After waiting 5 minutes it errors and my browser crashed.

[–] DemBoSain@midwest.social 12 points 10 months ago

That's a perfectly acceptable response from Gen-A.

[–] Imgonnatrythis@sh.itjust.works 6 points 10 months ago

That would be my answer too TbF

[–] RunOnSmoothFrozenIce@lemmy.world 4 points 10 months ago

Shit...it's become self aware.

[–] Papanca@lemmy.world 1 points 10 months ago (1 children)

That's unfortunate! I never had it crash and i use it a lot

[–] Caligvla@lemmy.dbzer0.com 1 points 10 months ago

Yeah... That's the problem with FOSS LLMs, either you have a whole expensive setup to run your own personal AI chatbot or you might as well just use ChatGPT.

[–] Evotech@lemmy.world 2 points 10 months ago

Also want to mention privateGPT

[–] Substance_P@lemmy.world 1 points 10 months ago* (last edited 10 months ago)

I've been using iask.ai or Phind.com for mostly quick answers to my simple questions, these get me by but I'm no coder or author and I have noticed these options are often pretty terrible for math queries.

Edit: the above services I'm pretty sure are not open source, but their privacy policies seem reasonable.

[–] homoludens@feddit.de 0 points 10 months ago* (last edited 10 months ago)

Holy Cyberjesus... I don't experience with ChatGPT and the likes, and it's obviously only one response, but the answer I got from https://api.together.xy to "Is it okay to do intense tempo runs in winter?" is absolutely useless and wrong and neglecting the actual problems that are usually mentioned (cold air while breathing intensely):

Intense tempo runs are usually done at tempo, which means that your foot contacts the ground after a relatively long time. This is different from the typical duration of a foot contact in normal running. In normal running, the foot contacts the ground after a relatively short time. In a tempo run, the duration of your foot contact with the ground is increased, which causes you to run at a faster pace than usual.

Intense tempo runs are typically done in the winter, when the ground is harder and more difficult to run on. Hard ground can be more damaging to your body, so it's important to be careful when running on snow, ice, or concrete. It's important to take safety precautions when doing intense tempo runs in the winter, such as wearing proper shoes and clothing, and avoiding running on icy or snowy surfaces.

It's important to note that intense tempo runs can be dangerous if not done properly. It's important to have a good understanding of your body and what works best for you. It's also important to consult with a doctor before starting any new running program, especially if you have any previous injuries or health concerns.