Self Hosted - Self-hosting your services.

11399 readers

2 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules

No harassment
crossposts from c/Open Source & c/docker & related may be allowed, depending on context
Video Promoting is allowed if is within the topic.
No spamming.
Stay friendly.
Follow the lemmy.ml instance rules.
Tag your post. (Read under)

Important

Beginning of January 1st 2024 this rule WILL be enforced. Posts that are not tagged will be warned and if not fixed within 24h then removed!

Lemmy doesn't have tags yet, so mark it with [Question], [Help], [Project], [Other], [Promoting] or other you may think is appropriate.

Cross-posting

!everything_git@lemmy.ml is allowed!
!docker@lemmy.ml is allowed!
!portainer@lemmy.ml is allowed!
!fediverse@lemmy.ml is allowed if topic has to do with selfhosting.
!selfhosted@lemmy.ml is allowed!

If you see a rule-breaker please DM the mods!

founded 3 years ago

MODERATORS

Zoe8338@lemmy.ml

dogmuffins@lemmy.ml

testman@lemmy.ml

[Question] What are some good selfhostable ChatGPT alternatives? (lemmy.ml)

submitted 1 year ago by Weirdbeardgame@lemmy.ml to c/selfhost@lemmy.ml

10 comments fedilink hide all child comments

What the title says. Are there any good ChatGPT alts that can be self hosted?

top 9 comments

sorted by: hot top controversial new old

[–] Weirdbeardgame@lemmy.ml 4 points 1 year ago

Serge I've heard good things about this one as well.

[–] CanOpener@sh.itjust.works 3 points 1 year ago

I've tried https://github.com/oobabooga/text-generation-webui with LLaMA, didn't have enough VRAM to run it though.

[–] zephyrvs@lemmy.ml 3 points 1 year ago

Llama.cpp + Wizard Vicuna (Uncensored, if you want to get the real thing) + one of the web interfaces that are compatible. Should be listed in the readme.

Or try gpt4all which is much easier to use and even offers a selection of downloadable models.

7B/13B/30B+ depends on your hardware, especially GPU.

[–] frap129@lemmy.maples.dev 2 points 1 year ago

I use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.

[–] HumanPerson@sh.itjust.works 1 points 1 year ago

I believe gpt4all has a self-hostable web interface but I could be wrong. Still it can run on relatively low end hardware (relatively because it still needs a decent amount) and you could just use it on your local computer.

[–] mrmojo@beehaw.org 1 points 1 year ago* (last edited 1 year ago)

Hi, I think localAi is a good place to start.

[–] ddtfrog@lemm.ee 1 points 1 year ago

Codestar for dev

load more comments