acec

joined 1 year ago
 

[–] acec@lemmy.world 12 points 8 months ago (2 children)

Can we say genocide already?

 

I don't get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit

[–] acec@lemmy.world 2 points 1 year ago

Decent enough for a model 50 times smaller than ChatGPT. I use orca_mini_3b.

[–] acec@lemmy.world 23 points 1 year ago (9 children)

Compile llama.cpp, download a small GGML LLM model and you will have a quite intelligent assiatant running into your phone.