this post was submitted on 22 Jul 2024
9 points (100.0% liked)

Free and Open Source Software

17911 readers
39 users here now

If it's free and open source and it's also software, it can be discussed here. Subcommunity of Technology.


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
 

Been having too much fun using LLMs hosted locally, but can't seem to get Ollama's chat with documents to work well. Lots of "what are you talking about? There are no documents here" issues. Does anyone have any recommendations to either a) figure out what's going wrong or b) Alternative locally hosted options that chat with documents works well with (GPT4all or something?)

you are viewing a single comment's thread
view the rest of the comments
[–] its_me_xiphos@beehaw.org 1 points 3 months ago

Thanks for this. Time to play around and experiment.