ddx7

joined 1 year ago
[–] ddx7@lemmy.world 1 points 1 year ago

lamacpp is kind of this. you give it a path to a model and a prompt. download a smallish model GGUF file by thebloke. lamacpp main exec has an interactive mode too which can function like a chatbot. i never built it on android though maybe you need android NDK