this post was submitted on 31 Dec 2024
82 points (72.0% liked)

Firefox

18166 readers
2 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago
MODERATORS
k_o_t@lemmy.ml
82
Meet Orbit, Mozilla's AI Assistant Extension for Firefox (www.omgubuntu.co.uk)
submitted 1 month ago by KarnaSubarna@lemmy.ml to c/firefox@lemmy.ml
55 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] KarnaSubarna@lemmy.ml 4 points 1 month ago* (last edited 1 month ago)

My (docker based) configuration:

Software stack: Linux > Docker Container > Nvidia Runtime > Open WebUI > Ollama > Llama 3.1

Hardware: i5-13600K, Nvidia 3070 ti (8GB), 32 GB RAM

Docker: https://docs.docker.com/engine/install/

Nvidia Runtime for docker: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html

Open WebUI: https://docs.openwebui.com/

Ollama: https://hub.docker.com/r/ollama/ollama