Hello sailors,
I have been job hunting for a while and I have felt a great disadvantage in my job search due to my lack of access to high-quality LLMs. Writing cover letters is honestly so bullshit. GPT-3 is honestly quite bad nowadays, but as a true pirate at heart I couldn't quite get myself to cough up the coin for OpenAI's GPT4 out of principle. I hate them for putting their cutting edge technology behind a paywall, making it inaccessible for their own gain. I feel like this is not what the internet was supposed to be. So today, call me the great emancipator cuz i'm teaching u how to get that shi for free baby
Requirements: Docker
It's all gonna be based off of this github repo: gpt4free
Installing through docker (there's also a way to install with Python PIP if that's more convenient for you. The docker worked for me though)
-
docker pull hlohaus789/g4f -
docker run -p 8080:8080 -p 1337:1337 -p 7900:7900 --shm-size="2g" -v ${PWD}/hardir:/app/hardir hlohaus789/g4f:latest -
Open up the webui in your browser at localhost:8080
-
In the "Provider" dropdown in the bottom look for "Liaobots"
-
Choose "gpt-4-plus" under the "Models" dropdown
??? Profit
The cool thing about gpt4free is that there's a lot of providers and a lot of models to choose from! So if gpt-4-plus from Liaobot doesn't work for you you can switch to something else easily. Do note that some models require you to provide an authentication token or be logged in. Most of them work right out of the box tho.
*this post was not made with any use of an llm I promise ;)
^^list of gpt4 providers
Oh and also for docker noobs, you might wanna put a
sudobefore the docker commands ;)You don't have to if you follow the documentation.
Hmm. I’m confused. This is a snippet from archwiki: https://wiki.archlinux.org/title/docker
Is it better to add the user to the docker group instead?
Yes
But what about: https://stackoverflow.com/questions/51218233/docker-why-do-i-need-to-sudo-in-linux
If i understand correctly, adding my home user to the docker group can allow other non-root user programs to leverage the ‘docker run —privileged’ command to elevate their permissions. Sounds like adding ‘sudo’ is a good security measure no?
It is 👍
Do not sudo docker... And run images you don't deeply know, connected to services you don't host.