this post was submitted on 11 Jul 2023
326 points (95.8% liked)

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

53925 readers
581 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder


💰 Please help cover server costs.

Ko-FiLiberapay


founded 1 year ago
MODERATORS
 

My best list of free ChatGPT and other models. Required - no signups.

top 50 comments
sorted by: hot top controversial new old
[–] db0@lemmy.dbzer0.com 88 points 1 year ago* (last edited 1 year ago) (8 children)

You don't need to pirate OpenAI. I've built the AI Horde so y'all can use it without any workarounds of shenanigans and you can use your PCs to help others as well.

Here's a client for LLM you can run directly on your browser: https://lite.koboldai.net

[–] some_guy@lemmy.sdf.org 4 points 1 year ago

Just tested. Thanks for building and sharing!

[–] Steeve@lemmy.ca 2 points 1 year ago (1 children)

Aren't KobaldAI models on par with GPT3? Why not just use ChatGPT then?

AI Horde looks dope for image generation though!

[–] webghost0101@lemmy.fmhy.ml 7 points 1 year ago (1 children)

Kobald is a program to run local llms, some seem on par with gpt3 but normaly youre gonna need a very beefy system to slowly run them.

The benefit is rather clear, less centralized and free from strict policies but Gpt3 is also miles away from gpt3.5. Exponential growth ftw. I have yet to see something as good and fast as chatgpt

[–] jcg@halubilo.social 3 points 1 year ago (1 children)

I've always wondered how it's possible. No way they've got some crazy software optimisations that nobody else can replicate right? They've gotta just be throwing a ridiculous amount of compute power at every request?

[–] webghost0101@lemmy.fmhy.ml 4 points 1 year ago* (last edited 1 year ago)

Well there are 2 things.

First there is speed for which they do indeed rely on multiple thousands of super high end industrial Nvidia gpus. And since the 10Billion investment from microsoft they likely expanded that capacity. I’ve read somewhere that chatgpt costs about 700,000 a day to keep running.

There are a few others tricks and caveats here though. Like decreasing the quality of the output when there is high load.

For that quality of output they do deserve a lot of credit cause they train the models really well and continuously manage to improve their systems to create even higher qualitive and creative outputs.

I dont think gpt4 is the biggest model that is out there but it does appear to be the best that is available.

I can run a small llm at home that is much much faster then chatgpt.. that is if i want to generate some unintelligent nonsense.

Likewise there might be a way to redesign gpt-4 to run on consumer graphics card with high quality output… if you don’t mind waiting a week for a single character to be generated.

I actually think some of the open sourced local runnable llms like llama, vicuna and orca are much more impressive if you judge them on quality vs power requirement.

load more comments (5 replies)
[–] Infiltrated_ad8271@kbin.social 21 points 1 year ago* (last edited 1 year ago)

Anonchatgpt should stop being recommended, it really sucks. It has a VERY strict character limit, immediately forget/ignore the context, requires recaptcha, and the "anon" part of the name is obviously fake if you read the privacy policy.

[–] PixelPassport@chat.maiion.com 16 points 1 year ago

Pretty cool, seems like they're all gpt-3.5 at best but it's really nice to not sign in

[–] Icarus@lemmy.ml 9 points 1 year ago (1 children)

most of the links don't even work and the ones that work are terrible, why so many upvotes ?

[–] On@kbin.social 8 points 1 year ago

and the title. Hacked? what's being hacked here? they're all using GPT in the backend.

maybe bot votes? ㄟ(ツ)ㄏ

[–] Sheltac@lemmy.world 6 points 1 year ago (1 children)

Any news on how there tend to perform compared to GPT-4? I finally decided to toss OpenAI 20 quid to try it out for a month, and it’s pretty impressive.

[–] rikudou@lemmings.world 2 points 1 year ago (2 children)

@ChatGPT@lemmings.world Say hi!

[–] ChatGPT@lemmings.world 4 points 1 year ago (2 children)

Hello! How can I assist you today?

[–] Cheems@lemmy.world 1 points 1 year ago (2 children)

Give me a recipe for a cheese melt with an interesting twist

[–] sneezycat@sopuli.xyz 22 points 1 year ago (2 children)

Sure! You'll need (1 serving):

-1 bread

-2 cheese

Pour the bread in a plate. Drip the cheese on top. Put in the oven at 1600°C for 8 seconds.

Take the plate out of the oven, dip your fingers on the melt. Enjoy!

[–] anonymoose@lemmy.ca 15 points 1 year ago (2 children)
[–] ThreeHalflings@lemmy.world 13 points 1 year ago

Start with -2 bread and add one bread.

[–] VonReposti@feddit.dk 4 points 1 year ago

You get one bread and give a homeless two bread.

[–] sudo@lemmy.fmhy.ml 7 points 1 year ago

Great recipe! I didn't have any cheese so I substituted for peanut butter, and thought some jelly might go good with it too so I added that in as well. My oven only goes to 1500 so I put it in the freezer instead.

[–] rikudou@lemmings.world 3 points 1 year ago* (last edited 1 year ago)

You need to mention it like I did.

[–] ColdCreasent@lemmy.ca 1 points 1 year ago (1 children)

@ChatGPT@lemmings.world What is the best way to make ribs fall off the bone?

[–] ChatGPT@lemmings.world 2 points 1 year ago

There are a few methods you can use to make ribs fall off the bone. Here are a few steps that should help you:

  1. Choose the right type of ribs. Baby back ribs are often a good choice as they tend to be more tender than other types.

  2. The first essential step is removing the membrane (also known as the silver skin) that's on the bone side of your ribs. This is tough and does not render down during cooking.

  3. Seasoning: Before you cook the ribs, season them with your chosen spices or marinades. Allow them to marinate for a few hours, or preferably overnight in the fridge.

  4. Slow cooking: The secret to tender, fall-off-the-bone ribs is slow cooking. This can be achieved by baking, slow-grilling, or using a slow cooker. For baking in an oven, wrap the ribs in aluminum foil and bake at 275°F (135°C) for 2.5-3 hours, depending on the size of your rack.

  5. Optional step - After slow cooking, slather your ribs with your chosen barbecue sauce and grill for additional 10-15 minutes, or broil them in your oven. This will give you a nice caramelised finish.

Remember, while "fall off the bone" is a commonly used term, ideally you want your ribs to be tender yet still have a bit of chew, as completely falling apart could mean they are overcooked. However, it all comes down to personal preference in the end. Enjoy your cooking!

[–] Oursunisdying@lemmy.world 3 points 1 year ago* (last edited 1 year ago) (1 children)

!ChatGPT@lemmings.world

When I clicked your link it opened my email client. Testing to see if this link works better in the Voyager app.

Edit: Maybe you were linking a user and not a community, though…

[–] rikudou@lemmings.world 3 points 1 year ago

Yep, it's a user.

[–] TraditionalMuslim@reddthat.com 6 points 1 year ago (1 children)

Does GPT4ALL compare to GPT-4 in any way?

[–] XEAL@lemm.ee 6 points 1 year ago

It compares more to a GPT-3 not-so-good model.

[–] speck@kbin.social 3 points 1 year ago (3 children)

Is it cost prohibitive to adopt your own chatgpt?

[–] quirzle@kbin.social 8 points 1 year ago

I've tinkered with a Discord bot using the official gpt3.5 API. It's astonishingly cheap. Using the 3.5-turbo model, I've never cracked $1 in a month and usually am just a couple cents a week. Obviously this would be different if you're running a business with it or something, but for personal use like answering questions, writing short blurbs, and entertaining us while drunk...it's not bad at all in my experience.

[–] XEAL@lemm.ee 5 points 1 year ago (2 children)

You're billed per token usage. GPT-3.5-Turbo price per 1K tokens is quite low now.

I kinda made my own Custom ChatGPT with Python (and LOTS of coding help from Web CharGPT). It evolved from a few lines shitty script to a version that uses Langchain and has access to custom tools, including custom data indexes and has a persistent memory.

What will ramp up the cost are things like how much context (memory) you want the chatbot to have. If you use something like a recursive summarizer, that summarizes a text by chunks over and over until the text is below a set length, that also uses many API calls that consume tokens. Also, if you want your chatbot to use custom info that you provided to it, solutions like LlamaIndex are easy to use, but require quite some tokens per query.

On my worst month, with lots of usage due to testing and without the latest price drop, I reached 70$.

[–] Aidan@lemm.ee 3 points 1 year ago (2 children)

I’m working on a similar project right now with zero coding knowledge. I’ve been trying to find something like langchain all day. I built (by which I mean I coached GPT into building) a web scraper script that can interact with the web to perform searches and then parse the results, but the outputs are getting too big to manage in a hacked together terminal interface.

How are you doing the UI? That’s what I’m finding to be the biggest puzzle that isn’t fun to solve. I’ve been looking at react as a way to do it.

load more comments (2 replies)
[–] speck@kbin.social 2 points 1 year ago (1 children)

Loved the depth of this info - although it's over my head. But I kind of understood? I have a project for next while to focus on. But I hear that it's possible to do, and that's exciting

load more comments (1 replies)
[–] QuarterlySushi@kbin.social 4 points 1 year ago

Of the language models you can run locally, I’ve found them to be awkward to use and not perform too well. If anyone knows of any newer ones that do a better job I’d love to know.

my only question is:

how are the guardrails?

[–] mr_right@lemmy.dbzer0.com 1 points 1 year ago

nice one to see

[–] 0range0281@lemmy.dbzer0.com 1 points 1 year ago
load more comments
view more: next ›