this post was submitted on 10 Aug 2024
549 points (96.0% liked)
Technology
59174 readers
3167 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
They absolutely cannot reliably summarize the result of searches, like this post is about, and OP in and of itself proves conclusively.
Any meaningful rate of failures at all makes them massively, catastrophically damaging to humanity as a whole. "Just don't use them" absolutely does not prevent their harm. Pushing them as competent is extremely fucking unacceptable behavior.
And this is all completely ignoring the obscene energy costs associated with making web searches complete and utter dogshit.
The problem is that it did summarize the result of this search, the results of this search included one of those "if the Earth was the size of a grain of sand, Alpha Centauri would be X kilometers away" analogies. It did exactly the thing you're saying it can't do.
Nothing is perfect. Does that make everything a massive catastrophic threat to humanity? How have we managed to survive for this long?
You're ridiculously overblowing this. It's a "ha ha, looks like AI made a whoopsie because I didn't understand that I actually asked it to do" situation. It's not Skynet coming to convince us to eat cyanide.
Of course it's ignoring that. It's not real.
You realize that energy costs money? If each web search cost an "obscene" amount, how is Microsoft managing to pay for it all? Why are they paying for it? Do you think they'll continue paying for it indefinitely? It'd be a completely self-solving problem.
Summaries distinguish substance from nonsense. It cannot be described as a summary of a piece of content if it does not accurately portray the substance of that content.
LLMs aren't imperfect. They're dumpster fire misinformation machines with no redeeming qualities. Of course it's not Skynet. Skynet was intelligent. This isn't within 100 orders of magnitude of intelligence.
Companies burn obscene amounts of money on moonshots all the time, even ones that have no possibility of success. Willingness to lose billions burning energy to degrade every single search made is not an indication that it's not a nightmare for the environment (again, for literally no purpose because every single search with an LLM is worse than without it).
No, a summary is just a condensed version of some larger work. If the larger work contains bullshit then so can the summary, that doesn't stop it from being a summary. As you say, a summary accurately portrays the substance of that content. In this case there was content that said Alpha Centauri was 13 km from Earth, so the summary said that too.
This is really not complicated.
If you think it has no possibility of success, sit back and relax as AI goes away.
Yep. This is exactly it, and this is what people don't seem to understand. AI is not going away, because it is actually useful, it has actual uses and people are actively using it. It's not entirely fluff based pointless technology like blockchain etc, it is actually useful and real-world people use AI/LLMs.
This is just not true.
Just because you don't like LLMs doesn't mean that they have no purpose. If they were really entirely useless and served no purpose and never did anything, they would not be the talk of the town and OpenAI would not be a multi-billion dollar company. If they were useless, nobody would use them, but people absolutely do use them.
I literally use ChatGPT daily to automate writing code for me and it honestly does a good job. I literally used it to write an entire Laravel project called ArigatouAnimeTracker, over 600 commits including documentation all written using ChatGPT, and tbh my project is awesome. It easily would have taken me 5x as long to write it without ChatGPT and tbh it might not have ended up existing without ChatGPT because of how long it would have taken to write without LLMs doing the heavy lifting.
Sure, you have to verify the output, but you know what? That's going to be the case for any code that is written regardless, code review is essential and completely normal and existed long before LLMs did. That doesn't mean that LLMs don't have a purpose, or that nobody actually uses them. People do use them, it's a multi-billion dollar industry for a reason and people are going to continue to use them, even if you say they have no redeeming qualities. There are definitely ethical concerns about LLMs, but to say they have no redeeming qualities is just not correct.
Regardless, anything I say about AI/LLMs that isn’t that it’s terrible and useless and nobody should/would ever use it is going to be met with criticism.
I disagree with that view on them, and I think the fact that they fail is actually a good thing in terms of preventing damage to humanity.
If they are able to perfectly do all kinds of jobs without ever making mistakes and being better at it than any humans, that would be infinitely more damaging than having them make mistakes meaning their use is limited to having to have their output carefully reviewed yet still used when it is helpful and appropriate.
Regardless, anything I say about AI/LLMs that isn't that it's terrible and useless and nobody should/would ever use it is going to be met with criticism.