this post was submitted on 26 Jul 2023
574 points (99.0% liked)

Technology

34788 readers
344 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] BitSound@lemmy.world 142 points 1 year ago (5 children)

This seems really short-sighted. Why would I go to How Stuff Works when I can just ask the LLM myself?

Maybe there's just no possible business model for them anymore with the advent of LLMs, but at least if they focused on the "actually written by humans!" angle there'd be some hook to draw people in.

[–] chaogomu@kbin.social 114 points 1 year ago (29 children)

The thing is, the LLM doesn't actually know anything, and lies about it.

So you go to How Stuff Works now, and you get bullshit lies instead of real information, you'll also get nonsense that looks like language at first glance, but is gibberish pretending to be an article. Because sometimes the language model changes topics midway through and doesn't correct, because it can't correct. It doesn't actually know what it's saying.

See, these language models are pre-trained, that the P in chatGPT. They just regurgitate the training data, but put together in ways that sort of look like more of the same training data.

There are some hard coded filters and responses, but other than that, nope, just a spew of garbage out from the random garbage in.

And yet, all sorts of people think this shit is ready to take over writing duties for everyone, saving money and winning court cases.

[–] sugar_in_your_tea@sh.itjust.works 26 points 1 year ago (3 children)

Yeah, this is why I can't really take anyone seriously when they say it'll take over the world. It's certainly cool, but it's always going to be limited in usefulness.

Some areas I can see it being really useful are:

  • generating believable text - scams, placeholder text, and general structure
  • distilling existing information - especially if it can actually cite sources, but even then I'd take it with a grain of salt
  • trolling people/deep fakes

That's about it.

[–] ech@lemm.ee 6 points 1 year ago* (last edited 1 year ago)

generating believable text - scams, placeholder text, and general structure

LLM generated scams are going to such problem. Quality isn't even a problem there as they specifically go for people with poor awareness of these scams, and having a bot that responds with reasonable dialogue will make it that much easier for people to buy into it.

load more comments (2 replies)
[–] PipedLinkBot@feddit.rocks 13 points 1 year ago

Here is an alternative Piped link(s): https://piped.video/watch?v=oqSYljRYDEM

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source, check me out at GitHub.

[–] bane_killgrind@kbin.social 9 points 1 year ago (2 children)

Absolutely. Creating new documentation will always be a human sport.

load more comments (2 replies)
[–] Nonameuser678@aussie.zone 8 points 1 year ago

I've graded papers from students who obviously used chatGPT to write them. They were a pass at best. Zero critical synthesis of ideas and application of them to the topic. I'm sure chatGPT has its uses but people really overhype its writing ability. There's more to writing than putting words in the right places.

[–] hoshikarakitaridia@sh.itjust.works 8 points 1 year ago* (last edited 1 year ago)

I mean I would say maybe "regurgitating their training data" is putting it a bit too simple. But it's true, we're currently at the point where the AI can mimic real text. But that's it - no one tells it not to lie rn, the programmatic goal of the AI is to get indistinguishable from real text with no bearing on the truthfulness of the information whatsoever.

Basically we train our AIs to pretend to know, not to know. And sometimes it's good at pretending, sometimes it isn't.

The "right" way to handle what the CEOs are doing would be to let go of a chunk of the staff, then let the rest write their articles with the help of chatgpt. But most CEOs are a bit too gullible when it comes to the abilities of AI.

load more comments (24 replies)
[–] AlmightySnoo@lemmy.world 22 points 1 year ago* (last edited 1 year ago)

It's a combination of three things:

1- most people still google things;

2- the more content you have the more organic traffic you're likely to attract from Google;

3- displaying ads on your website makes you money.

Websites full of LLM generated content are just the natural continuation of MFAs (Made For AdSense) and there were lots of tools on sale back then in the 2006~2008 period that promised to automatically create websites for you and fill them with randomized content that is optimized for AdSense.

[–] BanjoShepard@lemmy.world 16 points 1 year ago (2 children)

This reminds me of the short story "The Great Automatic Grammatizator" by Roald Dahl. In the story a machine is invented that can write great stories, but it's creators go around buying the naming rights of authors so people will actually not their books.

load more comments (2 replies)
[–] LoafyLemon@kbin.social 7 points 1 year ago (3 children)

LLM cannot create new concepts, it can only create a mishmash of things it has been fed on.

[–] Yendor@sh.itjust.works 10 points 1 year ago (1 children)

Humans aren’t much different. 99.9% of what we create is just a remix of existing parts/ideas. It’s why people spend 12-20 years pre-training on all the existing knowledge in the field they’re going to work in.

load more comments (1 replies)
[–] roguetrick@kbin.social 7 points 1 year ago (1 children)

Isn't that exactly how howstuffworks operates though?

load more comments (1 replies)
[–] Arbiter@lemmy.world 5 points 1 year ago

Just like Hollywood!

[–] mrbubblesort@kbin.social 6 points 1 year ago

Correct me if I'm wrong, but isn't AI generated content not copyrightable? Therefore nothing is stopping someone from taking all their content, rebranding it as "how stuff really works" or something, and then start stealing their business & ad revenue.

[–] circuitfarmer@lemmy.sdf.org 109 points 1 year ago (4 children)

This is going to happen for a while. Execs who actually have no clue have now been sold on the idea that AI lets them keep making money without paying labor.

It will fail eventually when the execs eventually take the time to learn what AI is capable of and what it isn't capable of.

Who am I kidding? It'll continue indefinitely because there are few consequences for clueless executives.

[–] vezrien@lemmy.world 26 points 1 year ago (2 children)

Execs won’t take the time to learn that, they will learn it only by losing market share to the competition.

[–] SheeEttin@lemmy.world 27 points 1 year ago

By that time they'll already be at the next company.

[–] evatronic@lemm.ee 8 points 1 year ago

"That was two golden parachutes ago, what do I care?"

[–] Justas@sh.itjust.works 16 points 1 year ago

Businesses should automate the executives instead of labor.

[–] kherge@beehaw.org 10 points 1 year ago

What will probably happen is that people catch on that the content all reads alike and wonder why they shouldn’t just ask ChatGPT directly. Traffic to these sites die down, they panic, and start hiring writers.

[–] worfamerryman@beehaw.org 5 points 1 year ago (1 children)

I see a possibility where these sites eventually become terrible and there is a new person can come in and make content made by humans.

[–] And009@reddthat.com 5 points 1 year ago (1 children)

Even edited by humans would be better than that

load more comments (1 replies)
[–] KiloPapa@lemmy.world 44 points 1 year ago (1 children)

Considering most articles on the internet that don’t come from legitimate newspapers sound like they’re written by a 6-year-old who gets paid by the word, how much worse could it get?

[–] Gradually_Adjusting@lemmy.world 39 points 1 year ago

Never ask that

[–] waterplants@lemm.ee 36 points 1 year ago* (last edited 1 year ago) (3 children)

People really don't understand the current state of LLM, like the pictures generated "Its a really good picture of what a dog would look like, it's not actually a dog". Like a police sketch, with a touch of "randomeness" so you don't always get the same picture.

I'm guessing they will try to solve this issue with some cheap human labour to review what is being generated. These verifers will probably not be experts on all the subjects that the llm will be spitting out, more of a "That does kind of look like a dog, APPROVED".

Let's say I'm wrong, and LLM's can make as good of an article as any human. The content would be so saturated (even a tumblr user could now make as good and as much content as one of these companies), I would expect companies to be joining in on all the strikes 😆.

Funny world we are all going into.

Boas Entradas

[–] Thorny_Thicket@sopuli.xyz 6 points 1 year ago (2 children)

One thing I disagree with is the assumption that anyone could create the same article by themselves. Coming up with a good prompt is a skill in itself and not everyone is equally good at it. I actually believe a prompt writer is going to be a new profession in the near future.

load more comments (2 replies)
load more comments (2 replies)
[–] DidacticDumbass@lemmy.one 34 points 1 year ago (1 children)

Bizarre. Not even keep a few editors for... the editing??

I wonder how this will affect the Stuff You Should Know podcsst.

[–] mechinn@kbin.social 7 points 1 year ago (3 children)

They haven’t been associated for awhile, the company owning HowStuffWorks spun off the podcasting division in 2017 before selling it to iHeartMedia in 2018 https://variety.com/2018/digital/news/iheartmedia-stuff-media-howstuffworks-podcast-acquisition-1202939938/

load more comments (3 replies)
[–] lemann@lemmy.one 27 points 1 year ago (1 children)

Someone should create a blocklist for all these new AI-driven websites.

For me personally thee primary appeal of websites are that there's human authors behind the content... otherwise I'd just ask an 'AI' myself.

[–] GiantBasil@beehaw.org 9 points 1 year ago

It would be great to have a list of sites so id know whose links I can just immediately ignore.

[–] kerneltux@lemmy.world 25 points 1 year ago (2 children)

I've read articles that were clearly created using ChatGPT, there was no extrapolation to add context/details to illustrate their points, and parts of it read like it just pulled from a Wikipedia page. The tone felt more robotic than pieces they published 6~8 months ago.

ChatGPT can be useful when it's part of a larger writing process, but I have a feeling that sites that create prompts and paste the output as their articles will slowly die-off because the quality isn't there.

[–] Ser_Salty@feddit.de 6 points 1 year ago

I was checking something on a Fandom "wiki" the other day and I swear to god the summary for a bunch of episodes for several shows was either written or rewritten by AI. You can tell because it uses a bunch of nonsense synonyms, like replacing the name Ray with Beam.

[–] pingveno@lemmy.ml 6 points 1 year ago

We're probing the limits of generative AI right now. I expect a snapback of sorts as people find what does and does not work.

[–] Tygr@lemmy.world 22 points 1 year ago (1 children)

How about instead of all the tracking cookie popups for permission, we force these sites to display a message that the content is AI generated.

[–] Niello@kbin.social 12 points 1 year ago

Why not both?

[–] Yewb@kbin.social 14 points 1 year ago (1 children)

Creating a market for real human content? Sounds tasty

load more comments (1 replies)
[–] Hagels_Bagels@lemmygrad.ml 14 points 1 year ago (5 children)

Great. Now people are going to read up a bunch of bs generated by a language model and confidently spread around "hallucinations" as facts.

load more comments (5 replies)
[–] vrighter@discuss.tchncs.de 12 points 1 year ago (2 children)

Used to be one of my favourite sites when I was younger. Haven't visited that site in ages. Holy crap, has it gone to complete shit. Like way worse than I thought possible

load more comments (2 replies)
[–] worfamerryman@beehaw.org 12 points 1 year ago (1 children)

How long until we can a browser extension that lets us know when we are on a site written by AI?

I don’t mean AI detection, but instead, sites that announce they are laying off editors in favor of AI.

load more comments (1 replies)
[–] Infinity187@lemm.ee 10 points 1 year ago (5 children)

I wonder how Josh and Chuck from SYSK feel about this.

load more comments (5 replies)
[–] HughJanus@lemmy.ml 10 points 1 year ago* (last edited 1 year ago)

Holy shit. Haven't heard of How Stuff Works since like 2002...

[–] waspentalive@lemmy.one 9 points 1 year ago (1 children)

ChatGPT comments on the news:

Prompt : In recent news, the management of "How it's Made" has fired all the writers and editors on the show and intends to replace them with a large language model. What do you think?

ChatGPT

As an AI language model, I don't have personal opinions or feelings, but I can provide an analysis based on the information available up to my last update in September 2021.

If the management of "How It's Made" decides to fire all the writers and editors on the show and replace them with a large language model like me, there are both potential benefits and drawbacks to consider:

Benefits:

Cost Savings: Employing an AI language model could potentially reduce production costs as it eliminates the need for paying human writers and editors.
Speed and Efficiency: AI models can generate content at a rapid pace, which may allow for more frequent episode releases or updates.
Access to Data: AI models have access to vast amounts of data, which could result in more comprehensive and detailed explanations of the manufacturing processes.
Consistency: AI-generated content can maintain a consistent style and tone throughout the episodes.

Drawbacks:

Lack of Creativity: While AI models can provide factual information, they might struggle to inject creative elements or engage with the audience on a more emotional level.
Human Touch: Human writers and editors bring their unique perspectives and storytelling abilities to the show, which might be missed with an AI-only approach.
Reliability: AI-generated content can sometimes produce errors or inaccurate information, which would require careful human oversight and fact-checking.
Audience Response: The audience's perception of AI-generated content might not be as positive as content created by human professionals, leading to a potential decrease in viewership.

Ultimately, the success of this decision would depend on how well the AI language model can replicate the engaging and informative aspects that made "How It's Made" popular in the first place. It's important for the management to carefully evaluate the pros and cons and ensure a seamless transition if they decide to go down this route. Additionally, audience feedback and receptiveness to the AI-generated content will play a significant role in determining the long-term viability of such a change.

[–] emeralddawn45@discuss.tchncs.de 9 points 1 year ago (2 children)

That's interesting, but just so you know it's the website "how stuff works" not the tv show "how it's made"

[–] nickajeglin@lemmy.one 5 points 1 year ago (1 children)

No shade on "how it's made", it's one of my favorite shows. But I think a LLM could probably write most of the narration. They primarily describe what is happening on screen. You might have to train one special to have information on industrial and manufacturing processes.

load more comments (1 replies)
load more comments (1 replies)
[–] altima_neo@lemmy.zip 8 points 1 year ago

This seems like a really dumb idea.

[–] waspentalive@lemmy.one 7 points 1 year ago (1 children)

I wonder what they will do when the tripe the LLM spews doesn't match the pictures they are showing.

load more comments (1 replies)
load more comments
view more: next ›