this post was submitted on 16 Jul 2023
80 points (100.0% liked)

Technology

37711 readers
373 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
alyaza@beehaw.org
TheRtRevKaiser@beehaw.org
gyrfalcon@beehaw.org
rs5th@beehaw.org
Los@beehaw.org
coldredlight@beehaw.org
SemioticStandard@beehaw.org
TheRtRevKaiser@kbin.social
remington@beehaw.org
80
AI model output quality decreases when trained with AI models (futurism.com)
submitted 1 year ago by shanghaibebop@beehaw.org to c/technology@beehaw.org
66 comments fedilink hide all child comments
 

"Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease," they added. "We term this condition Model Autophagy Disorder (MAD)."

Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.

you are viewing a single comment's thread
view the rest of the comments
[–] FaceDeer@kbin.social 1 points 1 year ago (1 children)

Humans are not entirely trained on other humans, though. We learn plenty of stuff from our environment and experiences. Note this very important part of the primary conclusion:

without enough fresh real data in each generation

[–] lol3droflxp@kbin.social 1 points 1 year ago (1 children)

Math for example is something one could argue is purely taught by humans.

[–] FaceDeer@kbin.social 2 points 1 year ago* (last edited 1 year ago)

Dogs can do math and I'm quite sure I've never taught my dog that deliberately.

Even for humans learning it, I would expect that most of our understanding of math comes from everyday usage of it rather than explicit rote training.