this post was submitted on 10 Jul 2023
85 points (98.9% liked)

World News

39050 readers
2452 users here now

A community for discussing events around the World

Rules:

Similarly, if you see posts along these lines, do not engage. Report them, block them, and live a happier life than they do. We see too many slapfights that boil down to "Mom! He's bugging me!" and "I'm not touching you!" Going forward, slapfights will result in removed comments and temp bans to cool off.

We ask that the users report any comment or post that violate the rules, to use critical thinking when reading, posting or commenting. Users that post off-topic spam, advocate violence, have multiple comments or posts removed, weaponize reports or violate the code of conduct will be banned.

All posts and comments will be reviewed on a case-by-case basis. This means that some content that violates the rules may be allowed, while other content that does not violate the rules may be removed. The moderators retain the right to remove any content and ban users.


Lemmy World Partners

News !news@lemmy.world

Politics !politics@lemmy.world

World Politics !globalpolitics@lemmy.world


Recommendations

For Firefox users, there is media bias / propaganda / fact check plugin.

https://addons.mozilla.org/en-US/firefox/addon/media-bias-fact-check/

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] MartianSands@sh.itjust.works 2 points 1 year ago

it is absolutely true that that AI keeps record of everything fed into it

No it isn't.

A properly trained deep learning system will ultimately far smaller than all of the data it's been trained on. It's simply impossible for it to have retained a record of very much of it at all.

When everything is working correctly it shouldn't have any of the actual text stored at all. Certainly every single piece of training data will have left some impression on the model, but that's a very long way from actually storing the training data. The model consists of statistical relationships, not a copy-paste of the inputs.

Strictly speaking there is something resembling text in the model, but it's made up of the smallest possible units of language (unless there's been overfitting, in which case the training has gone wrong and there probably would be a case to answer).

The model builds sentances from a list of "phrases" which don't even need to line up with word boundaries. Things like "is a" might be treated as a "word", as might "ing", if the model finds that to be a useful snippet.