this post was submitted on 16 Nov 2024
31 points (100.0% liked)

TechTakes

1493 readers
120 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] blakestacey@awful.systems 17 points 1 month ago* (last edited 1 month ago)

From the Wired story:

As a comparison, Cui cited another analysis that GPTZero ran on Wikipedia earlier this year, which estimated that around one in 20 articles on the site are likely AI-generated—about half the frequency of the posts GPTZero looked at on Substack.

That should be one in 20 new articles, per the story they cite, which is ultimately based on arXiv:2410.08044.

David Skilling, a sports agency CEO who runs the popular soccer newsletter Original Football (over 630,000 subscribers), told WIRED he sees AI as a substitute editor. “I proudly use modern tools for productivity in my businesses,” says Skilling.

Babe wake up, a new insufferable prick just dropped.

Edit to add: There's an interesting example here of a dubious claim being laundered into truthiness. That arXiv preprint says this in the conclusion section.

Shao et al. (2024) have even designed a retrieval-based LLM workflow for writing Wikipedia-like articles and gathered perspectives from experienced Wikipedia editors on using it—the editors unanimously agreed that it would be helpful in their pre-writing stage.

But if we dig up arXiv:2402.14207, we find that the "unanimous" agreement depends upon lumping together "somewhat" and "strongly agree" on their Likert scale. Moreover, this grand claim rests upon a survey of a grand total of ten people. Ten people, we hasten to add, who agreed to the study in the first place, practically guaranteeing a response bias against those Wikipedians who find "AI" morally repugnant.