this post was submitted on 09 Aug 2023
3 points (80.0% liked)

ChatGPT

8813 readers
19 users here now

Unofficial ChatGPT community to discuss anything ChatGPT

founded 1 year ago
MODERATORS
 

We all know by now that ChatGPT is full of incorrect data but I trusted it will no go wrong after I asked for a list of sci-fi books recommendations (short stories anthologies in Spanish mostly) including book names, editorial, print year and of course ISBN.

Some of the books do exist but the majority are nowhere to be found. I pick the one that caught my interest the most and contacted the editorial directly after I did not find it in their website or anywhere else.

This is what they replied (Google Translate):


ChatGPT got it wrong.

We don't have any books with that title.

In the ISBN that has given you the last digit is incorrect. And the correct one (9788477028383) corresponds to "The Holy Fountain" by Henry James.

Nor have we published any science fiction anthologies in the last 25 years.


I quick search in the "old site" shows that others have experienced the same with ChatGPT and ISBN searches... For some reason I thought it will no go wrong in this case, but it did.

top 3 comments
sorted by: hot top controversial new old
[โ€“] themoonisacheese@sh.itjust.works 1 points 1 year ago (1 children)

ChatGPT is a text predictor. You are not asking it for book recommendations, you are writing "some good books are:" and hoping that glorified autocorrect will somehow come up with actual books to complete the sentence.

This effect is compounded by the fact that it is trained to predict text that will make you click the thumbs up button and not the thumbs down one. Saying "here are some books" and inventing makes you more likely to click ๐Ÿ‘ or doing nothing, saying "as an AI language model, I do not know about books and cannot accurately recommend good books" makes you more likely to click ๐Ÿ‘Ž, so it doesn't do that.

Expecting chatGPT to do anything about the real world beyond writing text "creatively" is a fool's errand.

[โ€“] Fixbeat@lemmy.ml 0 points 1 year ago (1 children)

Okay, but how does a text predictor know how to program?

[โ€“] inverimus@lemm.ee 1 points 1 year ago

Its training data had a lot of code in it. It does the same thing with code that it does with any other text, predict the next token given the previous tokens.