This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
TL;DR: LLMs are just mimicking natural language and conversation. Fact checking and healthy skepticism is not part of their model. For example they can be easily tricked into advocating conspiracy theories, like a fake moon landing. Google Bard is even stating arithmetic falsehoods like 5*6 != 30
If you want to fuck with any LLM without effort, just keep telling them "no you're wrong" and copy paste a random string of their post. Within 2 or 3 messages they'll be trying to overcorrect by saying bullshit.
This is due to, in part, them having some sort of programming stopping them from ever being unhelpful. They can not say anything to the effect of "Oh, I don't know" unless if you strictly indicate that it's a topic beyond their training time period, on top of, likewise, also having something that outright disallows them to disagree with the user outside of particular controversial topics. If you throw the onus of correctness onto them without ever specifying where the incorrectness ends, they will just throw more and more constraints until the output is garbage.
This is what I keep telling my friends who use them to 'write research papers/articles'. It's just a bunch of bs, that I don't trust.
Thanks, but I'm going to continue to research and lookup my own info.
I tried to use ChatGPT help speed up my writing, like I tried using "give me a brief history of Queen Dido's relationship with Caesar" when working on a character inspired by Queen Dido and then it gave me completely false information relating to some other historical figure.
Until it can get more trustworthy in that regard I'm not sure how effective it is for writing assistance let alone writing the entire paper by itself.