Filed under: "LLMs are designed to make convincing sentences. Language models should not be used as knowledge models."
I wish I got a dollar every time someone shared their surprise of what a LLM said that was factually Incorrect. I wouldn't need to work a day.