this post was submitted on 30 Jul 2023
162 points (94.5% liked)
Machine Learning
1765 readers
1 users here now
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I just asked it (3.5) to list counties by what side of the road they drive on and by population
It got Bangladesh, India and Indonesia wrong and put Pakistan on both lists
I do think it could be the future of search but it's obviously got a way to go with regards to error checking if it wants to be
GPT-4 is usually much, much better.
Also, you have to keep in mind that asking it this way relies on its information storage mechanism inside its neural net, which is really not optimal. For many things, it is better to try get it to generate a program that does the task rather than extract information from it.
Unfortunately they removed for now its ability to access web page, but at that moment, asking it to check on wikipedia which side of the road you drive in each country would have worked much better.
It's much more impressive as a tool when you ask it to synthesize new text rather than awnser facts. It can produce a lot of text, either prose or code, that has a useful shape to edit for a final result. It can shift tasks from a generative problem to a editorial one.