In scientific queries. LMs return an answer from the largest data but if a system or model was recently proven wrong, they still return the wrong answer.

If you make very specific queries about DNA or protein sequence, they usually generate fabrications that are completely wrong.

They tend to return answers trained on the Internet, an uncurated pile of dogshit when it comes to science.

Google search up until about 5 years ago. Then they enshittified in favor of AI summaries that regularly get shit wrong