Diamond Member Pelican Press 0 Posted December 4 Diamond Member Share Posted December 4 This is the hidden content, please Sign In or Sign Up Researchers call ChatGPT Search answers ‘confidently wrong’ ChatGPT was already a threat to This is the hidden content, please Sign In or Sign Up Search, but ChatGPT Search was supposed to clench its victory, along with being an answer to Perplexity AI. This is the hidden content, please Sign In or Sign Up by This is the hidden content, please Sign In or Sign Up , ChatGPT Search struggles with providing accurate answers to its users’ queries. The researchers selected 20 publications from each of three categories: Those partnered with OpenAI to use their content in ChatGPT Search results, those involved in lawsuits against OpenAI, and unaffiliated publishers who have either allowed or blocked ChatGPT’s crawler. “From each publisher, we selected 10 articles and extracted specific quotes,” the researchers wrote. “These quotes were chosen because, when entered into search engines like This is the hidden content, please Sign In or Sign Up or This is the hidden content, please Sign In or Sign Up , they reliably returned the source article among the top three results. We then evaluated whether ChatGPT’s new search tool accurately identified the original source for each quote.” Forty of the quotes were taken from publications that are currently using OpenAI and have not allowed their content to be scraped. But that didn’t stop ChatGPT Search from confidently hallucinating an answer anyway. “In total, ChatGPT returned partially or entirely incorrect responses on a hundred and fifty-three occasions, though it only acknowledged an inability to accurately respond to a query seven times,” the study found. “Only in those seven outputs did the chatbot use qualifying words and phrases like ‘appears,’ ‘it’s possible,’ or ‘might,’ or statements like ‘I couldn’t locate the exact article.’” ChatGPT Search’s cavalier attitude toward telling the truth could harm not just its own reputation but also the reputations of the publishers it cites. In one test during the study, the AI misattributed a Time story as being written by the Orlando Sentinel. In another, the AI didn’t link directly to a New York Times piece, but rather to a third-party website that had copied the news article wholesale. OpenAI, unsurprisingly, argued that the study’s results were due to Columbia doing the tests wrong. “Misattribution is hard to address without the data and methodology that the Tow Center withheld,” OpenAI told the This is the hidden content, please Sign In or Sign Up in its defense, “and the study represents an atypical test of our product.” The company promises to “keep enhancing search results.” This is the hidden content, please Sign In or Sign Up #Researchers #call #ChatGPT #Search #answers #confidently #wrong This is the hidden content, please Sign In or Sign Up This is the hidden content, please Sign In or Sign Up Link to comment https://hopzone.eu/forums/topic/180537-researchers-call-chatgpt-search-answers-%E2%80%98confidently-wrong%E2%80%99/ Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now