ChatGPT Isn't as Good at Coding as We Thought

 

ChatGPT might be great at answering quick questions or even helping you get started on a blog post, but it needs to improve its coding skills, according to researchers.


A study from Purdue University looked at how ChatGPT responded to 517 different questions from Stack Overflow (SO), and the results were pretty underwhelming. "Our examination revealed that 52% of ChatGPT’s answers contain inaccuracies and 77% are verbose," the researchers wrote in the paper, which was not peer-reviewed and published on a pre-print site.


Even more concerning, the study found that 54% of the errors made by the chatbot seemed to come from it not understanding the concept of the question it was being asked. In instances where it did understand the question, it often struggled with providing a correct answer, which highlights the importance of fact-checking ChatGPT answers. 

Comments

Popular posts from this blog

14 incredible places in the UAE you need to visit at least once

UAE, Pakistani FMs discuss cooperation, strategic partnership

Strengthening China UAE Ties through Joint Cooperation on the Belt and Road Initiative