its average score was 85.1.
by rick richardson
technology this week
an improved and better-trained version of chatgpt took a simulated cpa test after an earlier failure and passed, similar to the roughly half of human applicants who fail on their first attempt. but does this trial suggest that chatgpt will soon compete for accounting positions?
more: smartwatch saves two lives | first e-road charges electric vehicles as they drive | stanford scientists 3d-print heart tissue | chatgpt unlikely to replace accountants | cancer vaccine available by 2030? | four of today’s new technologies that will be tomorrow’s ‘norm’ | chatgpt spurs competition in different ways | chatgpt: what it is. why you need to know.
exclusively for pro members. log in here or 2022世界杯足球排名 today.
“this calls into question the ‘competitive advantage’ of the human accountant relative to the machine. to our knowledge, for the first time, ai has performed as well as most human accountants on a real-world accounting task. this raises important questions of how machines and accountants will work together in the future,” the study’s authors said.
the worry around artificial intelligence (ai) is that it will eventually replace human labor. there are some tasks that a machine simply cannot perform, but there are others that will adapt to take advantage of ai’s efficiency. the question is, do accounting jobs fall into that category? that may be the case, according to the most recent test, but only after certain ai system adjustments.
here’s how chatgpt did it …
although chatgpt has shown its abilities in a variety of applications, the researchers aimed to improve its effectiveness in student examinations like the cpa exam.
the researchers changed the chatbot using “chain of thought” prompting and a “10-shot” scenario, where it was taught with 10 examples. these techniques helped the ai become more knowledgeable about the topic and keep important concepts.
the upgrade from the initial version, chatgpt 4.0, was the one that passed the cpa exam. newer chatgpt models, which have stronger training and reasoning capabilities, outscored older models on average by 16.5 percent, according to the study.
the most recent version 4.0 averaged 85.1 out of 100 and successfully completed all four sections of the exam, in contrast to the prior version 3.5’s average score of 53.1. the chatbot received an 87.5 in the part that rated highest, auditing and attestation (aud).
version 3.5 of chatgpt took the cpa exam in early may under the direction of the trade publication accounting today. the chatbot got a pitiful 35 percent in financial accounting and reporting (far), its weakest category, and just 48 percent in business environment and concepts (bec), its strongest category.
the researchers’ test results show that chatgpt’s most recent iterations, which have the most sophisticated reasoning capabilities yet, can handle virtually every evaluation. this finding could have significant ramifications for important areas like accounting and auditing.
chatgpt has demonstrated its talents in several well-known exams, such as the wharton mba, bar and many ap exams.