Is the Google Artificial Intelligence Overview Accurate for Current Procedural Terminology Coding in Hand Surgical Procedures?
Abstract
PURPOSE: As the Google Artificial Intelligence (AI) Overview function becomes engrained in the search engine, it is important to understand the accuracy of these search results as they pertain to Current Procedural Terminology (CPT) codes. We hypothesized that the identified codes will not be 100% accurate and that there will be subgroups of procedures with relatively lower accuracy than others.
METHODS: One hundred common CPT codes used in hand and upper-extremity surgery were selected and searched in Google using 150 different simplified phrases describing the procedure. The additional 50 phrases were intended to provide more detail on the importance of phrasing variation, for example, "arthrodesis" versus "fusion". The accuracy of the codes was assessed using American Academy of Orthopaedic Surgeons CodeX and the American Society for Surgery of the Hand Coding App. The accuracy was calculated as a percentage.
RESULTS: Google AI Overview's response provided an accurate CPT Code 90% of the time. Tendon procedures (78%) and nerve procedures (71%) had lower accuracy than the remainder of the groups. Bony procedures had an 88% accuracy rate, and the remainder of the categories had over 90% accuracy. Ten percent of queries resulted in multiple codes; 14 of these 15 queries contained the correct code. Fifty-nine acronyms were used, and searches with acronyms resulted in accurate codes at a similar rate to those without acronyms.
CONCLUSIONS: This study demonstrates that…
Read the paper
Related studies
- Regulation of nucleolus assembly by non-coding RNA polymerase II transcripts
- For a Healthy Histone Code, a Little SUMO in the Tail Keeps the Acetyl Away
- Discovering a binary CTCF code with a little help from BORIS
- Article Commentary: Stabilizing the Code–-Methods to Preserve RNA Prove Their Worth
- Foreword to the Special Issue for the RINTC (The Implicit Seismic Risk of Code-Conforming Structures) Project
- Commentary: Promoting Health and Well-being in Pediatric Primary Care Settings: Using Health and Behavior Codes at Routine Well-child Visits
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.