A Pilot Study by Ayesha Almemari & Rasha Buhmaid
Background and Objective: Point-of-care ultrasound (POCUS) has become an integral part of the curricula of various specialty residency programs. POCUS education requires learners to be proficient in image acquisition, image interpretation, and integration into clinical practice. The assessment of POCUS skills and competency is variable. This study aimed to assess the validity and reliability of using still ultrasound images as examination test items without providing clinical vignettes or anatomical locations.
Methods: This is a proof-of-concept survey pilot study, residents from the Middle East who had completed their training in emergency medicine were surveyed during their competency assessment examination. They were provided with a single ultrasound image of an abdominal aortic aneurysm in both print and PowerPoint slide format. The task was to identify the diagnosis based on this image, which was taken from a reference emergency medicine textbook.
Results: The study showed that only 50% of the residents correctly identified the diagnoses based on the still images. Many of the incorrect answers included diagnoses that were not related to the anatomical structure that was scanned, indicating that the residents were not able to identify the anatomical locations, which high- lighted the challenges of interpreting a single still image without clinical context and emphasized the need for valid and reliable test items in POCUS education and assessment.
Conclusion: National and international emergency medicine societies should establish standards for writing POCUS examination test items to ensure their validity and reliability.
