← Back to Previous Page

 

P436: AUTOMATED PERFORMANCE METRICS ON THE CYRANO SIMULATOR DIFFERENTIATE EXPERTISE IN ENDOSCOPIC ENDONASAL SURGERY
Myriam Agunaoun¹; Cecile Rumeau, MD²; Romain Renkes²; Patrice Gallet²; Valentin Favier¹; Julien Boetto, MD¹; ¹CHU Montpellier; ²CHU Nancy

Background: Simulation provides a safe and standardized environment for surgical training. The Cyrano simulator has demonstrated face and construct validity. Its latest version integrates automated motion tracking and scoring, offering the potential for objective assessment of surgical skills.

Objectives: To determine whether automated performance scores on the Cyrano simulator can distinguish between intermediate and expert surgeons, as defined by video-based Objective Structured Assessment of Technical Skills (OSATS-v).

Methods: Twenty-nine residents and ENT surgeons completed four endoscopic endonasal exercises on the Cyrano simulator: Target the Target (telescope navigation), Captain Hook and Drag’n Drop (forceps/telescope precision), and Chicken Run (drilling precision). Automated global and sub-scores (amplitude, fluidity, tremor, precision, safety) were derived from motion sensors and task-specific metrics. Independent blinded experts rated anonymized videos using OSATS-v. Participants were categorized as intermediate (IP, OSATS-v ≤15) or expert (EP, OSATS-v ≥16). Group differences were tested using Mann–Whitney U (p<0.05).

Results: Mean simulator scores were higher in EPs (68.2%) than IPs (57.1%). Significant differences favored EPs in Captain Hook (global: 81.8% vs 56.1%, p=0.029; subscores: errors, handling, amplitude, optic precision), Drag’n Drop (global: 79.6% vs 57.3%; opening subscore p=0.030), and Target the Target (optic motor score, p=0.040). Chicken Run showed no group discrimination.

Conclusion: Automated performance analysis on the Cyrano simulator, combining global and skill-specific metrics, can differentiate intermediate from expert performance. It may represent a valuable adjunct for objective assessment in endoscopic endonasal surgery training.

View Poster

 

← Back to Previous Page