Endometriosis diagnosis and staging by operating surgeon and expert review using multiple diagnostic tools: an inter-rater agreement study

To determine agreement on endometriosis diagnosis between real-time laparoscopy and subsequent expert review of digital images, operative reports, magnetic resonance imaging (MRI), and histopathology, viewed sequentially.

Inter-rater agreement study.

Five urban surgical centres.

Women, aged 18-44 years, who underwent a laparoscopy regardless of clinical indication. A random sample of 105 women with and 43 women without a postoperative endometriosis diagnosis was obtained from the ENDO study.

Laparoscopies were diagnosed, digitally recorded, and reassessed.

Inter-observer agreement of endometriosis diagnosis and staging according to the revised American Society for Reproductive Medicine criteria. Prevalence and bias-adjusted kappa values (κ) were calculated for diagnosis, and weighted κ values were calculated for staging.

Surgeons and expert reviewers had substantial agreement on diagnosis and staging after viewing digital images (n = 148; mean κ = 0.67, range 0.61-0.69; mean κ = 0.64, range 0.53-0.78, respectively) and after additionally viewing operative reports (n = 148; mean κ = 0.88, range 0.85-0.89; mean κ = 0.85, range 0.84-0.86, respectively). Although additionally viewing MRI findings (n = 36) did not greatly impact agreement, agreement substantially decreased after viewing histological findings (n = 67), with expert reviewers changing their assessment from a positive to a negative diagnosis in up to 20% of cases.

Although these findings suggest that misclassification bias in the diagnosis or staging of endometriosis via visualised disease is minimal, they should alert gynaecologists who review operative images in order to make decisions on endometriosis treatment that operative reports/drawings and histopathology, but not necessarily MRI, will improve their ability to make sound judgments. Tweetable Abstract: Endometriosis diagnosis and staging agreement between expert reviewers and operating surgeons was substantial.