Skip to main content

Nomogram based on the O-RADS for predicting the malignancy risk of adnexal masses with complex ultrasound morphology

Abstract

Objective

The accurate preoperative differentiation of benign and malignant adnexal masses, especially those with complex ultrasound morphology, remains a great challenge for junior sonographers. The purpose of this study was to develop and validate a nomogram based on the Ovarian-Adnexal Reporting and Data System (O-RADS) for predicting the malignancy risk of adnexal masses with complex ultrasound morphology.

Methods

A total of 243 patients with data on adnexal masses with complex ultrasound morphology from January 2019 to December 2020 were selected to establish the training cohort, while 106 patients with data from January 2021 to December 2021 served as the validation cohort. Univariate and multivariate analyses were used to determine independent risk factors for malignant tumors in the training cohort. Subsequently, a predictive nomogram model was developed and validated in the validation cohort. The calibration, discrimination, and clinical net benefit of the nomogram model were assessed separately by calibration curves, receiver operating characteristic (ROC) curves, and decision curve analysis (DCA). Finally, we compared this model to the O-RADS.

Results

The O-RADS category, an elevated CA125 level, acoustic shadowing and a papillary projection with color Doppler flow were the independent predictors and were incorporated into the nomogram model. The area under the ROC curve (AUC) of the nomogram model was 0.958 (95% CI, 0.932–0.984) in the training cohort. The specificity and sensitivity were 0.939 and 0.893, respectively. This nomogram also showed good discrimination in the validation cohort (AUC = 0.940, 95% CI, 0.899–0.981), with a sensitivity of 0.915 and specificity of 0.797. In addition, the nomogram model showed good calibration efficiency in both the training and validation cohorts. DCA indicated that the nomogram was clinically useful. Furthermore, the nomogram model had higher AUC and net benefit than the O-RADS.

Conclusion

The nomogram based on the O-RADS showed a good predictive ability for the malignancy risk of adnexal masses with complex ultrasound morphology and could provide help for junior sonographers.

Introduction

Ovarian cancer (OC) is one of the most aggressive and lethal malignancies. According to statistics, it has the highest mortality rate among all gynecological cancers and is often discovered at an advanced stage, with a 5-year survival rate of less than 30% [1]. The most common treatment for patients with initially diagnosed with OC is maximal debulking surgery followed by platinum-based adjuvant therapy [2]. In contrast, benign tumors can be managed with fertility conservation surgery or follow-up. Thus, accurate preoperative assessment is pivotal to the treatment and prognosis of OC.

Ultrasound (US) is the preferred imaging modality [3] for the preoperative evaluation of adnexal masses. Due to the varying characteristics in ultrasound images of adnexal masses and the dependence of operator experience, the accurate preoperative diagnosis of adnexal masses remains a great challenge for most junior sonographers, especially those with complex ultrasound morphology. At present, subjective assessment by the ultrasound experts remains the best method for the preoperative identification of adnexal masses [4, 5], but these experts are not always available.

A range of ultrasound-based predictive models and classification systems have been developed to help risk stratify adnexal masses [6,7,8,9,10,11,12]. In 2008, the International Ovarian Tumor Analysis (IOTA) group proposed the Simple Rules base on ten ultrasound features [8]. Nevertheless, the Simple Rules cannot be applied in all cases, as it classifies adnexal masses as benign, malignant and inconclusive, which limits its usefulness. The Gynecologic Imaging Reporting and Data System (GI-RADS) was developed in 2009 for the assessment of adnexal masses. However, it relies heavily on the subjective assessment of the sonographers rather than objective criteria, and is not universally accepted. The IOTA Assessment of Different Neoplasias in the Adnexa (ADNEX) model is the only model that can calculate the likelihood of multiple types of adnexal masses [10], including benign tumors, borderline tumors, stage I OC, stage II–IV OC, and metastatic cancer. Although the ADNEX model has high predictive value [13], it has not been widely used in North America and China to date. Recently, the American College of Radiology (ACR) released the Ovarian-Adnexal Reporting and Data System (O-RADS) ultrasound lexicon [14] and consensus guideline of risk stratification and management [12], which provide a standardized ultrasound lexicon for adnexal lesions and associated management schemes for all risk categories. The current studies showed that the O-RADS had a high diagnostic sensitivity but relatively low specificity [15,16,17], which means that the O-RADS can misdiagnose some benign masses as malignant and lead to overtreatment. Some scholars have proposed that the acoustic shadowing should be included in O-RADS classification system to improve its performance [18]. In addition, published studies have shown that the diagnostic performance of adnexal masses can be improved by combining ultrasound with clinical indicators [19, 20].

Therefore, we aimed to develop a model based on O-RADS in conjunction with other ultrasound and clinical indicators for predicting the malignancy risk of complex ultrasound morphology adnexal mass so as to improve the accuracy of junior sonographers.

Materials and methods

Patients

Data from women who underwent preoperative ultrasound examinations and surgery for adnexal masses at the Second Affiliated Hospital of Harbin Medical University between January 2019 and December 2021 were retrospectively analyzed. Patients from January 2019 to December 2020 were selected to establish the training cohort, while patients from January 2021 to December 2021 served as the validation cohort. All patients had complete ultrasound images and postoperative histological diagnoses. Borderline tumors were classified as malignant in this study due to their potential malignant biological behavior, susceptibility to recurrence, and potential for progression toward OC. The exclusion criteria were as follows: (a) ultrasound images of adnexal masses showing a unilocular cyst without solid component; (b) treatment before ultrasound examination; (c) a history of ovarian borderline tumor or OC; (d) an interval of more than 30 days between ultrasonography and surgery; (e) pregnancy.

Data collection

Data on preoperative CA125 levels, age, menopausal status and postoperative histological diagnoses were collected for all patients. The postmenopausal state was defined as women who had been in amenorrhoea for more than 1 year and over the age of 50 years for those who had undergone hysterectomy or lacked records regarding menopause status. Elevated CA125 value was considered if > 35U/ml.

Most patients underwent transvaginal ultrasonography by experienced sonographers, and transabdominal sonography was additionally performed in patients whose adnexal masses were too large to be adequately assessed and in patiens for whom transvaginal ultrasound could not be performed for objective reasons. When multiple adnexal masses were detected in a patient, the lesion with the highest O-RADS category was included in this study. If the O-RADS categories were the same, the lesion with the largest maximum diameter was selected.

All ultrasound images were independently reviewed by two resident sonographers (with less than 3 years of gynecological ultrasound experience) who were blinded to the pathology findings. Before analyzing the images, the same two residents received theoretical training about the O-RADS lexicon [14] and risk stratification [12]. In this study, adnexal masses with complex ultrasound morphology included those lesions of multilocular cyst without solid component, unilocular cyst with solid component, multilocular cyst with solid component, and solid. According to the descriptor terms of the IOTA [21] and O-RADS strictly, the following ultrasound morphology features were recorded for each mass: maximum diameter of the lesion, maximum diameter of the largest solid component, internal margin or walls, external contour, number of locules, acoustic shadowing, number of papillary projections, papillary projection with color Doppler flow, vascularity, ascites. The degree of vascularity includes color score 1–4 according to the IOTA Group criteria [21], which represent no blood flow, minimal flow, moderate flow, and marked blood flow, respectively. The two sonographers categorized the adnexal masses separately by O-RADS risk stratification. If there was a disagreement between the two sonographers, all the details were discussed with the help of a senior sonographer until a consensus was reached.

Statistical analysis

All analyses were performed using R version 4.2.1 and SPSS version 26.0. Continuous variables were described by medians (interquartile range [IQR]), and were compared by Mann–Whitney U test. Categorical variables were presented as numbers and percentages, and were compared using the chi-square test or Mann–Whitney U test. The interreviewer agreement (IRA) of two resident sonographers when using the O-RADS was evaluated by the kappa (κ) value. In the training cohort, univariate and multivariate analyses were used to determine risk factors and further develop a nomogram model that predicted the risk of malignancy of complex ultrasound morphology adnexal masses. Then, the model was verified in the validation cohort. The receiver operating characteristic (ROC) curve and area under the curve (AUC) were used to quantify the discriminative performance of the nomogram. Calibration curves and the Hosmer–Lemeshow test were used to evaluate the consistency of the model. Decision curve analysis (DCA) was conducted to assess the clinical usefulness of the nomogram by quantifying the net benefits. Furthermore, the sensitivity and specificity were calculated. The DeLong test was used to calculate the statistical significance of differences among the AUCs. Statistical significance was assumed at p < 0.05 for all comparisons.

Results

Patient characteristics

A total of 349 patients were recruited for this study (Fig. 1). Table 1 presents the detailed clinical and ultrasound characteristics for the training and validation cohorts, and the results showed that there were no significant differences between two cohorts (all p > 0.05). The malignancy rates of the training and validation cohorts were 53.9% (131/243) and 44.3% (47/106), respectively, with no significant difference (p = 0.100). Data comparisons between the benign and malignant groups in both cohorts showed that there were no significant differences in age or menopausal status (all p > 0.05). In addition to the characteristics of  > 3 papillary projections in the validation cohort (p = 0.059), there were obvious differences in ultrasound features between the benign and malignant groups, either within the training or validation cohorts.

Fig. 1
figure 1

Flowchart of the study population

Table 1 Clinical and ultrasound characteristics of patients with adnexal masses in the training and validation cohorts

The IRA between the two sonographers when using the O-RADS was good (κ = 0.889, p < 0.001).

Univariate and multivariate analyses

In the training cohort, six parameters were included to determine the risk factors for malignancy. In the univariate analysis, a higher category of O-RADS, elevated CA125 levels, the absence of acoustic shadowing, the presence of papillary projection with color Doppler flow, and a larger maximum diameter of the largest solid component were associated with malignant tumors (all p < 0.01, Table 2).

Table 2 Univariate and multivariate analyses of factors associated with malignancy

Multivariable analysis showed that the O-RADS category, elevated CA125 levels, acoustic shadowing, and papillary projection with color Doppler flow were independent predictors for malignancy (all p < 0.05, Table 2).

Nomogram to predict the risk of malignancy

According to the multivariate analysis, a nomogram incorporating O-RADS, CA125, acoustic shadowing, and papillary projection with color Doppler flow was constructed to predict the malignancy risk of adnexal masses with complex ultrasound morphology (Table 3) (Fig. 2). The nomogram showed that the O-RADS category was the most influential predictors of malignancy. ROC analysis in the training cohort showed that the AUC of the nomogram model was 0.958 (95% CI, 0.932–0.984), with a sensitivity of 0.939 and a specificity of 0.893 (Fig. 3). The calibration curves of the nomogram showed good consistency between the predicted probability of malignancy and the actual probability in the training cohort (Fig. 4), which was further supported by a non-significant result (p = 0.441) obtained by the Hosmer–Lemeshow test.

Table 3 Predictors of the malignancy risk of adnexal masses in the model
Fig. 2
figure 2

A nomogram for predicting the malignancy risk of adnexal masses with complex ultrasound morphology

Fig. 3
figure 3

The ROC curves of the nomogram in each cohort. A The ROC curves in the training cohort. B The ROC curves in the validation cohort

Fig. 4
figure 4

The calibration curves of the nomogram in each cohort. A The calibration curves in the training cohort. B The calibration curves in the validation cohort

Validation of the nomogram

In the validation cohort, this model also exhibited a good AUC of 0.940 (95% CI, 0.899–0.981), with a sensitivity and specificity of 0.915 and 0.797 respectively (Fig. 3). Similarly, a good calibration of this model was observed in the validation cohort, and no significant difference was found by the Hosmer–Lemeshow test (p = 0.187) (Fig. 4).

Clinical utility of the nomogram

The DCA curves (Fig. 5) showed that clinical decisions based on the nomogram model had greater benefit than O-RADS in the training and validation cohorts, which suggested that the model may be used as an effective tool in clinical practice.

Fig. 5
figure 5

The DCA of the nomogram and the O-RADS in each cohort. A The DCA in the training cohort. B The DCA in the validation cohort

Comparison of the nomogram to O-RADS

ROC curve (Fig. 3) analysis of O-RADS showed that O-RADS 5 was the best threshold for predicting malignancy risk in both the training and validation cohorts, indicating that the adnexal masses of O-RADS 5 were diagnosed as malignant and O-RADS 2–4 were diagnosed as benign. In this case, the AUC, sensitivity, and specificity of O-RADS in the training cohort were 0.877 (95% CI, 0.835–0.920), 0.649 and 0.955, respectively; those in the validation cohort were 0.862 (95% CI, 0.803–0.921), 0.660 and 0.949, respectively. However, when O-RADS 4 was used as the threshold, the AUC of O-RADS in the training cohort was only 0.714 (95% CI, 0.647–0.782), with a sensitivity of 1.00 and a specificity of 0.429; whereas those in the validation cohort were 0.669 (95% CI, 0.568–0.771), 1.00 and 0.339, respectively.

In contrast to O-RADS, the nomogram model exhibited better performance for malignancy prediction, with higher AUC and net benefit.

Discussion

OC is the most fatal cancer among gynecological tumors, and seriously affects the life and health of women due to its low survival and high recurrence rates. Early detection, accurate diagnosis and referral to a gynecological oncologist are pivotal to the survival and prognosis of patients with OC, but these are still difficult for less experienced sonographers in their clinical work. In this study, we combined O-RADS with other ultrasonic indicators that included in other models or classification systems and clinical indicators to establish a model for predicting the malignancy risk of adnexal masses with complex ultrasound morphology. Finally, a nomogram consisting of O-RADS, CA125, acoustic shadowing, and papillary projection with color Doppler flow was obtained, and the results showed that the model had a favorable performance in predicting the malignancy risk of adnexal masses.

As the only standardized ultrasound lexicon for adnexal lesions and risk stratification system that includes all risk categories and related management schemes, the O-RADS has been widely studied by scholars since its release. A multicenter study [22] derived from 4905 masses for external validation of the O-RADS conducted that the O-RADS had 0.92 sensitivity and 0.80 specificity at the 10% risk threshold (O-RADS 4). A meta-analysis [15] involving 4634 adnexal masses from 11 studies showed that the sensitivity and specificity of the O-RADS were 0.97 and 0.77, respectively. Even though the overall diagnostic efficacy and sensitivity were good, relatively low specificity was still inevitable; in the study of Hiett et al., which only included 150 patients with adnexal masses and set the malignant risk threshold at 10% directly, the specificity was only 0.466 [23]. Furthermore, the specificity and sensitivity of O-RADS vary widely at different threshold risks [24, 25]. To date, there has been no consensus on the threshold of O-RADS in relation to the boundary between benign and malignant lesions or recommended surgery. Most studies have indicated that the optimal threshold for predicting malignancy was O-RADS 4 [23, 24, 26, 27], but in this study, it was O-RADS 5. Using the O-RADS 5 as a threshold for malignancy in this study, the AUC, sensitivity and specificity were 0.877, 0.649 and 0.955 respectively; whereas O-RADS 4 yielded a AUC only of 0.714, with a sensitivity of 1.00 and a specificity of 0.429. We speculated that the reason for this inconsistent optimal threshold and the poor performance at a threshold of O-RADS 4 was the different composition of study cohorts. The study cohort in our study was the adnexal masses with complex ultrasound morphology, which was different from other studies.

CA125 is the most widely used tumor biomarker for screening and monitoring epithelial ovarian cancer (EOC) [28]. However, it has always been controversial in clinical practice due to the high false-positive and false-negative rates. The United States Preventive Services Task Force also noted that isolated CA125 results were not recommended as an indicator for the diagnosis of OC [29]. In present study, the CA125 level in malignant tumors was significantly higher than that in benign tumors. As an independent risk factor for malignant tumors, CA125 had a high OR value (16.26) in the nomogram model, which indicated that CA125 had a high diagnostic value in adnexal masses with complex ultrasound morphology. Part of the reasons may be that most of the ovarian endometriosis cysts were excluded as unilocular cyst with solid component, thus the number was small in this study, which reduced the false-positive rate of CA125 to some extent. Acoustic shadowing often appears in benign adnexal masses, such as teratoma, cystadenofibroma, and fibroma [30, 31]. Acoustic shadowing was included in IOTA SR and ADNEX model as one of the key benign features [8, 10], but it has not been included in the O-RADS classification system. Studies have shown that adding acoustic shadowing to the O-RADS system can improve the diagnostic efficiency [22], and similar conclusion have been obtained in this study. The members of O-RADS US working group claimed that acoustic shadowing may appear in future iterations of the O-RADS [18]. As one of the malignant features in the LR model [6], in this study, the papillary projection with color Doppler flow mostly appeared in malignant tumors. Moreover, ultivariable analysis showed that the papillary projection with color Doppler flow was independent predictor for malignancy, which was consistent with previous studies [32, 33].

Previously, some scholars have also proposed to combine O-RADS with other ultrasound or serological indicators to improve diagnostic performance. Wang et al. [34] proposed a simple combination of O-RADS, HE4 and CA125, in which an adnexl mass was diagnosed as benign if all three results were negative; otherwise, it is diagnosed as malignant. However, endometriosis cysts with elevated CA125 were misdiagnosed as malignant using this method. A recent study [35] indicated that a combination of O-RADS, SR and CA125 had a significantly higher AUC in discriminating ovarian tumors than individual approaches, but it did not provide the specific method. Wu et al. [36] developed a model of combining O-RADS and CA125, and the results suggested that the model significantly increased the diagnostic performance of malignancy risk estimation in adnexal masses. In addition, the model also showed good results in distinguishing certain subtypes of ovarian tumors. However, they only provided the mathematical formula of the model, and did not conduct a comprehensive evaluation and verification of the model.

In clinical practice, sonographers are usually able to correctly diagnose the adnexal masses with simple morphology, such as unilocular cysts without solid component. As previously reported, the risk of malignancy of the unilocular cysts is less than 1% [37, 38]. However, it is more difficult to distinguish the adnexal masses with complex ultrasound morphology, especially for junior sonographers. Therefore, this study excluded the adnexal masses of unilocular cysts without solid component and attempted to develop a nomogram for predicting the malignancy risk of adnexal masses with complex ultrasound morphology. The results showed that the model presented in this study had high predictive efficiency in the training cohort (AUC = 0.958) and validation cohort (AUC = 0.940), and had a superior performance than the O-RADS. These findings indicated that this model can help junior sonographers to identify adnexal masses and improve their confidence.

One of limitations of the present study was its retrospective nature that all ultrasound images were static and stored with varied quality, which may have influenced the assessments of the sonographers. Additionally, only patients who had undergone gynecological surgery were included in this study, which may cause selection bias. Finally, the model was based on data from a single tertiary center and the small sample may not be representative, and the applicability of this model still requires external validation by additional databases from other regions and countries.

Conclusion

In summary, the results suggested the nomogram based on the O-RADS showed a better predictive ability than O-RADS for the malignancy risk of adnexal masses with complex ultrasound morphology. This nomogram may hold potential values in helping junior sonographers identify adnexal masses.

Availability of data and materials

All data generated or analyzed during this study are included in this published article.

References

  1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2019. CA Cancer J Clin. 2019;69(1):7–34.

    Article  PubMed  Google Scholar 

  2. Lheureux S, Gourley C, Vergote I, Oza AM. Epithelial ovarian cancer. Lancet. 2019;393(10177):1240–53.

    Article  PubMed  Google Scholar 

  3. Lowry KP, Lee SI. Imaging and screening of ovarian cancer. Radiol Clin North Am. 2017;55(6):1251–9.

    Article  PubMed  Google Scholar 

  4. Koneczny J, Czekierdowski A, Florczak M, Poziemski P, Stachowicz N, Borowski D. The use of sonographic subjective tumor assessment, IOTA logistic regression model 1, IOTA Simple Rules and GI-RADS system in the preoperative prediction of malignancy in women with adnexal masses. Ginekol Pol. 2017;88(12):647–53.

    Article  PubMed  Google Scholar 

  5. Chen H, Yang BW, Qian L, Meng YS, Bai XH, Hong XW, He X, Jiang MJ, Yuan F, Du QW, et al. Deep Learning Prediction of Ovarian Malignancy at US Compared with O-RADS and Expert Assessment. Radiology. 2022;304(1):106–13.

    Article  PubMed  Google Scholar 

  6. Timmerman D, Testa AC, Bourne T, Ferrazzi E, Ameye L, Konstantinovic ML, Van Calster B, Collins WP, Vergote I, Van Huffel S, et al. Logistic regression model to distinguish between the benign and malignant adnexal mass before surgery: a multicenter study by the International Ovarian Tumor Analysis Group. J Clin Oncol. 2005;23(34):8794–801.

    Article  PubMed  Google Scholar 

  7. Timmerman D, Van Calster B, Jurkovic D, Valentin L, Testa AC, Bernard JP, Van Holsbeke C, Van Huffel S, Vergote I, Bourne T. Inclusion of CA-125 does not improve mathematical models developed to distinguish between benign and malignant adnexal tumors. J Clin Oncol. 2007;25(27):4194–200.

    Article  PubMed  Google Scholar 

  8. Timmerman D, Testa AC, Bourne T, Ameye L, Jurkovic D, Van Holsbeke C, Paladini D, Van Calster B, Vergote I, Van Huffel S, et al. Simple ultrasound-based rules for the diagnosis of ovarian cancer. Ultrasound Obstet Gynecol. 2008;31(6):681–90.

    Article  CAS  PubMed  Google Scholar 

  9. Amor F, Vaccaro H, Alcázar JL, León M, Craig JM, Martinez J. Gynecologic imaging reporting and data system: a new proposal for classifying adnexal masses on the basis of sonographic findings. J Ultrasound Med. 2009;28(3):285–91.

    Article  PubMed  Google Scholar 

  10. Van Calster B, Van Hoorde K, Valentin L, Testa AC, Fischerova D, Van Holsbeke C, Savelli L, Franchi D, Epstein E, Kaijser J, et al. Evaluating the risk of ovarian cancer before surgery using the ADNEX model to differentiate between benign, borderline, early and advanced stage invasive, and secondary metastatic tumours: prospective multicentre diagnostic study. BMJ. 2014;349:g5920.

    Google Scholar 

  11. Timmerman D, Van Calster B, Testa A, Savelli L, Fischerova D, Froyman W, Wynants L, Van Holsbeke C, Epstein E, Franchi D, et al. Predicting the risk of malignancy in adnexal masses based on the Simple Rules from the International Ovarian Tumor Analysis group. Am J Obstet Gynecol. 2016;214(4):424–37.

    Article  PubMed  Google Scholar 

  12. Andreotti RF, Timmerman D, Strachowski LM, Froyman W, Benacerraf BR, Bennett GL, Bourne T, Brown DL, Coleman BG, Frates MC, et al. O-RADS US Risk Stratification and Management System: A Consensus Guideline from the ACR Ovarian-Adnexal Reporting and Data System Committee. Radiology. 2020;294(1):168–85.

    Article  PubMed  Google Scholar 

  13. Van Calster B, Valentin L, Froyman W, Landolfo C, Ceusters J, Testa AC, Wynants L, Sladkevicius P, Van Holsbeke C, Domali E, et al. Validation of models to diagnose ovarian cancer in patients managed surgically or conservatively: multicentre cohort study. BMJ. 2020;370:m2614.

    Google Scholar 

  14. Andreotti RF, Timmerman D, Benacerraf BR, Bennett GL, Bourne T, Brown DL, Coleman BG, Frates MC, Froyman W, Goldstein SR, et al. Ovarian-Adnexal Reporting Lexicon for Ultrasound: A White Paper of the ACR Ovarian-Adnexal Reporting and Data System Committee. J Am Coll Radiol. 2018;15(10):1415–29.

    Article  PubMed  Google Scholar 

  15. Vara J, Manzour N, Chacón E, López-Picazo A, Linares M, Pascual M, Guerriero S, Alcázar JL. Ovarian Adnexal Reporting Data System (O-RADS) for Classifying Adnexal Masses: A Systematic Review and Meta-Analysis. Cancers. 2022;14(13):3151.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Jha P, Gupta A, Baran TM, Maturen KE, Patel-Lippmann K, Zafar HM, Kamaya A, Antil N, Barroilhet L, Sadowski EA. Diagnostic Performance of the Ovarian-Adnexal Reporting and Data System (O-RADS) Ultrasound Risk Score in Women in the United States. JAMA Netw Open. 2022;5(6):e2216370.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Guo Y, Zhao B, Zhou S, Wen L, Liu J, Fu Y, Xu F, Liu M. A comparison of the diagnostic performance of the O-RADS, RMI4, IOTA LR2, and IOTA SR systems by senior and junior doctors. Ultrasonography. 2022;41(3):511–8.

    PubMed  Google Scholar 

  18. Wilson MP, Katlariwala P, Low G. Solid Hypoechoic Adnexal Lesions with Acoustic Shadowing Warrant an MRI Recommendation in the O-RADS Risk Stratification and Management System. Radiology. 2020;296(1):E11-e13.

    Article  PubMed  Google Scholar 

  19. Chen YN, Ma F, Zhang YD, Chen L, Li CY, Gong SP. Ultrasound Features Improve Diagnostic Performance of Ovarian Cancer Predictors in Distinguishing Benign and Malignant Ovarian Tumors. Current medical science. 2020;40(1):184–91.

    Article  CAS  PubMed  Google Scholar 

  20. Cui Y, Shi S, Zhang S, Huang C, Li P, Han C. Application value of Doppler ultrasound combined with CA125 and CA19.9 in the early diagnosis of epithelial ovarian cancer. J BUON. 2021;26(5):1802–8.

    PubMed  Google Scholar 

  21. Timmerman D, Valentin L, Bourne TH, Collins WP, Verrelst H, Vergote I. Terms, definitions and measurements to describe the sonographic features of adnexal tumors: a consensus opinion from the International Ovarian Tumor Analysis (IOTA) Group. Ultrasound Obstet Gynecol. 2000;16(5):500–5.

    Article  CAS  PubMed  Google Scholar 

  22. Timmerman S, Valentin L, Ceusters J, Testa AC, Landolfo C, Sladkevicius P, Van Holsbeke C, Domali E, Fruscio R, Epstein E, et al. External Validation of the Ovarian-Adnexal Reporting and Data System (O-RADS) Lexicon and the International Ovarian Tumor Analysis 2-Step Strategy to Stratify Ovarian Tumors Into O-RADS Risk Groups. JAMA Oncol. 2022;9(2):225-233.

  23. Hiett AK, Sonek JD, Guy M, Reid TJ. Performance of IOTA Simple Rules, Simple Rules risk assessment, ADNEX model and O-RADS in differentiating between benign and malignant adnexal lesions in North American women. Ultrasound Obstet Gynecol. 2022;59(5):668–76.

    Article  CAS  PubMed  Google Scholar 

  24. Chen GY, Hsu TF, Chan IS, Liu CH, Chao WT, Shih YC, Jiang LY, Chang YH, Wang PH, Chen YJ. Comparison of the O-RADS and ADNEX models regarding malignancy rate and validity in evaluating adnexal lesions. Eur Radiol. 2022;32(11):7854-7864.

  25. Hack K, Gandhi N, Bouchard-Fortier G, Chawla TP, Ferguson SE, Li S, Kahn D, Tyrrell PN, Glanc P. External Validation of O-RADS US Risk Stratification and Management System. Radiology. 2022;304(1):114–20.

    Article  PubMed  Google Scholar 

  26. Cao L, Wei M, Liu Y, Fu J, Zhang H, Huang J, Pei X, Zhou J. Validation of American College of Radiology Ovarian-Adnexal Reporting and Data System Ultrasound (O-RADS US): Analysis on 1054 adnexal masses. Gynecol Oncol. 2021;162(1):107–12.

    Article  PubMed  Google Scholar 

  27. Basha MAA, Metwally MI, Gamil SA, Khater HM, Aly SA, El Sammak AA, Zaitoun MMA, Khattab EM, Azmy TM, Alayouty NA, et al. Comparison of O-RADS, GI-RADS, and IOTA simple rules regarding malignancy rate, validity, and reliability for diagnosis of adnexal masses. Eur Radiol. 2021;31(2):674–84.

    Article  PubMed  Google Scholar 

  28. Wiseman L, Cinti N, Guinn BA. Identification and prioritization of tumor associated antigens for immunotherapeutic and diagnostic capacity in epithelial ovarian cancer: a systematic literature review. Carcinogenesis. 2022;43(11):1015-1029.

  29. Henderson JT, Webber EM, Sawaya GF. Screening for Ovarian Cancer: Updated Evidence Report and Systematic Review for the US Preventive Services Task Force. JAMA. 2018;319(6):595–606.

    Article  PubMed  Google Scholar 

  30. Yoeli-Bik R, Lengyel E, Mills KA, Abramowicz JS. Ovarian masses: the value of acoustic shadowing on ultrasound examination. J Ultrasound Med. 2022;42(4):935-945.

  31. Zheng X, Lyu G, Gan Y, Hu M, Liu X, Chen S, Wu X, Yang W, Ye F, Yan X, et al. Microcystic pattern and shadowing are independent predictors of ovarian borderline tumors and cystadenofibromas in ultrasound. Eur Radiol. 2021;31(1):45–54.

    Article  PubMed  Google Scholar 

  32. Landolfo C, Valentin L, Franchi D, Van Holsbeke C, Fruscio R, Froyman W, Sladkevicius P, Kaijser J, Ameye L, Bourne T, et al. Differences in ultrasound features of papillations in unilocular-solid adnexal cysts: a retrospective international multicenter study. Ultrasound Obstet Gynecol. 2018;52(2):269–78.

    Article  CAS  PubMed  Google Scholar 

  33. Hassen K, Ghossain MA, Rousset P, Sciot C, Hugol D, Baddoura R, Vadrot D, Buy JN. Characterization of papillary projections in benign versus borderline and malignant ovarian masses on conventional and color Doppler ultrasound. AJR Am J Roentgenol. 2011;196(6):1444–9.

    Article  PubMed  Google Scholar 

  34. Wang R, Li X, Li S, Fang S, Zhao C, Yang H, Yang Z. Clinical value of O-RADS combined with serum CA125 and HE4 for the diagnosis of ovarian tumours. Acta Radiol. 2023;64(2):821-828.

  35. Xie WT, Wang YQ, Xiang ZS, Du ZS, Huang SX, Chen YJ, Tang LN. Efficacy of IOTA simple rules, O-RADS, and CA125 to distinguish benign and malignant adnexal masses. J Ovarian Res. 2022;15(1):15.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Wu M, Wang Q, Zhang M, Cao J, Chen Y, Zheng J, Luo L, Su M, Lin X, Kuang X et al: Does Combing O-RADS US and CA-125 Improve Diagnostic Accuracy in Assessing Adnexal Malignancy Risk in Women with Different Menopausal Status? J Ultrasound Med. 2023;42(3):675-685.

  37. Parazzini F, Frattaruolo MP, Chiaffarino F, Dridi D, Roncella E, Vercellini P. The limited oncogenic potential of unilocular adnexal cysts: a systematic review and meta-analysis. Eur J Obstet Gynecol Reprod Biol. 2018;225:101–9.

    Article  PubMed  Google Scholar 

  38. Valentin L, Ameye L, Franchi D, Guerriero S, Jurkovic D, Savelli L, Fischerova D, Lissoni A, Van Holsbeke C, Fruscio R, et al. Risk of malignancy in unilocular cysts: a study of 1148 adnexal masses classified as unilocular cysts at transvaginal ultrasound and review of the literature. Ultrasound Obstet Gynecol. 2013;41(1):80–9.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

LPG was major contributors in writing the manuscript. SZ and XSD collected the patient data. LPG, DS and XYL analyzed the images. YNF, XJG, YQP, YEL, YNW, JWT, LTS and CXS conceptualized the study and provided supervision, writing review, and editing. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Cong-Xin Sun or Li-Tao Sun.

Ethics declarations

Ethics approval and consent to participate

The study which included human approval was acquired from the Ethics Committee of The Second Affiliated Hospital of Harbin Medical University. The consent we obtained from study participants was verbal and it was approved by the ethics committee.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gong, LP., Li, XY., Wu, YN. et al. Nomogram based on the O-RADS for predicting the malignancy risk of adnexal masses with complex ultrasound morphology. J Ovarian Res 16, 57 (2023). https://doi.org/10.1186/s13048-023-01133-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13048-023-01133-1

Keywords