Reliability of preoperative evaluation of postmenopausal ovarian tumors
© The Author(s). 2017
Received: 22 December 2016
Accepted: 2 March 2017
Published: 14 March 2017
Preoperative evaluation of ovarian tumors is challenging. This study was undertaken to evaluate the performance of conventional two-dimensional (2D) ultrasound and CA125 in predicting malignant or benign nature of pelvic masses, and to investigate if three-dimensional power Doppler (3DPD) ultrasound provides any added value. Ninety-six postmenopausal and four perimenopausal women with supposed ovarian tumors were examined by standardized 2D and 3DPD ultrasounds preoperatively. The tumors were evaluated using the risk of malignancy index (RMI), International Ovarian Tumors Analysis (IOTA) group simple rules, expert opinion, IOTA logistic regression model 2 (LR2) and 3D vascular indices, and were postoperatively compared to histopathological results.
Ninety-eight tumors turned out to be ovarian in origin. Of these, 66 were benign and 32 malignant. RMI (cut-off value 200), simple rules, expert opinion and LR2 (cut-off value 25) were used to predict malignant nature of the tumors and had sensitivities of 71.9, 90.6, 87.5 and 90.6%, and specificities of 80.3, 84.6, 92.4 and 77.3%, respectively. When the 3D vascularization flow index (VFI) was added to RMI and LR2, the accuracy of the test improved from 77.6 to 81.4% and from 81.6 to 86.5%, respectively, at the expense of sensitivity, while VFI gave no added benefit for simple rules and expert opinion. Agreement between two examiners using expert opinion was good (Cohen’s kappa = 0.89).
The subjective opinion of an expert seems to be the most reliable method in assessing ovarian tumors, and the 3DPD indices seem to provide no significant added value.
KeywordsExpert opinion IOTA LR2 IOTA simple rules Ovarian cancer Ovarian tumor Power doppler Three-dimensional ultrasound
Ovarian cancer has the leading mortality rate of all gynecological cancers, and the incidence of ovarian cancer is at its peak among postmenopausal women. The optimal treatment of ovarian neoplasms requires correct preoperative characterization of tumors. The surgical treatment of ovarian cancer should be reserved for gynecological oncologists, while benign tumors can be operated on less radically by general gynecologists, or even managed conservatively.
Preoperatively ultrasound features combined with the measurements of CA125 has been used to predict the malignancy of a pelvis mass (Risk of Malignancy Index, RMI) since early 1990’s . However, subjective assessment by an experienced ultrasound examiner has been considered to be the best diagnostic method for ovarian tumors [2, 3]. While not all gynecologists are so well accustomed to ultrasound examinations, in 2008 the International Ovarian Tumors Analysis (IOTA) group presented simple ultrasound-based rules that include five rules for predicting malignant tumors (M-rules) and five for predicting benign tumors (B-rules). If one or more M-rules with absence of B-rules or B-rules with absence of M-rules are present, the tumor is supposed to be malignant or benign, respectively. In a multicenter study, these rules were applicable for 76% of all tumors and showed a sensitivity of 95% and specificity of 91% . If none of the rules is valid or if both M- and B-rules are present, a tumor is considered to be inconclusive [4, 5]. In that case the opinion of an expert ultrasound examiner is needed, which is called a two-step strategy . In addition, the IOTA group developed two logistic regression models (LR1 and LR2) . LR1 is based on 12 different variables, and LR2 is based on 6, including patient history, clinical signs and ultrasound features. These models have shown sensitivities of 92–95% and 89–95% with specificities of 74–87% and 73–86% in detecting ovarian malignancies, respectively . Nevertheless, in several studies, the impression of an expert ultrasound examiner has still been considered to be the best method, or at least equivalent to LR1 and LR2, for diagnosing ovarian pathology [8, 9].
An increased density of microvessels and abnormal vascular tree of the tumor are characteristic of malignant ovarian processes [10, 11]. These phenomena have given new insight for the use of three-dimensional (3D) ultrasound and 3D power Doppler (3DPD) in evaluating the vascularization of ovarian tumors to discriminate between benign and malignant tumors. Unfortunately, there are no clear cut-off rules for 3D ultrasound features, limiting their clinical utility .
The purpose of this study was to examine if 3DPD ultrasound can offer additional benefits over conventional two-dimensional ultrasound and other diagnostic methods as a useful tool for predicting malignancy of an adnexal mass. The aim was to find the most applicable and reliable preoperative diagnostic approach for postmenopausal women.
Between February 2011 and November 2014, one hundred women over 50 years of age presenting with an abnormal adnexal mass(es) at the Department of Obstetrics and Gynecology of Tampere University Hospital, were recruited to the study. All patients were destined for surgery. Overtly benign or malignant looking tumors like unilocular simple ovarian cysts and tumors associated with marked ascites (depth of the greatest pool over 10 cm) were excluded. In principle, the maximum allowed diameter of the tumors was 10 cm, allowing the entire tumor to be assessible transvaginally. However, there were five tumors, the maximum diameter of which exceeded 10 cm at the final examination, but it never exceeded 12 cm.
According to preoperative findings, the patients were operated on by either a gynecological oncologist or a general gynecologist, using either laparoscopic or open technique.
The patients were assessed within 2 weeks prior to surgery by vaginal two-dimensional (2D) and 3D ultrasound examination with power Doppler. In the case of bilateral ovarian tumors, both masses were examined, and the more complex tumor was assessed for the study. All ultrasound examinations were performed by an experienced gynecologist or the author R.J.N., using a Voluson 730 Expert unit (GE Medical Systems, Zipf, Austria) with a multifrequency transvaginal transducer (5–9 MHz). A normal B-mode ultrasound assessment included the calculation of the size of the adnexal mass. The power Doppler settings were standardized: frequency, 6 MHz; power Doppler gain, -0.6; wall motion filter (WMF), low 1; pulse repetition filter (PRF), 0.6 kHz. The extent of vascularization of the tumor was described by a score from 1 to 4 (1 = no blood flow detected, 4 = high blood flow detected) . 3DPD was used to examine the ovarian tumor after the 2D evaluation. The acquisition sweep angle was set to 85°.
A serum sample was obtained preoperatively, and RMI was calculated by using the original formula of Jacobs et al. in which the serum CA125 level, ultrasound scan result and patient’s menopausal status are taken into account . The ultrasound data were stored on a hard disk for later evaluation. Based on the ultrasound examination, the examiner classified the adnexal tumor as benign or malignant (expert opinion), immediately following the actual examination. From the 2D data, the tumors were classified by using the IOTA simple rules. If none of these rules applied or if both M- and B-rules were applicable, the tumor could not be classified. In such case, the tumor was evaluated subjectively by the examiner as benign or malignant.
The IOTA LR2 was implemented by using the Predictive IOTA models for ovarian cancer application software, version 2013 (App for IOS operating systems). In the LR2 model, the six variables used are age of the patient, presence/absence of ascites, presence/absence of papillations/papillary projections with blood flow, maximum diameter of the largest solid component, irregular cyst walls and presence/absence of acoustic shadows. This calculated model yields the probability of malignancy of an ovarian tumor.
The analyses of the stored 3D volumes were performed by the same investigator (R.J.N.) using a virtual organ computer-aided analysis (VOCAL™) imaging program and 4D-View software (GE Healthcare, v 9.1). The volume of each adnexal tumor was measured by manual delineation of the contour of the mass with a 15°-rotation step. Using the VOCAL software’s histogram feature, three vascular indices were calculated from the adnexal tumors: vascularization index (VI), flow index (FI) and vascularization flow index (VFI). VI represents the number of vessels in the studied volume and is expressed as a percentage. FI reflects the intensity of blood flow at the time of the 3D sweep. VFI is interpreted to be a combination of VI and FI representing both vascularization and blood flow. FI and VFI are expressed as values ranging from 0 to 100 [12, 14, 15].
To estimate the interobserver agreement, another experienced ultrasound examiner (S.K.S.) re-evaluated the stored ultrasound data and classified the malignancy of tumors (expert opinion), and analysed 3D volumes.
The ultrasound examinations and off-line assessments were performed blinded for each other’s results and the histopathological diagnoses while analyzing the tumors. The preoperative findings were finally compared to postoperative histopathological diagnoses. For the purpose of this analysis, the borderline and low grade ovarian tumors were classified as malignant because normally also they are staged surgically. All participants gave their informed consent to the study, which was approved by the Ethics Committee of Tampere University Hospital (ETL R10080, 6 August 2010).
No sample size calculation was performed due to the preliminary descriptive nature of this study. All data were analyzed using IBM SPSS Statistics for Windows, version 22 (Armonk, NY, IBM Corp.). The normality of the distributions of continuous variables was evaluated by Kolmogorov-Smirnov tests. Due to the skewness of the distributions, the comparisons of groups were performed using Mann-Whitney U-tests, and correlations were evaluated using Spearman’s correlation tests. Receiver operating characteristics curves (ROC) were used for evaluating the performance of serum CA125, RMI, LR2 and 3D vascular indices as predictive tests for malignancy. The best cut-off values of the models were calculated in consideration of sensitivity, specificity, positive predictive value and negative predictive value. Binomial variables were evaluated by Fischer’s exact tests or Pearson Chi-Square tests when appropriate.
The agreement of ultrasound features by both ultrasound examiners (R.J.N. and S.K.S.) was estimated by calculating the Cohen’s kappa index. A kappa value of less than 0.20 indicates poor agreement, 0.21–0.40 moderate agreement, 0.61–0.80 good agreement and 0.81–1.00 very good agreement . Interobserver agreement of 3DPD indices were analyzed by related-samples Wilcoxon signed rank test.
Histology of the tumors
Clear cell carcinoma
Granulosa cell tumor
Sertoli-Leydig cell tumor
The median age of the patients was 61 (range, 50–84) years. Tumor pathology did not depend on the age of the women or the bilaterality of the tumors. Three of the women in the benign ovarian tumor group and one in the malignant group were in fact perimenopausal, because they had experienced menstrual bleeding during the previous 6 months. Systemic hormone replacement therapy was used before surgery by 17 women with benign tumors and by five with malignant tumors. The median body mass index was 26 (range, 20–44) for women with benign tumors and respectively 27 (range, 19–39) for women with malignant tumors. The median diameters of the tumors in the groups were 6 (range, 3–11) and 7 (range, 3–12) cm, respectively. The median serum CA125 levels were 15 (range, 6–127) and 50 (range, 9–3195) kU/L, respectively, and the difference between the groups was significant (p < 0.001). The calculated median values of RMI for benign and malignant cases were 99 (range, 10–1143) and 360 (range, 27–7488), respectively (p < 0.001). The age of the patients, body mass indexes and CA125 levels did not correlate with each other.
Diagnostic performances of different methods at various cut-off values in detecting ovarian malignancy
Serum CA125 (kU/L) → Area under the ROC curve = 0.80
RMI → Area under the ROC curve = 0.81
Simple rules with expert opiniona
LR2 (%) → Area under the ROC curve = 0.93
The opinions of the experts (R.J.N. and S.K.S.) differed in five cases, including two serous and one mucinous cystadenoma, one teratoma, and one benign Brenner tumor. In addition, both experts failed in the case of two malignant tumors: one endometrioid adenocarcinoma FIGO Stage IA and one granulosa cell tumor. Two serous borderline cystadenomas were erroneously classified as benign. The interobserver agreement of the malignancy of tumors between both examiners was very good (Cohen’s kappa = 0.89, 95% CI 0.79–0.98; percentage of agreement of correct classification = 87.8%).
Diagnostic performances of three-dimensional power Doppler indices at different cut-off values in detecting ovarian malignancy
VI (%) → Area under the ROC curve = 0.86
FI → Area under the ROC curve = 0.72
VFI → Area under the ROC curve = 0.87
Interobserver agreement between two experts using three-dimensional power Doppler (3DPD) indices
Expert opinion 1
Expert opinion 2
Diagnostic performances of combined methods to detect malignancy at specific cut-off values
RMI > 200 and VFI > 0.31
Simple rules with expert opiniona and VFI > 0.31
LR2 > 25 and VFI > 0.31
To the best of our knowledge, this is the first study to compare such a large spectrum of various preoperative methods (serum CA125, RMI, simple ultrasound rules, expert opinion, 2DPD and IOTA LR2) along with 3DPD indices for discrimination between benign and malignant ovarian tumors. The results of the present study imply that clinical expert opinion still provides the best method for diagnosing malignant ovarian tumors, with no additional benefit provided by use of 3DPD indices. Regarding the specificity of 3DPD indices, VI and VFI are only as specific as the traditional methods CA125 and RMI, but the combination of them with LR2 and RMI provides a clear improvement of specificity, but unfortunately at the expense of sensitivity.
The present results regarding the superiority of expert opinion are in accordance with previous studies. Timmerman et al.  found in their prospective study comparing IOTA-based simple rules, LR1 and LR2, and subjective assessment of the sonologist that expert’s opinion is either better or equivalent to the scoring systems.
A weakness of this study is the rather small number of patients, but on the other hand, all the patients were examined by the same investigator, which in turn can be considered to be an advantage. Moreover, the data was assessed by another examiner yielding a very good agreement between both examiners. Another advantage is a quite homogenous patient population, with only four perimenopausal women among 96 postmenopausal patients. A potential bias of the study is that although RMI was originally developed as a triage test for use by a less experienced ultrasound examiner to predict the malignancy of a tumor, in this study it was rather used by an ultrasound expert in parallel with simple rules and LR2 designed to triage patients who should be operated on by a gynecologic oncologist [5, 8]. The main rationale for including also RMI was to provide a reader less experienced in ultrasound, with a familiar comparator for the more specific triage methods.
CA125 is widely used as a tumor marker for epithelial ovarian cancer. It is quite accurate among postmenopausal women, while the relatively great number of false-positive results limits its utility in premenopausal setting. Our cut-off value was 35 kU/L, whereas some reports have used lower cut-offs, which might explain the lower sensitivity of CA125 (59.4%) in our study. In a review article on seven studies, the pooled sensitivity and specificity of CA125 in postmenopausal women were 85.9 and 85.2%, respectively . We also tested a lower cut-off value of 24 kU/L, which clearly improved sensitivity, while somewhat weakening specificity.
In their original study, Jacobs et al. described a sensitivity of 85% and a specificity of 97% for a RMI cut-off level of 200 . A review of RMI on 13 studies showed that for a cut-off level of 200, the pooled estimate for sensitivity was 78% (95% CI 71–85%) and for specificity was 87% (95% CI 83–91%), which is still better than in our study . The reason for this may be our rather limited sample size, or the fact that the majority of the malignant tumors were of low malignant potential i.e. borderline epithelial, granulosa and Sertoli-Leydig cell tumors, which may have contributed to the less-than-optimal performance of RMI.
An IOTA-based protocol classified a woman as being at high risk for ovarian malignancy if the estimated LR2 risk was at least 25%, at intermediate risk if LR2 was between 5 and 25% and at low risk if LR2 was below 5% . It has been presumed that the LR2-based protocol is more accurate than the RMI-based protocol, and is recommended to be used instead of RMI in discriminating ovarian tumors and concluding treatment protocols . In the multicenter study of Testa et al., LR2 and RMI achieved AUC values of 0.90 and 0.85, respectively in 1,049 postmenopausal patients . The corresponding AUC values in the present study were quite similar, 0.93 and 0.81. We argue that LR2 ≥ 25% risk is the most practical value in clinical work because in our study it achieved a negative predictive value of 94.4%.
Different preoperative scoring systems of ovarian tumors were evaluated in the meta-analysis of Kaijser et al. The pooled sensitivity and specificity of simple rules in five validated studies were found to be 93 and 81%, respectively . However, the inconclusive cases were assessed to be malignant, which differs from our study where in the inconclusive results obtained by the simple rules protocol, the tumors were subjectively classified as being either benign or malignant by the same examiner. This is described as a two-step strategy . In our data 85/98 of tumors were classified correctly by using this two-step strategy. Only three of 13 incorrectly classified tumors were false negative, or they were malignant although they were classified as benign. We reached equivalent results as the meta-analysis by Testa et al., which yielded a sensitivity of 93% and specificity of 83% for the two-step strategy in postmenopausal women . Our results are also in line with a large database of IOTA studies which has shown that the pattern recognition by an experienced clinician is the best method in assessing ovarian tumors . Recently, Piovano et al. showed that when serum CA125 was added to simple rules with subjective assessment for diagnosing ovarian tumors, the diagnostic accuracy increased, with an acceptable cost/benefit ratio .
In recent years, several studies have been published, where 3D ultrasound assessment has been used in gynecological cancers, including ovarian cancer. It has been shown that 3DPD vascular indices are elevated in malignant ovarian tumors . Jokubkiene et al. also found this difference, but quantitative 3DPD indices of an ovarian tumor measured by another expert did not add any significant information to subjective quantitation by the original examiner of 2DPD findings . Similarly, Guerriero et al. reported that 3DPD indices failed to improve accuracy as a secondary test for ovarian tumors alongside the evaluation of central vascularization by 2DPD . On the contrary, Geomini et al. found that 3D ultrasonography significantly improved the discrimination of ovarian pathology, when they compared 2D to 3D ultrasound models . Two methods of vascular sampling, manual  and spherical , have been purported to be alternatives to measuring the vascularity of the whole tumor, but based on our experience, the entire tumor should be taken account. In support of this, Kudla and Alcazar have shown that the size of the sphere volume does not affect power Doppler indices .
Our results do not differ from those of the only previous study that compared simple rules and 3DPD. The study of Silvestre et al. assessed 3DPD examination and simple rules in the identification of ovarian tumors . They did not use other preoperative diagnostic methods, and the menopausal status of the patients was ignored. Similar to our study, the ovarian tumors were classified by conventional 2DPD according to IOTA vascular scores. They found that VI and VFI differentiated malignant tumors from benign ones, but they were not more accurate than 2D vascular scores. The use of 3D vascular indices did not decrease the number of false positive results obtained by simple rules.
Combining the 3DPD vascular index VFI with RMI or LR2 may increase the specificity of the diagnostic test, but an ultrasound examination by an experienced clinician still seems to be the most reliable method in the preoperative work-up of ovarian tumors.
Two-dimensional power Doppler
Three-dimensional power Doppler
International Ovarian Tumors Analysis
Logistic regression model
Risk of malignancy index
Vascularization flow index
The study was supported by Finnish Cancer Society and Competitive Research Funding of the Tampere University Hospital (Grant 9S040).
Availability of data and materials
The datasets used and analysed during the current study are available and can be provided by the corresponding author upon request.
RN did all the ultrasound examinations and wrote the first draft of the manuscript. SS evaluated the stored data as the second investigator and reviewed the manuscript. TL did the statistical analysis. JM presented the original idea, supervised the study, and revised the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
All participants gave their informed consent to the study, which was approved by the Ethics Committee of Tampere University Hospital (ETL R10080, 6 August 2010).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Jacobs I, Oram D, Fairbanks J, Turner J, Frost C, Grudzinskas JG. A risk of malignancy index incorporating CA 125, ultrasound and menopausal status for the accurate preoperative diagnosis of ovarian cancer. Br J Obstet Gynaecol. 1990;97(10):922–9.View ArticlePubMedGoogle Scholar
- Valentin L, Hagen B, Tingulstad S, Eik-Nes S. Comparison of ‘pattern recognition’ and logistic regression models for discrimination between benign and malignant pelvic masses: a prospective cross validation. Ultrasound Obstet Gynecol. 2001;18(4):357–65.View ArticlePubMedGoogle Scholar
- Timmerman D. The use of mathematical models to evaluate pelvic masses; can they beat an expert operator? Best Pract Res Clin Obstet Gynaecol. 2004;18(1):91–104.View ArticlePubMedGoogle Scholar
- Timmerman D, Testa AC, Bourne T, Ameye L, Jurkovic D, Van Holsbeke C, et al. Simple ultrasound-based rules for the diagnosis of ovarian cancer. Ultrasound Obstet Gynecol. 2008;31(6):681–90.View ArticlePubMedGoogle Scholar
- Timmerman D, Ameye L, Fischerova D, Epstein E, Melis GB, Guerriero S, et al. Simple ultrasound rules to distinguish between benign and malignant adnexal masses before surgery: prospective validation by IOTA group. BMJ. 2010;341:c6839.View ArticlePubMedPubMed CentralGoogle Scholar
- Testa A, Kaijser J, Wynants L, Fischerova D, Van Holsbeke C, Franchi D, et al. Strategies to diagnose ovarian cancer: new evidence from phase 3 of the multicentre international IOTA study. Br J Cancer. 2014;111(4):680–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Timmerman D, Testa AC, Bourne T, Ferrazzi E, Ameye L, Konstantinovic ML, et al. Logistic regression model to distinguish between the benign and malignant adnexal mass before surgery: a multicenter study by the International Ovarian Tumor Analysis Group. J Clin Oncol. 2005;23(34):8794–801.View ArticlePubMedGoogle Scholar
- Kaijser J, Bourne T, Valentin L, Sayasneh A, Van Holsbeke C, Vergote I, et al. Improving strategies for diagnosing ovarian cancer: a summary of the International Ovarian Tumor Analysis (IOTA) studies. Ultrasound Obstet Gynecol. 2013;41(1):9–20.View ArticlePubMedGoogle Scholar
- Meys EM, Kaijser J, Kruitwagen RF, Slangen BF, Van Calster B, Aertgeerts B, et al. Subjective assessment versus ultrasound models to diagnose ovarian cancer: A systematic review and meta-analysis. Eur J Cancer. 2016;58:17–29.View ArticlePubMedGoogle Scholar
- Orre M, Lotfi-Miri M, Mamers P, Rogers PA. Increased microvessel density in mucinous compared with malignant serous and benign tumours of the ovary. Br J Cancer. 1998;77(12):2204–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Konerding MA, Malkusch W, Klapthor B, van Ackern C, Fait E, Hill SA, et al. Evidence for characteristic vascular patterns in solid tumours: quantitative studies using corrosion casts. Br J Cancer. 1999;80(5-6):724–32.View ArticlePubMedPubMed CentralGoogle Scholar
- Alcazar JL, Rodriguez D. Three-dimensional power Doppler vascular sonographic sampling for predicting ovarian cancer in cystic-solid and solid vascularized masses. J Ultrasound Med. 2009;28(3):275–81.View ArticlePubMedGoogle Scholar
- Timmerman D, Valentin L, Bourne TH, Collins WP, Verrelst H, Vergote I. Terms, definitions and measurements to describe the sonographic features of adnexal tumors: a consensus opinion from the International Ovarian Tumor Analysis (IOTA) Group. Ultrasound Obstet Gynecol. 2000;16(5):500–5.View ArticlePubMedGoogle Scholar
- Alcazar JL, Jurado M. Three-dimensional ultrasound for assessing women with gynecological cancer: a systematic review. Gynecol Oncol. 2011;120(3):340–6.View ArticlePubMedGoogle Scholar
- Pairleitner H, Steiner H, Hasenoehrl G, Staudach A. Three-dimensional power Doppler sonography: imaging and quantifying blood flow and vascularization. Ultrasound Obstet Gynecol. 1999;14(2):139–43.View ArticlePubMedGoogle Scholar
- Brennan P, Silman A. Statistical methods for assessing observer variability in clinical measures. BMJ. 1992;304(6840):1491–4.View ArticlePubMedPubMed CentralGoogle Scholar
- Wang J, Gao J, Yao H, Wu Z, Wang M, Qi J. Diagnostic accuracy of serum HE4, CA125 and ROMA in patients with ovarian cancer: a meta-analysis. Tumour Biol. 2014;35(6):6127–38.View ArticlePubMedGoogle Scholar
- Geomini P, Kruitwagen R, Bremer GL, Cnossen J, Mol BW. The accuracy of risk scores in predicting ovarian malignancy: a systematic review. Obstet Gynecol. 2009;113(2 Pt 1):384–94.View ArticlePubMedGoogle Scholar
- Van Calster B, Timmerman D, Valentin L, McIndoe A, Ghaem-Maghami S, Testa AC, et al. Triaging women with ovarian masses for surgery: observational diagnostic study to compare RCOG guidelines with an International Ovarian Tumour Analysis (IOTA) group protocol. BJOG. 2012;119(6):662–71.View ArticlePubMedGoogle Scholar
- Kaijser J, Sayasneh A, Van Hoorde K, Ghaem-Maghami S, Bourne T, Timmerman D, et al. Presurgical diagnosis of adnexal tumours using mathematical models and scoring systems: a systematic review and meta-analysis. Hum Reprod Update. 2014;20(3):449–62.View ArticlePubMedGoogle Scholar
- Piovano E, Cavallero C, Fuso L, Viora E, Ferrero A, Gregori G, et al. diagnostic accuracy and cost-effectiveness of different strategies to triage adnexal masses: a prospective study. Ultrasound Obstet Gynecol. 2016; doi: 10.1002/uog.17320.
- Alcazar JL, Merce LT, Garcia MM. Three-dimensional power Doppler vascular sampling: a new method for predicting ovarian cancer in vascularized complex adnexal masses. J Ultrasound Med. 2005;24(5):689–96.View ArticlePubMedGoogle Scholar
- Jokubkiene L, Sladkevicius P, Valentin L. Does three-dimensional power Doppler ultrasound help in discrimination between benign and malignant ovarian masses? Ultrasound Obstet Gynecol. 2007;29(2):215–25.View ArticlePubMedGoogle Scholar
- Guerriero S, Ajossa S, Piras S, Gerada M, Floris S, Garau N, et al. Three-dimensional quantification of tumor vascularity as a tertiary test after B-mode and power Doppler evaluation for detection of ovarian cancer. J Ultrasound Med. 2007;26(10):1271–8.View ArticlePubMedGoogle Scholar
- Geomini PM, Coppus SF, Kluivers KB, Bremer GL, Kruitwagen RF, Mol BW. Is three-dimensional ultrasonography of additional value in the assessment of adnexal masses? Gynecol Oncol. 2007;106(1):153–9.View ArticlePubMedGoogle Scholar
- Kudla MJ, Alcazar JL. Does sphere volume affect the performance of three-dimensional power Doppler virtual vascular sampling for predicting malignancy in vascularized solid or cystic-solid adnexal masses? Ultrasound Obstet Gynecol. 2010;35(5):602–8.View ArticlePubMedGoogle Scholar
- Silvestre L, Martins WP, Candido-Dos-Reis FJ. Limitations of three-dimensional power Doppler angiography in preoperative evaluation of ovarian tumors. J Ovarian Res. 2015;8:47. 015-0174-y.View ArticlePubMedPubMed CentralGoogle Scholar