Limitations of three-dimensional power Doppler angiography in preoperative evaluation of ovarian tumors
© Silvestre et al. 2015
Received: 22 April 2015
Accepted: 1 July 2015
Published: 29 July 2015
This study describes the accuracy of three-dimensional power Doppler (3D-PD) angiography as secondary method for differential diagnosis of ovarian tumors.
Seventy-five women scheduled for surgical removal of adnexal masses were assessed by transvaginal ultrasound. Ovarian tumors were classified by IOTA simple rules and two three-dimensional blocks were recorded. In a second step analyses, a 4 cm3 spherical sample was obtained from the highest vascularized solid area of each stored block. Vascularization index (VI), flow index (FI) and vascularization-flow index (VFI) were calculated. The repeatability was assessed by concordance correlation coefficient (CCC) and limits of agreement (LoA), and diagnostic accuracy by area under ROC curve.
IOTA simple rules classified 26 cases as benign, nine as inconclusive and 40 as malignant. There were eight false positive and no false negative. Among the masses classified as inconclusive or malignant by IOTA simple rules, the CCCs were 0.91 for VI, 0.70 for FI, and 0.86 for VFI. The areas under ROC curve were 0.82 for VI, 0.67 for FI and 0.81 for VFI.
3D-PD angiography presented considerable intraobserver variability and low accuracy for identifying false positive results of IOTA simple rules.
Ovarian cancer is the leading cause of death among gynecological cancers . Because the patient survival is strongly associated with disease stage, there have been many attempts of early diagnosis. While the occurrence of masses in adnexal region is very frequent (up to 20 %), the prevalence of ovarian cancer is low (approximately 0.2-0.3 % in post-menopausal women). To detect one ovarian cancer case using screening methods, approximately 5 women will be submitted to surgery [2, 3]. Tranvaginal ultrasonography is one of the most evaluated methods for early detection of ovarian cancer. In clinical practice, detected adnexal masses can be classified according to International Tumor Ovarian Analysis (IOTA) “simple rules”. IOTA simple rules are based on the identification of some simple features during conventional ultrasound examination and presents high sensitivity . However, the false positive rate is elevated. About 40-50 % of the women with inconclusive and malignant results by IOTA simple rules have benign ovarian tumors [5, 6].
Three-dimensional ultrasonography allows quantifying blood flow and vascularization in ovarian tumors . Vascularization index (VI), flow index (FI) and vascularization-flow index (VFI) can be calculated after manual outlining of vascularized solid areas within the tumor  or after spherical sampling from the most vascularized area of the tumor, the area is selected by the examiner and the spherical sampling performed automatically by the software . The results are similar for both methods, however virtual spherical sampling saves time compared with manual sampling when the examiner is less experienced .
Differences in vascularization between malignant and benign ovarian tumors are well established  and vascular indices obtained using 3D-PD angiography are correlated with tissue perfusion as reported for experimental models [12–14]. However, the usefulness of vascular virtual biopsies for differential diagnosis of adnexal masses is still controversy [15, 16]. In this study, our objective was to evaluate whether 3D-PD angiography can be used to reduce the false positives among adnexal masses with inconclusive or malignant result according to IOTA simple rules.
We invited 75 women that were consecutively scheduled for surgery to remove adnexal masses from September 2008 to December 2010. All these women accepted to participate and were included in the study. The study was approved by the institutional review board (Ethics Committee of the University Hospital of Ribeirao Preto School of Medicine) and informed consents were obtained from all participants. Final diagnoses were based on the tumor histology, classified according to WHO criteria . The manuscript was prepared following the STARD (diagnostic accuracy studies) guideline.
Participants were assessed by transvaginal ultrasound scan using a Voluson 730 (GE Healthcare, Zipf, Austria) ultrasound machine equipped with a volumetric vaginal probe (RIC5-9-D). The adnexal masses were classified as benign, malignant or inconclusive according to IOTA simple rules . Briefly, if one or more malignant features were present in absence of benign feature, the mass was classified as malignant; if one or more benign features were present in absence of malignant feature, the mass was classified as benign; if both malignant features and benign features were present, or if no benign or malignant feature was present, the result was inconclusive. Vascular power Doppler score is included in IOTA simple rules as one variable: a score of 1 is given when no blood flow is found in the tumor, a score of 2 when only minimal flow is detected, a score of three when moderate flow is present and a score of four when the tumor presents marked blood flow .
After the conventional ultrasound, the same observer acquired two three-dimensional volumes from the adnexal masses. For large tumors, when it was not possible to completely include the tumor in the block, the sonographer chose the most complex area of the tumor to be sampled and attempted to sample the same area for both blocks. The following predetermined power Doppler settings that were kept constant throughout the study: (Main PD settings) Filter = low1; PRF = 0.6 KHz; gain = 0.0; Quality = normal; (Sub PD settings) Freq = mid; Flow res = mid1; Smooth = 5/6; Ensemble = 12; Line Den = 7; PD map = 5 (Gently Color = on); Balance = G > 200; Artifact = on; L. Filter = 2. The blocks were recorded for later analyses. The maximum interval time between ultrasound scan and surgery was 7 days; this was performed to reduce the risk of the occurrence/regression of a disease between the ultrasound scan and the surgery.
A 4 cm3 spherical sample was obtained from the highest vascularized solid area of each tumor stored block using the 4D View software (version 5.0, GE Healthcare). The maximum distance between the ultrasound probe and the spherical sample was 4 cm (mean = 2 cm; average difference between distances from each pair of samples = 0.1 cm; effect size of intra-pair variation = 0.04). VI, FI and VFI were calculated. The observer was blinded for the histological result.
Statistical analysis was conducted using STATA/SE version 13 (StataCorp). Mann–Whitney test was used to compare quantitative variables between benign and malignant groups, Fisher's exact test to analyze contingency tables and Kruskal-Wallis test to compare the 3D-PD indices among the tumors grouped by power Doppler scores. Intra-observer repeatability and diagnostic accuracy and were evaluated for 49 women with inconclusive or malignant results by IOTA. The intra-observer repeatability was assessed comparing the results of vascular virtual biopsies from the two blocks of each tumor by the concordance correlation coefficient (CCC)  and the limits of agreement (LoA) of the relative difference between measurements . CCC values should be higher than 0.70 to be used as research tool, higher than 0.90 to be used in clinical practice, and higher than 0.95 for individual and important decisions . The diagnostic accuracy of 3D-PD indices was estimated by the area under ROC curve.
Final diagnosis of 75 adnexal masses
Ovarian abscess sequelae
Clear cell carcinoma
Mucinous bordeline tumor
Serous borderline tumor
Transitional cell carcinoma
IOTA and 3D-PD indices according to final diagnosis
Benign (N = 43)
Malignant (N = 32)
IOTA simple rulesb
Repeatability analyses of the 3D-PD indices in the 49 adnexal masses with inconclusive or malignant results by IOTA simple rules: concordance correlation coefficient (CCC) and limits of agreement (LoA)
CCC (95 % CI)
Mean difference (LoA)
0.91 (0.84 to 0.95)
0.12 (−10.6 to +10.9)
0.70 (0.53 to 0.82)
−0.02 (−13.1 to +13.0)
0.86 (0.77 to 0.92)
0.33 (−6.1 to + 6.8)
Diagnostic accuracies of 3D-PD indices for reclassifyadnexal masses with inconclusive or malignant results by IOTA simple rules are presented in Fig. 1d. We observed an area under ROC curves of 0.82 (95 % CI: 0.70-0.94) for VI, 0.67 (95 % CI: 0.50-0.84) for FI and 0.81 (95 % CI: 0.69-0.93) for VFI. The highest cut-offs still resulting in 100 % sensitivity for malignancy were: VI ≥ 3.4, FI ≥ 31.2 and VFI ≥ 1.6. The number of false positives was 14 for all 3D-PD indices.
Based on the combination of limits of agreement and ROC curves, the sensitivity of 3D-PD presented considerable variation. Intra-observer variability can be reduced the sensitivity for VI from 100 % to 75 %, for FI from 100 % to 43 % for FI and from 100 % to 64 % for VFI.
Benign ovarian tumors can be safely managed by general gynecologists; however malignant ovarian tumors should be referred to a gynecologic oncology expert. The best management of “inconclusive” cases is still not defined; frequently the patients are referred to a gynecologic oncology expert and submitted to surgery. The major problem in the management of adnexal masses is to reduce the false positive rate without reducing the sensitivity. Our results show that 3D-PD angiography from the most complex area of adnexal mass can distinguish benign from malignant ovarian tumors. However, this method is not able to reduce the false positive rates of IOTA simple rules. The intra examiner repeatability is lower than the minimum recomended for secure clinical use and may impair significantly the accuracy of this method.
VI and VFI were more accurate to differentiate between benign and malignant ovarian tumors than FI. However, both indices were strongly associated with conventional power Doppler vascular scores. The variable power Doppler vascular score is used in the IOTA simple rules classification. Therefore, this association may be another reason why 3D-PD indices do not improve the accuracy of IOTA classification of ovarian tumors.
Despite the relatively small sample size, our study has the advantages of a planned prospective design and data collection by an experienced sonographer using a single machine with all set up parameters kept constant. Our observed values of 3D-PD indices were higher in malignant ovarian tumors which are in agreement with most of previously published data . The effect of intra-observer variability of 3D-PD indices can be observed considering together the limits of agreement and the cut-offs from ROC curves. The sensitivity of the method can vary from 100 % to 43 % due to intra-observer variability, which in unacceptable for this group of patients. Some authors claim to have better reproducibility than we found in this series. Previous studies have shown intra-observer intraclass correlation coefficients (ICC) between 0.95-0.99 [9, 24, 25]. However, all these studies were based on single 3D-PD data-sets, which did not account for inherent clinical relevant sources of variability caused by respiratory and intestinal movements, and also from the phase of the cardiac cycle during acquisition .
The prevalence of malignant cases in our sample was high. In ultrasound settings linked to a gynecological oncology service the expected prevalence of malignancy in adnexal masses is higher than in general hospitals. Among our cases, 43 % were malignant, this prevalence is similar to the reported prevalence of 42 % of malignancy in oncology centers and 17 % in other centers .
Ovarian neoplasms are heterogeneous in morphology and even in genetic sub-clones of malignant cells . Variable patterns of vascularization are frequently identified in different portions of the same tumor . Therefore, diagnostic methods based on the analysis of parts of the tumor produce inevitable intra-observer variability. The key question is whether the disagreement is enough to cause confusion and impair the method validity.
Our data provide strong evidence that 3D-PD angiography from spherical biopsy is not accurate for reducing the false positive rates of IOTA single rules.
We thank all the women whose data were used in the study.
- Siegel R, Naishadham D, Jemal A. Cancer statistics, 2012. CA Cancer J Clin. 2012;62(1):10–29.PubMedView ArticleGoogle Scholar
- Buys SS, Partridge E, Black A, Johnson CC, Lamerato L, Isaacs C, et al. Effect of screening on ovarian cancer mortality: the Prostate, Lung, Colorectal and Ovarian (PLCO) Cancer Screening Randomized Controlled Trial. JAMA. 2011;305(22):2295–303.PubMedView ArticleGoogle Scholar
- Pavlik EJ, Ueland FR, Miller RW, Ubellacker JM, DeSimone CP, Elder J, et al. Frequency and disposition of ovarian abnormalities followed with serial transvaginal ultrasonography. Obstet Gynecol. 2013;122(2 Pt 1):210–7.PubMedView ArticleGoogle Scholar
- Sayasneh A, Wynants L, Preisler J, Kaijser J, Johnson S, Stalder C, et al. Multicentre external validation of IOTA prediction models and RMI by operators with varied training. Br J Cancer. 2013;108(12):2448–54.PubMed CentralPubMedView ArticleGoogle Scholar
- Timmerman D, Ameye L, Fischerova D, Epstein E, Melis GB, Guerriero S, et al. Simple ultrasound rules to distinguish between benign and malignant adnexal masses before surgery: prospective validation by IOTA group. BMJ. 2010;341:c6839.PubMed CentralPubMedView ArticleGoogle Scholar
- Alcazar JL, Pascual MA, Olartecoechea B, Graupera B, Auba M, Ajossa S, et al. IOTA simple rules for discriminating between benign and malignant adnexal masses: prospective external validation. Ultrasound Obstet Gynecol. 2013;42(4):467–71.PubMedGoogle Scholar
- Pairleitner H, Steiner H, Hasenoehrl G, Staudach A. Three-dimensional power Doppler sonography: imaging and quantifying blood flow and vascularization. Ultrasound Obstet Gynecol. 1999;14(2):139–43.PubMedView ArticleGoogle Scholar
- Alcázar JL, Mercé LT, García Manero M. Three-dimensional power Doppler vascular sampling: a new method for predicting ovarian cancer in vascularized complex adnexal masses. J Ultrasound Med. 2005;24(5):689–96.PubMedGoogle Scholar
- Jokubkiene L, Sladkevicius P, Valentin L. Does three-dimensional power Doppler ultrasound help in discrimination between benign and malignant ovarian masses? Ultrasound Obstet Gynecol. 2007;29(2):215–25.PubMedView ArticleGoogle Scholar
- Alcázar JL, Prka M. Evaluation of two different methods for vascular sampling by three-dimensional power Doppler angiography in solid and cystic-solid adnexal masses. Ultrasound Obstet Gynecol. 2009;33(3):349–54.PubMedView ArticleGoogle Scholar
- Candido Dos Reis F, Moreira de Andrade J, Bighetti S. CA 125 and vascular endothelial growth factor in the differential diagnosis of epithelial ovarian tumors. Gynecol Obstet Invest. 2002;54(3):132–6.PubMedView ArticleGoogle Scholar
- Jones NW, Hutchinson ES, Brownbill P, Crocker IP, Eccles D, Bugg GJ, et al. In vitro dual perfusion of human placental lobules as a flow phantom to investigate the relationship between fetoplacental flow and quantitative 3D power doppler angiography. Placenta. 2009;30(2):130–5.PubMedView ArticleGoogle Scholar
- Morel O, Pachy F, Chavatte-Palmer P, Bonneau M, Gayat E, Laigre P, et al. Correlation between utero-placental three-dimensional power Doppler indices and the uterine real blood flow: Evaluation in a pregnant sheep experimental model. Ultrasound Obstet Gynecol. 2010;36(5):635–40.PubMedView ArticleGoogle Scholar
- Raine-Fenning NJ, Nordin NM, Ramnarine KV, Campbell BK, Clewes JS, Perkins A, et al. Determining the relationship between three-dimensional power Doppler data and true blood flow characteristics: an in-vitro flow phantom experiment. Ultrasound Obstet Gynecol. 2008;32(4):540–50.PubMedView ArticleGoogle Scholar
- Ohel I, Sheiner E, Aricha-Tamir B, Piura B, Meirovitz M, Silberstein T, et al. Three-dimensional power Doppler ultrasound in ovarian cancer and its correlation with histology. Arch Gynecol Obstet. 2010;281(5):919–25.PubMedView ArticleGoogle Scholar
- Perez-Medina T, Orensanz I, Pereira A, Valero de Bernabe J, Engels V, Troyano J, et al. Three-dimensional angioultrasonography for the prediction of malignancy in ovarian masses. Gynecol Obstet Invest. 2013;75(2):120–5.PubMedView ArticleGoogle Scholar
- Lee KR, Tavassoli FA, Prat J, Dietel M, Gersell DJ, Karseladze AI, et al. Tumours of the Ovary and Peritoneum. In: Lyon DP (ed) The World Health Organization Classification of Tumours Pathology and Genetics of Tumours of the Breast and Female Genital Organs. IARC Press; 2003. pp 113–97.Google Scholar
- Timmerman D, Testa AC, Bourne T, Ameye L, Jurkovic D, Van Holsbeke C, et al. Simple ultrasound-based rules for the diagnosis of ovarian cancer. Ultrasound Obstet Gynecol. 2008;31(6):681–90.PubMedView ArticleGoogle Scholar
- Timmerman D, Valentin L, Bourne TH, Collins WP, Verrelst H, Vergote I, et al. Terms, definitions and measurements to describe the sonographic features of adnexal tumors: a consensus opinion from the International Ovarian Tumor Analysis (IOTA) Group. Ultrasound Obstet Gynecol. 2000;16(5):500–5.PubMedView ArticleGoogle Scholar
- Chen C-C, Barnhart HX. Comparison of ICC and CCC for assessing agreement for data without and with replications. Comput Stat Data Anal. 2008;53(2):554–64.View ArticleGoogle Scholar
- Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.PubMedView ArticleGoogle Scholar
- Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hrobjartsson A, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96–106.PubMedView ArticleGoogle Scholar
- Kudla MJ, Timor-Tritsch IE, Hope JM, Monteagudo A, Popiolek D, Monda S, et al. Spherical tissue sampling in 3-dimensional power Doppler angiography: a new approach for evaluation of ovarian tumors. J Ultrasound Med. 2008;27(3):425–33.PubMedGoogle Scholar
- Alcazar JL, Rodriguez D, Royo P, Galvan R, Ajossa S, Guerriero S, et al. Intraobserver and interobserver reproducibility of 3-dimensional power Doppler vascular indices in assessment of solid and cystic-solid adnexal masses. J Ultrasound Med. 2008;27(1):1–6.PubMedGoogle Scholar
- Kudla M, Alcazar JL. Does the size of three-dimensional power Doppler spherical sampling affect the interobserver reproducibility of measurements of vascular indices in adnexal masses? Ultrasound Obstet Gynecol. 2009;34(6):732–4.PubMedView ArticleGoogle Scholar
- Martins WP. Three-dimensional power Doppler: validity and reliability. Ultrasound Obstet Gynecol. 2010;36(5):530–3.PubMedView ArticleGoogle Scholar
- Van Calster B, Van Hoorde K, Valentin L, Testa AC, Fischerova D, Van Holsbeke C, et al. Evaluating the risk of ovarian cancer before surgery using the ADNEX model to differentiate between benign, borderline, early and advanced stage invasive, and secondary metastatic tumours: prospective multicentre diagnostic study. BMJ. 2014;349:g5920.PubMed CentralPubMedView ArticleGoogle Scholar
- Langdon SP, Lawrie SS, Hay FG, Hawkes MM, McDonald A, Hayward IP, et al. Characterization and properties of nine human ovarian adenocarcinoma cell lines. Cancer Res. 1988;48(21):6166–72.PubMedGoogle Scholar
- Prompeler HJ, Madjar H, Sauerbrei W. Classification of adnexal tumors by transvaginal color Doppler. Gynecol Oncol. 1996;61(3):354–63.PubMedView ArticleGoogle Scholar
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.