Journal article
Evaluating Confidence Interval Methods for Binomial Proportions in Clustered Surveys
Vaccination coverage surveys - Publication abstract: In survey settings, a variety of methods are available for constructing confidence intervals for proportions. These methods include the standard Wald method, a class of modified methods that replace the sample size with the survey effective sample size (Wilson, Clopper-Pearson, Jeffreys, and Agresti-Coull), and transformed methods (Logit and Arcsine). We describe these seven methods, two of which have not been previously evaluated in the literature (the modified Jeffreys and Agresti-Coull intervals). For each method, we describe two formulations, one with and one without adjustment for the design degrees of freedom. We suggest a definition of adjusted effective sample size that induces equivalency between different confidence interval expressions. We also expand on an existing framework for truncation that can be used when data appear to be more efficient than a simple random sample or when data have standard error equal to zero. We compare these methods using a simulation study modeled after the 30 × 7 design for immunization surveys. Our results confirmed the importance of adjusting for the design degrees of freedom. As expected, the Wald interval performed very poorly, frequently failing to achieve the nominal coverage level. For similar reasons, we do not recommend the use of the Arcsine interval. When the intracluster correlation coefficient is high and the prevalence, p, is less than 0.10 or greater than 0.90, the Agresti-Coull and Clopper-Pearson intervals perform best. In other settings, the Clopper-Pearson interval is unnecessarily wide. In general, the Logit, Wilson, Jeffreys, and Agresti-Coull intervals perform well, although the Logit interval may be intractable when the standard error is equal to zero.
Authors
Languages
- English
Journal
J survey stats & methods
Type
Journal article
Categories
- Programme management
Topic references
COV-METH-PUB
Title | Author | Year | Type | Language |
---|---|---|---|---|
A computer simulation of the EPI survey strategy. | Alexandre G. Tserkovnyi, Jacobus Keja, James Leonard Tulloch, John E. Dowd, Stanley Lemeshow, Steven K. Lwanga | Journal article | English | |
A not quite as quick but much cleaner alternative to the Expanded Programme on Immunization (EPI) Cluster Survey design. | Anthony G. Turner , Muhammad Shuaib, Robert J. Magnani | Journal article | English | |
Assessing and monitoring vaccination coverage levels: lessons from the Americas. | Edgar Monterroso, Elizabeth R Zell, George Stroh, Gina Tambini, Héctor Izurieta, Linda Venczel, Vance Dietz | 2004 | Journal article | English |
Assessing equivalence: an alternative to the use of difference tests for measuring disparities in vaccination coverage. | Elizabeth T. Luman, Lawrence E. Barker, Mary M. McCauley, Susan Y Chu | 2002 | Journal article | English |
Choosing a Cluster Sampling Design for Lot Quality Assurance Sampling Surveys | Edward J. Bedrick, Lauren Hund, Marcello Pagano | Journal article | English | |
Cluster Lot Quality Assurance Sampling: Effect of Increasing the Number of Clusters on Classification Precision and Operational Feasibility | Roland W. Sutter, Steven G. F. Wassilak, Pascal Mkanda, Marina Takane, Alex N. Gasasira, Michael M. Nzioki, Alexandra E. Brown, Hiromasa Okayasu | Journal article | English | |
Comments on ‘‘Monitoring vaccination coverage: Defining the role of surveys” | Robert Pond, Sandra Mounier-Jack | Journal article | English | |
Consultancy services for conducting an evaluation of immunisation coverage monitoring methodology and process | Wolfgang Weber, Xavier Bosch-Capblanch | Guidance | English | |
Does adjusting for recall in trend analysis affect coverage estimates for maternal and child health indicators? An analysis of DHS and MICS survey data | Donela Besada, Nicholas P. Oliphant, Nobubelo K. Ngandu, Samuel Manda, Sarah Rohde, Tanya Doherty | Journal article | English | |
Effectiveness of Using Mobile Phone Image Capture for Collecting Secondary Data: A Case Study on Immunization History Data Among Children in Remote Areas of Thailand | Amnat Khamsiriwatchara, Jaranit Kaewkungwal, Kasemsak Jandee, Peerawat Wansatid, Saranath Lawpoolsri, Waranya Wongwit | 2015 | Journal article | English |
Evaluating Confidence Interval Methods for Binomial Proportions in Clustered Surveys | Marcello Pagano, Natalie Dean | Journal article | English | |
Immunization Coverage Surveys and Linked Biomarker Serosurveys in Three Regions in Ethiopia | Jaya Goswami, Amha Kebede, Berhane Beyene, Inna Ruslanova, James D Campbell, Jenny Sequeira, Lisa Oot, Marcela F. Pasetti, Mardi Reymann, Mark A Travassos, Myron M Levine, Nigisti Mulholland, Robert Steinglass, Samba O Sow, Seydou S Diarra, Tassew Kassa, William C. Blackwelder, Yukun Wu, Zenaw Adam | Journal article | English | |
Issues and considerations in the use of serologic biomarkers for classifying vaccination history in household surveys | Adam MacNeil, Chung-won Lee, Vance Dietz | 1960 | Journal article | English |
Lot Quality Assurance Sampling to Monitor Supplemental Immunization Activity Quality: An Essential Tool for Improving Performance in Polio Endemic Countries | Alexandra E. Brown, Arshad Quddus, George Walker, Guillaume Chabot-Couture, Hiromasa Okayasu, Michael M. Nzioki, Mufti Z. Wadood, Roland W. Sutter | Journal article | English | |
LQAS: User Beware | Dale A. Rhoda, David J. Fitch, Soledad A. Fernandez, Stanley Lemeshow | Journal article | English | |
Measurement of immunisation coverage | Jean-Marie Okwo-Bele, Maryanne Neil, Peter Salama, Tessa Wardlaw, Tony Burton | Journal article | English | |
Measuring Coverage in MNCH: A Validation Study Linking Population Survey Derived Coverage to Maternal, Newborn, and Child Health Care Records in Rural China | Biqin Tan, Harry Campbell, Jennifer Bryce, Li Liu, Li Yang, Lirong Ju, Mengying Li, Neff Walker, Robert E. Black, Yan Guo | 2013 | Journal article | English |
Measuring coverage in MNCH: total survey error and the interpretation of intervention coverage estimates from household surveys. | Aluisio J D Barros, Dale A. Rhoda, Felicity T Cutts, Fred Arnold, Joseph Keating, Ruilin Ren, Thomas P. Eisele | Journal article | English | |
Measuring Coverage in MNCH: Tracking Progress in Health for Women and Children Using DHS and MICS Household Surveys | Attila Hancioglu, Fred Arnold | Journal article | English | |
Measuring populations to improve vaccination coverage | Ali Djibo, Andrew J. Tatem, Bryan T. Grenfell, Matthew J. Ferrari, Nita Bharti | 2016 | Journal article | English |
Measuring the performance of vaccination programs using cross-sectional surveys: a likelihood framework and retrospective analysis. | Bryan T. Grenfell, C. Jessica E. Metcalf, Derek A. T. Cummings, Francisco J. Luquero, Justin Lessler, Rebecca F. Grais | Journal article | English | |
Monitoring vaccination coverage: Defining the role of surveys | Dale A. Rhoda, Felicity T Cutts, M. Carolina Danovaro-Holliday, Pierre Claquin | Journal article | English | |
Reply to comments on Monitoring vaccination coverage: Defining the role of surveys. | Dale A. Rhoda, Felicity T Cutts, M. Carolina Danovaro-Holliday, Pierre Claquin | Journal article | English | |
Seroepidemiology: an underused tool for designing and monitoring vaccination programmes in low- and middleincome countries | Felicity T Cutts, Matt Hanson | Journal article | English | |
Use and abuse of rapid monitoring to assess coverage during mass vaccination campaigns. | Elizabeth T. Luman, K. Lisa Cairns, Robert Perry, Vance Dietz | Guidance | English | |
Validity of reported vaccination coverage in 45 countries. | Christopher J. L. Murray, Bakhuti Shengelia, Neeru Gupta, Saba Moussavi, Ajay Tandon, Michel Thieren | 2003 | Journal article | English |
Validity of vaccination cards and parental recall to estimate vaccination coverage: a systematic review of the literature. | Elizabeth T. Luman, Elizabeth Zell, Melody Miles, Tove K. Ryman, Vance Dietz | Journal article | English |