Key points
- The Collaborating Center for Questionnaire Design and Evaluation Research (CCQDER) publishes reports about all its projects in Q-Bank.
- CCQDER experts have published books about cognitive interviewing and other evaluation methods.
- CCQDER also shares findings through journal articles and workshops.
Q-Bank reports
Access CCQDER question evaluation reports in Q-Bank. Reports in Q-Bank provide information about question design and performance. Use this information to improve surveys and understand survey data estimates better.
Books
CCQDER staff and collaborators have published two books about cognitive interviewing and question evaluation methods.
Cognitive Interviewing Methodology provides an interdisciplinary perspective on the evolution of theory and methodology within cognitive interview processes.
Miller K, Willson S, Chepp V, Padilla JL, editors. Cognitive interviewing methodology. Hoboken, NJ: John Wiley & Sons, Inc. 2014.
Question Evaluation Methods provides insight about best practices in common question evaluation methods. The book is based on the 2009 Question Evaluation Methods Workshop held at the National Center for Health Statistics (NCHS).
Madans J, Miller K, Maitland A, Willis G, editors. Question evaluation methods: Contributing to the science of data quality. Hoboken, NJ: John Wiley & Sons, Inc. 2011.
Question Evaluation Methods Workshop
In 2009, NCHS, CCQDER, and the National Cancer Institute hosted a workshop on question evaluation methods. Leading experts in different evaluation methods presented. Participants engaged in an interdisciplinary and cross-method examination of evaluation methods.
Journal articles and book chapters
Smith Z, Ryan V, Willson S. Using Interpretive Question Evaluation Methods to Assess Race and Ethnicity Items. Survey Practice. 16 (1). 2023. Available from: https://www.surveypractice.org/article/89383-using-interpretive-question-evaluation-methods-to-assess-race-and-ethnicity-items.
Willson S, Scanlon P, Miller K. Question Evaluation for Real-Time Surveys: Lessons from COVID-19 Data Collection. SSM – Qualitative Research in Health. 2022. Available from: https://doi.org/10.1016/j.ssmqr.2022.100164.
Parker J, Miller K, He Y, Scanlon P, Cai B, Shin H-C, et al. Overview and initial results of the National Center for Health Statistics' Research and Development Survey. Stat J IAOS 36(4):1199–211. 2020. Available from: https://content.iospress.com/articles/statistical-journal-of-the-iaos/sji200678.
Scanlon P. The effects of embedding closed-ended cognitive probes in a web survey on survey response. Field Methods 31(4):328–43. 2019. Available from: https://journals.sagepub.com/doi/10.1177/1525822X19871546.
Scanlon P. Using targeted embedded probes to quantify cognitive interviewing findings. In: Beatty PC, Collins D, Kaye L, Padilla JL, Willis G, Wilmot A, editors. Advances in questionnaire design, development, evaluation, and testing 427–50. John Wiley and Sons Inc. 2019. DOI: https://doi.org/10.1002/9781119263685.ch17.
Miller K. Conducting cognitive interviewing studies to examine survey question comparability. In: Johnson TP, Pennell BE, Stoop IAL, Dorer B, editors. Advances in comparative survey methods: Multinational, multiregional, and multicultural contexts (3MC)203–25. John Wiley and Sons Inc. 2018. DOI: https://doi.org/10.1002/9781118884997.ch10.
Miller K, Willis G. Cognitive models of answering processes. In: Wolf C, Joye D, Smith TW, Fu YC, editors. The SAGE handbook of survey methodology. SAGE Publications. 2016. DOI: https://dx.doi.org/10.4135/9781473957893.
Miller K. Conducting cognitive interviews to understand question-response limitations. Am J Health Behav. 27(S3):264–72. 2003. Available from: https://www.ingentaconnect.com/contentone/png/ajhb/2003/00000027/a00300s3/art00010;jsessionid=2pra6skpp5jqe.x-ic-live-02.
Shockey TM, Silver SR, Wilmot A. Development and Cognitive Testing of Occupational Safety and Health Questions for a Youth Survey: Addressing the Research Needs for a Vulnerable Working Population. J Sch Health. 2024 Feb;94(2):165-177. doi: 10.1111/josh.13386. Available from: https://pubmed.ncbi.nlm.nih.gov/37562408/.
Santibanez TA, Nguyen KH, Greby SM, Fisher A, Scanlon P, Bhatt A, et al. Parental vaccine hesitancy and childhood influenza vaccination. Pediatrics 146(6). 2020. DOI: https://doi.org/10.1542/peds.2020-007609.
Miller K. Summary of Washington Group question evaluation studies. In: Altman BM, editor. International measurement of disability: Purpose, method and application. Springer International Publishing. 2016. Abstract available from: https://link.springer.com/chapter/10.1007/978-3-319-28498-9_5
Willson S, Miller K, Seem D, Kuehnert MJ. Cognitive evaluation of the AABB Uniform Donor History Questionnaire. Transfusion. 2016 Jun;56(6 Pt 2):1662–7. Available from: https://onlinelibrary.wiley.com/doi/10.1111/trf.13587.
Ridolfo H, Miller K, Maitland A. Measuring sexual identity using survey questionnaires: How valid are our measures? Sexuality research and social policy: A Journal of the NSRC 9(2):113–24. 2012. Available from: https://link.springer.com/article/10.1007/s13178-011-0074-x.