Insightful observations on common question evaluation methods and best practices for data collection in survey research Featuring contributions from leading researchers and academicians in the field of survey research, Question Evaluation Methods: Contributing to the Science of Data Quality sheds light on question response error and introduces an interdisciplinary, cross-method approach that is essential for advancing knowledge about data quality and ensuring the credibility of conclusions drawn from surveys and censuses. Offering a variety of expert analyses of question evaluation methods, the book provides recommendations and best practices for researchers working with data in the health and social sciences. Based on a workshop held at the National Center for Health Statistics (NCHS), this book presents and compares various question evaluation methods that are used in modern-day data collection and analysis. Each section includes an introduction to a method by a leading authority in the field, followed by responses from other experts that outline related strengths, weaknesses, and underlying assumptions. Topics covered include: Behavior coding Cognitive interviewing Item response theory Latent class analysis Split-sample experiments Multitrait-multimethod experiments Field-based data methods A concluding discussion identifies common themes across the presented material and their relevance to the future of survey methods, data analysis, and the production of Federal statistics. Together, the methods presented in this book offer researchers various scientific approaches to evaluating survey quality to ensure that the responses to these questions result in reliable, high-quality data. Question Evaluation Methods is a valuable supplement for courses on questionnaire design, survey methods, and evaluation methods at the upper-undergraduate and graduate levels. it also serves as a reference for government statisticians, survey methodologists, and researchers and practitioners who carry out survey research in the areas of the social and health sciences.

Insightful observations on common question evaluation methodsand best practices for data collection in survey researchFeaturing contributions from leading researchers andacademicians in the field of survey research, QuestionEvaluation Methods: Contributing to the Science of Data Qualitysheds light on question response error and introduces aninterdisciplinary, cross-method approach that is essential foradvancing knowledge about data quality and ensuring the credibilityof conclusions drawn from surveys and censuses. Offering a varietyof expert analyses of question evaluation methods, the bookprovides recommendations and best practices for researchers workingwith data in the health and social sciences.Based on a workshop held at the National Center for HealthStatistics (NCHS), this book presents and compares various questionevaluation methods that are used in modern-day data collection andanalysis. Each section includes an introduction to a method by aleading authority in the field, followed by responses from otherexperts that outline related strengths, weaknesses, and underlyingassumptions. Topics covered include:* Behavior coding* Cognitive interviewing* Item response theory* Latent class analysis* Split-sample experiments* Multitrait-multimethod experiments* Field-based data methodsA concluding discussion identifies common themes across thepresented material and their relevance to the future of surveymethods, data analysis, and the production of Federal statistics.Together, the methods presented in this book offer researchersvarious scientific approaches to evaluating survey quality toensure that the responses to these questions result in reliablehigh-quality data.Question Evaluation Methods is a valuable supplement for courseson questionnaire design, survey methods, and evaluation methods atthe upper-undergraduate and graduate levels. it also serves as areference for government statisticians, survey methodologists, andresearchers and practitioners who carry out survey research in theareas of the social and health sciences.

Contributors ixPreface xi1 Introduction 1Jennifer Madans, Kristen Miller, Aaron Maitland, and GordonWillisI BEHAVIOR CODING 52 Coding the Behavior of Interviewers and Respondents toEvaluate Survey Questions 7Floyd J. Fowler, Jr.3 Response 1 to Fowler's Chapter: Coding the Behaviorof Interviewers and Respondents to Evaluate Survey Questions23Nora Cate Schaeffer and Jennifer Dykema4 Response 2 to Fowler's Chapter: Coding the Behaviorof Interviewers and Respondents to Evaluate Survey Questions41Alisú Schoua-GlusbergII COGNITIVE INTERVIEWING 495 Cognitive Interviewing 51Kristen Miller6 Response 1 to Miller's Chapter: CognitiveInterviewing 77Gordon Willis7 Response 2 to Miller's Chapter: CognitiveInterviewing 93Frederick G. ConradIII ITEM RESPONSE THEORY 1038 Applying Item Response Theory for Questionnaire Evaluation105Bryce B. Reeve9 Response 1 to Reeve's Chapter: Applying Item ResponseTheory for Questionnaire Evaluation 125Ron D. Hays10 Response 2 to Reeve's Chapter: Applying ItemResponse Theory for Questionnaire Evaluation 137Clyde Tucker, Brian Meekins, Jennifer Edgar, and Paul P.BiemerIV LATENT CLASS ANALYSIS 15111 Some Issues in the Application of Latent Class Models forQuestionnaire Design 153Paul P. Biemer and Marcus Berzofsky12 Response 1 to Biemer and Berzofsky's Chapter: SomeIssues in the Application of Latent Class Models for QuestionnaireDesign 187Frauke Kreuter13 Response 2 to Biemer and Berzofsky's Chapter: SomeIssues in the Application of Latent Class Models for QuestionnaireDesign 199Janet A. Harkness and Timothy P. JohnsonV SPLIT-SAMPLE EXPERIMENTS 21314 Experiments for Evaluating Survey Questions 215Jon A. Krosnick15 Response 1 to Krosnick's Chapter: Experiments forEvaluating Survey Questions 239Johnny Blair16 Response 2 to Krosnick's Chapter: Experiments forEvaluating Survey Questions 253Theresa DeMaio and Stephanie WillsonVI MULTITRAIT-MULTIMETHOD EXPERIMENTS 26317 Evaluating the Reliability and Validity of SurveyInterview Data Using the MTMM Approach 265Duane F. Alwin18 Response to Alwin's Chapter: Evaluating theReliability and Validity of Survey Interview Data Using the MTMMApproach 295Peter Ph. MohlerVII FIELD-BASED DATA METHODS 31919 Using Field Tests to Evaluate Federal Statistical SurveyQuestionnaires 321Brian A. Harris-Kojetin and James M. DahlhamerIndex 345