Open research questions in Survey Methodology and Nonresponse

What the literature leaves open

• the systems. With Future research in data collection is expected to focus on improving accuracy, efficiency, and security of data gathering rapid advancement of artificial intelligence and machine learning, more intelligent and automated data collection frameworks can be developed to reduce human effort and errors. Another key area of future work includes enhancing real-time data collection systems using IoT devices and cloud computing, which will allow continuous monitoring and instant decision-making in fields such as healthcare, smart cities, and industry. Researchers will also need to address challenges related to data privacy, ethical usage, and cybersecurity by transparent data developing more secure and handling mechanisms. hybrid traditional and digital approaches combining methods can be explored to improve data reliability and completeness. Overall, future developments aim to make data collection more adaptive, scalable, and intelligent to meet the growing demands of datadriven applications.

  Data Collection :A Systematic Review · 2026 · DOI

• Purpose The purpose of this study was to assess the accuracy and representativeness of common census-sampled campus climate surveys given the potential for misestimating sexual violence (SV) rates on campuses due to low response rates and self-selection bias in research (mixed findings in previous research).

  Sexual Violence Among Postsecondary Students: No Evidence that a Low Response Rate Biases Victimization or Perpetration Rates in a Well-Designed Climate Survey · 2022 · DOI

• Drawing on interviews conducted in preparation for the 2017 Census of Agriculture, this study identifies the disproportionate rates by which male and female agricultural operators are underreported on the form, and the cultural underpinnings of these patterns of reporting.

  Using Cognitive Interview Data to Assess Data Quality and the Cultural Norms of Survey Participants · 2019 · DOI

• We find that effects very much depend on how CAPI is implemented, including the hardware and software adopted, the extent and nature of dependent data, and even interviewer workloads—a finding that helps explain the conflicting results from previous studies.

  Design Matters · 2015 · DOI

• There is, however, mixed evidence on the impact of CAPI on interview length, an important survey outcome in the context of length limits imposed by survey budgets and concerns over respondent burden.

  Design Matters · 2015 · DOI

• This paper attempts to help fill this gap in knowledge by presenting multilevel models of the accuracy of a housing-unit observation recorded by interviewers in the National Survey of Family Growth (NSFG): whether or not young children under the age of 15 are present in the household.

  Factors Affecting the Accuracy of Interviewer Observations: Evidence from the National Survey of Family Growth · 2013 · DOI

• Despite organizations’ widespread Internet use and ready availability of Web survey software, few studies have examined explicitly the impact on employees’ responses of using the Web as opposed to mail-based surveys (MBS).

  Web versus Mail · 2011 · DOI

• This study takes a first step in filling this gap in the literature on interviewer effects by analyzing a unique survey data set, collected using computer-assisted telephone interviewing (CATI) from a sample of divorce records.

  How Much of Interviewer Variance is Really Nonresponse Error Variance? · 2010 · DOI

• Self-registration methods have proven to be popular because of their low cost and relative ease of administration, but little is known about the extent to which the data collected from self-registration boxes are representative of the population of visitors, and the degree that bias exists as a result of non-compliance.

  Non-Compliance with On-Site Data Collection in Outdoor Recreation Monitoring · 2009 · DOI

• This research note focuses on an issue that has not yet been studied: Are respondents who complete self-administered Web surveys more quickly-perhaps taking advantage of participation benefits while minimizing effort-also more prone to response order effects, a manifestation of "satisficing"? I surveyed a random sample of the US adult population over the Web and manipulated the order in which respondents saw the response options.

  Completion Time and Response Order Effects in Web Surveys · 2008 · DOI

• Although surveys are often used to assess and track employee attitudes and opinions over time and are used quite frequently by applied communication researchers, the use of surveys as a channel to voice employee attitudes and opinions has not been fully explored in the employee voice or basic organizational communication literature.

  Organizational Surveys: A System for Employee Voice · 2006 · DOI

• The 40% response rate was higher than for postal questionnaires and the space flexibility of the e‐survey yielded a considerable amount of data to the open questions which is normally limited by design constraints in conventional surveys.

  The online or e‐survey: a research approach for the ICT age · 2005 · DOI

• 325)? The authors of survey questions have long struggled to write clear survey questions—ones that are easy to understand and are understood by all respondents in the same way—and it remains to be seen whether the addition of images and other visual enhancements to survey questions will help achieve that goal or make it harder than ever to reach.

  Picture This!: Exploring Visual Effects in Web Surveys · 2004 · DOI

• Although time use has received much attention by social scientists as an index of resource allocation and social relations across groups, only a few studies have carefully assessed the relative strengths and weaknesses of the existing methods of measuring time use: time diary (TD), stylized (S) respondent report, and experiential sampling method (ESM).

  2. An Assessment of Alternative Measures of Time Use · 2003 · DOI

• This experimental study asked: What are the effects of using contemporary technology within a total design methodology on response rates, timeliness of responses and cost effectiveness? While this study was small, findings create strong support for further investigation into the use of new information technologies to yield high response rates in mailed surveys.

  Enhancing Dillman's total design method for mailed/ telephone surveys using current technology to maximise cost-benefit ratios · 1997 · DOI

• Two reasons seem to underlie this skepticism about public opinion data: (1) evidence of the typical citizen's limited knowledge of public affairs (Stipak, 1979a, 1979b; Erikson, Luttbeg, and Tedin, 1980) and (2) problems of the methods used in conducting surveys (Stipak, 1979b; Wilson, 1983).

  Measuring Citizen Evaluations: The Question of Question Order Effects · 1993

• "Free" recall proved marginally superior to forward or backward ordering, although overall respondents underreported the number of visits by 20 percent; participants' gender and self-reported health status, among other factors, also affected quality of recall.

  Recall Strategies and Memory for Health-Care Visits · 1990 · DOI

• While this may appear to be a plausible explanation, the pattern is insufficiently persistent to substantiate it with any conviction. The conclusion for research is that further investigation of the correlates of consistency and inconsistency of response between the two methods would provide a worthwhile programme for future investigations.

  A Methodological Study of the Interview and Questionnaire Approaches to Information-Gathering · 1973 · DOI

• and constructive suggestions regarding the , high-school program we received from the graduates of the 17 secondary schools 1,781 responses. Similarity of content per mitted groupings under various headings. In many instances the comment of the pupil has been translated rather freely in order to procure uniformity in setting up categories. No liberties were taken with the intent of the pupil as we understood it, and we held scrupulously to the line in interpretation. Many of the comments were such that they could not be grouped in any single category, and because of their diversity and infrequency of men tion, were not included in the report. Thus more than one-half of the 1,781 comments were eliminated. While we could not possibly enumerate, because of space limitation, all of these remaining items, we are listing those which were repeated most often: 1. There should be offered an exten- sive office machine practice course.. 137 2. More attention should be given to the social life in school and the de velopment of personality........ 3. There should be more strictness in subject selection and better teaching (including the insistence upon bet- ter study habits) . . . . . . . . . . . . . . . . 4. There should be offered a more ex tended and more practical business course. ... . . . ... ... .... .. ..... 5. More attention should be given to personal, vocational, and educational problems 6. Everyone should be allowed to take typewriting . . . . . . . . . . . . . . . . . . .. 76 75 61 44 40 Other comments included: "The curricu lum should be more progressive"; "There should be offered more practical courses for boys and girls"; "More attention should be given to the teaching of cur rent problems and citizenship," etc.

  Pittsburgh Surveys Its Own · 1939 · DOI

• This approach has the advantage of utilizing information about survey experiences over multiple survey waves, while accommodating the unbalanced data structure typical of OPPs, where the number, timing, and content of survey invitations varies widely between panel members.

  Survey Experience and Nonresponse in an Online Probability Panel: A Survival Analysis · 2026 · DOI

• Despite this, respondent burden remains an understudied topic in the field of survey methodology, with few researchers systematically measuring objective and subjective burden factors in surveys used to produce official statistics.

  Modeling the Relationship between Proxy Measures of Respondent Burden and Survey Response Rates in a Household Panel Survey · 2022 · DOI

• Using voter rolls for sampling can save most of the cost of constructing a sampling frame relative to a household listing, but there is limited evidence about their accuracy and completeness.

  Are Voter Rolls Suitable Sampling Frames for Household Surveys? Evidence from India · 2022 · DOI

• Although the issue of unit nonresponse in web and other survey modes has been investigated in several meta-analyses, item nonresponse has not been examined meta-analytically, a gap addressed by this paper.

  Item Nonresponse in Web Versus Other Survey Modes: A Systematic Review and Meta-Analysis · 2022 · DOI

• Contributions: Prior research has not investigated the digital divide from a wide array of public datasets, nor done enough to consider the bias inherent in internet users-only samples.

  A Deeper Dive into the Digital Divide: Reducing Coverage Bias in Internet Surveys · 2022 · DOI

• Abstract Evidence from the household survey literature shows a declining response rate trend in recent decades, but whether a similar trend exists for voluntary establishment surveys is an understudied issue.

  Trends in Establishment Survey Nonresponse Rates and Nonresponse Bias: Evidence from the 2001-2017 IAB Establishment Panel · 2021 · DOI

Most-cited papers in Survey Methodology and Nonresponse

• Assessing dissimilarity relations under missing data conditions: Evidence from computer simulations. · Journal of Applied Psychology · 2007 · 2,134 citations
• Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity · Public Opinion Quarterly · 2008 · 917 citations
• 1. Ecometrics: Toward a Science of Assessing Ecological Settings, with Application to the Systematic Social Observation of Neighborhoods · Sociological Methodology · 1999 · 751 citations
• The Demographic and Political Composition of Mechanical Turk Samples · SAGE Open · 2016 · 542 citations
• Web-based Questionnaires: The Future in Epidemiology? · American Journal of Epidemiology · 2010 · 478 citations
• Computing Response Metrics for Online Panels · Public Opinion Quarterly · 2008 · 421 citations
• Mail Surveys and Response Rates: A Literature Review · Journal of Marketing Research · 1975 · 407 citations
• Dealing with Careless Responding in Survey Data: Prevention, Identification, and Recommended Best Practices · Annual Review of Psychology · 2022 · 391 citations
• The Effects of Sampling Frequency and Questionnaire Length on Perceived Burden, Compliance, and Careless Responding in Experience Sampling Data in a Student Population · Assessment · 2020 · 342 citations
• Strategies to improve response rates to web surveys: A literature review · International Journal of Nursing Studies · 2021 · 297 citations

Most recent work

• Rise of the Machine: Detecting Aberrant Response Patterns in Survey Instruments Using Autoencoder · Applied Psychological Measurement · 2026
• Data Collection :A Systematic Review · International Journal of Creative and Open Research in Engineering and Management · 2026
• Calibrating Nonresponse Bias: A Cautionary Tale · Journal of Official Statistics · 2026
• Data Quality in Online Crowdsourced Surveys: Methodological Challenges and Analytic Insights in Survey Research · Survey Practice · 2026
• The impact of bots and fraudulent responses on online survey data: the development of a 12-point data cleaning protocol used in a study of marginalized communities · International Journal of Social Research Methodology · 2026
• Detecting and responding to fake responses to an online infant care survey in the UK · NIHR Open Research · 2026
• Biased Survey Example · Figshare · 2026
• Response Rates in Survey Research · Figshare · 2026
• Detecting Response Time Outlier Detection Methods in Probability and Nonprobability Panels · International Journal of Market Research · 2026
• Ethics as methodological innovation: participatory research adaptations in panel survey research with Syrian refugees · Frontiers in Political Science · 2026

Related topics in Social Sciences