Source: DECISION SCIENCE RESEARCH INSTITUTE, INC. submitted to
PEST POPULATION SUPPRESSION, REPLACEMENT AND RESISTANCE, GENE DRIVES, AND POLICY PREFERENCES
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
COMPLETE
Funding Source
Reporting Frequency
Annual
Accession No.
1027997
Grant No.
2022-67023-37415
Cumulative Award Amt.
$614,642.00
Proposal No.
2021-10788
Multistate No.
(N/A)
Project Start Date
May 15, 2022
Project End Date
Sep 12, 2024
Grant Year
2022
Program Code
[A1642]- AFRI Foundational - Social Implications of Emerging Technologies
Project Director
Johnson, B.
Recipient Organization
DECISION SCIENCE RESEARCH INSTITUTE, INC.
2160 ROLAND WAY
EUGENE,OR 974012036
Performing Department
(N/A)
Non Technical Summary
We are at an important crossroads as new methods, such as gene drives, are making their way out of the lab and into the "field." What shapes public trust and stakeholder attitudes towards acceptance or rejection of agricultural gene drives is vital to grasp to develop responsible governance, effective communications and public engagement. Yet our understanding of stakeholders' policy preferences, acceptance of gene drives, and trust in regulatory agencies to manage risks towards agricultural gene drive applications is limited. Understanding what policies and factors would build trust in risk assessments, and the subsequent policies/authority of agencies to assess and manage those impacts, is crucial. Using a multifaceted approach of a multi-disciplinary external advisory group, stakeholder workshops, public and farmer surveys, and Q method, this study: (1) emphasizes understanding of policy preferences across a wide range of policy domains, rather than a narrow range of policies (e.g., ban versus allow) or benefit/risk perceptions, and (2) includes a wide range of stakeholders (including both conventional and organic farmers) to ensure diverse perspectives and open deliberation, while not assuming that, e.g., "conventional farmers" will all exhibit the same viewpoint on gene drive policies, and (3) uses surveys of both citizens and diverse farmer types to both understand factors in gene drive policy preferences, and in trust in USDA and USEPA policy formulation and implementation. The study will provide recommendations for development of policies designed to address public and stakeholder concerns and hopes regarding impacts of agricultural gene drive applications.
Animal Health Component
(N/A)
Research Effort Categories
Basic
100%
Applied
(N/A)
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
80374103030100%
Goals / Objectives
Our major goal is to clarify the factors that shape public and stakeholder (particularly farmer) attitudes toward gene drives for suppression, replacement, and/or resistance of agricultural pest populations, and their preferences for policies regarding assessing and managing gene drive impacts. Our project objectives are:? Objective 1: Engage varied stakeholders in deliberative workshops on policies for assessing and managing gene drive benefits and risks, to inform later research? Objective 2: Conduct Q interviews and survey the general public and conventional and organic farmers about gene drive and conventional alternatives for pest control, along with appropriate policies? Objective 3: Probe factors in trust of gene drive applications, policies and managers to help inform regulatory agencies on how best to track and understand trust for gene drives specifically and for trust in agricultural system actors generally.
Project Methods
1) Stakeholder involvement will include recruiting a diverse advisory committee who will be consulted and informed about study aims and results at three points over the project timeline to maximize the project's research and applied value, two workshops with diverse stakeholder representatives, and feedback (if they wish) of project results to Q interview and survey respondents (see below). Such involvement has become increasingly common in research projects. Evaluation will occur through direct (informal or short survey) feedback from committee and workshop participants, and on whether and how that feedback alters project objectives, research questions, educational materials, analyses, and report content.2) Development of educational materials about gene drives and associated issues will involve (a) background research involving review of published and gray literature, interviewing experts, and assessing historical analogues; (b) cognitive interviewing with farmers and near-farm residents (n ~ 40); and (c) survey experiment tests of draft educational materials with farmers and residents (n = 200). These are standard social science approaches that are not always combined in the same project. Evaluation will come from the research team, the external advisory committee, key informants in the development process (e.g., cognitive interviewees), workshop participants, Q interviewees and survey respondents, and farmer and public surveys, in a mix of informal responses, qualitative answers to evaluation questions in interviews and surveys, and indirect survey measures (e.g., attention checks).3) Q method interviews (n ~ 40) to elicit from farmers, citizens and other groups sorts of diverse statements about gene drives and potential policies for gene-drive assessment and management--as well as about pest control options other than gene drives--that when analyzed will identify a few unique perspectives on these topics (and any consensus on certain views). This will be supplemented by a wider set of online Q interviews to partly validate these results and explore effects of alternative sorting instructions. Measures reflecting the Identified perspectives will appear in the later surveys. Q method has been widely used as a semi-qualitative research perspective, particularly when the topic is novel, but the mix of in-person, online, and survey approaches here is unusual (the PD has used an in-person + survey approach before). Evaluation will come from informal responses by interviewees, convergence in perspectives identified by the three data-collection approaches, and convergence with other data (e.g., workshop discussions; survey results on non-Q-based questions).4) National surveys of citizens (n ~1200) and farmers (n ~ 900) will be conducted online, with recruitment respectively from online panel YouGov and with demographic weighting to get nationally representative results, and from emails of farmers nationwide purchased from FarmMarketID. Mailed surveys will be used to supplement online farmer responses where needed, using a standard multi-wave approach and a $10 gift card incentive to maximize farmer response rate. Because the FarmMarketID list includes conventional and part-organic farmers, in-person interviews with North Carolina organic farmers, and recruitment of organic farmers at least two national meetings of such farmers, will help fill in gaps in our grasp of this constituency's views on gene drives. Evaluation will come from the response rates, which are expected to be low (less than or equal to 20%) but the higher they are the better we have engaged people's attention on an abstruse topic), and non-response bias (how many questions people answer; whether they give the same answer to different questions; etc.).As a basic research project--gene drives for agricultural pests are entirely hypothetical at this point--the main deliverable for this project is the overall report summing up what we have learned about how diverse audiences--but particularly farmers and general citizens--think about this prospect and how it ought to be managed. Thus there are no intermediate evaluation milestones to meet except in terms of completing each sequential task (e.g., setting up and meeting with advisory committee; designing and evaluating educational materials; conducting workshops, interviews and surveys) needed to meet that ultimate goal.

Progress 05/15/22 to 09/12/24

Outputs
Target Audience:Policymakers, stakeholders, and scholars concerned with acceptance and regulation of novel agricultural technologies, including those addressing pest control issues. Changes/Problems:No changes or problems since the last annual reporting period, just awaiting a decision on the request for transferring the grant. What opportunities for training and professional development has the project provided?A graduate student received further interview training and practice through the project, while a post-doctoral fellow worked on qualitative data analysis and writing up of a report on expert interviews. How have the results been disseminated to communities of interest?No dissemination yet, but a conference presentation is planned, and an initial article from expert interviews is in the works. What do you plan to do during the next reporting period to accomplish the goals?The timing of the next reporting period is uncertain, given that work will not resume until the grant transfer request is approved by NIFA, with an indeterminate date. But with that proviso, we expect to proceed with Q interviews and a workshop with experts on gene drive policy, and surveys with consumers and farmers.

Impacts
What was accomplished under these goals? The last annual report covered the period ending May 14, 2024. This final report covers the period from May 15-May 31, 2024, at which point all activity was suspended in preparation for requesting transfer of the grant from Decision Science Research Institute to Oregon Research Institute. As a result, most accomplishments are listed in the last annual report. During the last half of May, the PI and co-PI attended the mandatory annual conference for awardees to present their results to date, and documentation of prior interview activities was wrapped up.

Publications


    Progress 05/15/23 to 05/14/24

    Outputs
    Target Audience: Nothing Reported Changes/Problems: Recruitment of farmers/producers for interviews has been particularly challenging. We will continue to explore alternative methods, as well as timing, of recruitment to increase our ability to recruit both interviewees and (later) survey respondents. Given this problem, we now expect that we will not invite farmers and citizens to our proposed second "convergence" workshop discussing implications of our findings, as recruitment will be too difficult, and instead focus on including experts and regulatory decision-makers in that workshop. Current interviewing with producers and consumers will end shortly as the graduate student doing this work will move on to his Ph.D. thesis. As noted in the first annual report, co-PI Dr. Barnhill's lack of a faculty appointment limits her ability (relative to regular faculty) to recruit candidates to advise as her full-time student as was described in the original proposal. This was the reason for recruiting and hiring a postdoc and a temporary graduate student instead. Dr. Barnhill will attempt to recruit an additional temporary graduate student to continue to support the project. We will review the interview data carefully to determine the need for further interviews, and thus for such recruiting. Decision Research is being absorbed by the Oregon Research Institute, though the precise timing of this transition is uncertain. What opportunities for training and professional development has the project provided?Further training for a graduate student in interview methods, and ongoing professional training for a post-doctoral fellow in qualitative data analysis and professional publication development. How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals? Expert interview results will be used to draft the first of several expected publications about policy issues related to gene drives. Dr. Barry will present the paper about the seven identified uncertainties emerging from the expert interviews at the Society for Risk Analysis annual meeting in December 2024. Dr. Barnhill and Dr. Barry, with assistance from Dr. Johnson, will learn about the details of Q method, and all three will familiarize themselves with the various software tools available for conducting Q interviews online, as doing this virtually (as opposed to the traditional in-person, paper-based sorting) will be more efficient. Dr. Barnhill, with assistance from Dr. Johnson, will peruse lay and expert interviews done under this project, plus qualitative material from previous studies on attitudes toward gene drives (e.g., by Texas A&M, and North Carolina State University), to construct a set of subjective statements about gene drive issues that represents the universe of attitudes towards them. The final set of Q statements will be applied in think-aloud sorting interviews with experts, consumers and farmers, which will then be analyzed to identify unique perspectives on gene drives, as well as those attitudes (if any) that may be consensual. We will use the same set of Q statements for each group, without assuming that a given perspective will be unique to one such group (e.g., that all farmers will favor one perspective, and reject all others). However, as we analyze the policy positions of experts (#1), we may decide to add a separate Q sort for experts only on nuanced policy positions that may be too dependent on expert knowledge to warrant applying these statements with farmers and consumers. Dr. Johnson will use the lay interview results, in association with our two volunteer economists (Profs. Martinez Cruz and Guignet), to finalize the discrete choice experiment (DCE) design for quantitative pilot testing in a mini-survey of consumers and farmers, to refine the experimental design before we place it in the main surveys. The DCE aims to have people choose between pairs of combinations of diverse pest control options, to identify their preferences and estimate willingness to pay for them. Dr. Johnson will continue to revise the draft main surveys, in light of the lay and expert interviews, that will be used with national samples of consumers and farmers.

    Impacts
    What was accomplished under these goals? 1. Drafted educational materials about gene drives and five other agricultural pest control options (pesticides, physical interventions, biological controls, genetically modified crops, crop rotation) for testing incognitive interviews with farmers, and in revised form in an ongoing set of interviews (15completed by the end of the reporting period) with consumers and farmers. 2. Interviewed 24 experts from academic, research and regulatory organizations about policy issues concerning agricultural pest gene drives. Experts came from diverse fields: gene drive development, biotechnology policy, ecology and pest management, economics, entomology, natural resource policy, environmental law and policy, non-economic social science, gene drive communication, environmental ethics, and science policy and society, as well as people who would be involved in regulatory decisionmaking. These interviews have revealed seven kinds of uncertainties of concern to experts: technical (e.g., the difficulty of building gene drives), risk (e.g., ecological impacts), decision-making (e.g., authority, coordination, jurisdiction, and independence across different levels of governance), legislative (e.g., international law and sovereignty), regulatory (e.g., role of Coordinated Framework updates), social and ethical (e.g., managing preferences at different geographical scales), and stakeholder (e.g., discomfort with or willingness of private firms versus government to be responsible--including financially--and accountable). 3. The initial draft of the survey has been regularly revised to reflect what we have been learning, and to help structure our development of educational materials and interview protocols. 4. Our two volunteer economists have collaborated with us on preliminary development of a discrete choice experiment (DCE) to assess how people make tradeoffs between gene drives and other agricultural pest management options. The current sequence of producer/consumer interviews is testing the logistics of the DCE task, to help come up with a final version that will yield the desired tradeoff information without over-burdening later survey respondents. 5. The ongoing interviews with consumers and producers address other issues besides testing educational and DCE materials: e.g., considerations that arise for these groups when thinking about these six agricultural pest options (which overlap to a considerable degree with some of the uncertainties raised by experts), whether there are some pest control options that are so routine in farmers' view that they don't really affect their decisions about which suite of pest control options to prefer (versus the more controversial options of pesticides, genetically modified crops, and--perhaps--gene drives), for which species gene drives would be most acceptable (e.g., farmers are more broadly accepting than consumers; bacteria, viruses and fungi are most accepted, mammals and birds are least accepted, and insects receive a mixed response), and attitudes toward regulators (e.g., trust; whether they would pay attention to the concerns raised by the respondent).

    Publications


      Progress 05/15/22 to 05/14/23

      Outputs
      Target Audience: Nothing Reported Changes/Problems:There are several changes in approach to report. Our proposal had envisioned building upon prior research on public attitudes towards gene drives (GDs) to expand into more detail on views about public policies regarding GDs and on trust, and to incorporate a national survey of farmers' views. We still intend to do those tasks, but realized that this was too narrow (e.g., prior studies had done a lot on public views, particularly considering that GDs are still quite hypothetical; public policy changes are likely to be limited under the current regulatory regime). Most important, GDs are unlikely to be used as the sole method of pest population suppression (i.e., it will be used in combination with such other methods as chemical pesticide spraying and biological controls). So while we will ask respondents to evaluate GDs on several dimensions, we will be particularly interested in their responses to different suites of pest control methods, including ones that include or exclude GDs. Much of our effort in this first year has been scoping out how best to pursue that aim, including which pest control options and combinations of options we should ask people to evaluate, and on which dimensions. In that process, we decided that we needed to account for tradeoffs, which prior GD studies have tended to assess either just qualitatively (e.g., in tracking focus group or public meeting comments), or indirectly (e.g., separately rating the importance of various outcomes for being evaluated in risk assessments, so one can compare the average score, but not directly indicating the value of one outcome versus another). We are considering several options, but in our discussions eventually concluded that inclusion of a discrete choice experiment, which economists use to help elicit relative valuations of different options, might be useful. Our discussions with three economists, who are participating on a volunteer basis, indicate that this is feasible, and we are currently planning to incorporate some such material into our surveys of the general public and farmers, with pretests occurring as part of our already-planned cognitive interviewing, first workshop, and farmer interviews. After we began this conversation, one of those economists noted that he had just published a discrete choice experiment based on one of the earlier GD surveys with the general public, so we have an example to inform us on how to move beyond that to advance our understanding of GD attitudes. What opportunities for training and professional development has the project provided? Nothing Reported How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?1. Expert interviews on policy issues related to gene drives begun during summer 2023 will be continued as prelude to an expected expert workshop in early 2024. The interviews and workshop will identify the policy issues--what are they, and how should they be solved--on which our experts agree and disagree. Results may influence which policy issues are included in the consumer and farmer surveys. 2. A post-doctoral researcher, Dr. Barry, with experience on anti-malaria gene drives in Africa, will join the project starting in November-December 2023, to initially work on interviewing with experts, consumers and farmers, analyzing results, and publishing them, as well as helping organize the 2024 expert workshop. A graduate student also will be available to assist on these tasks. Both will receive training on interviewing and Q analysis as part of the training opportunities we will offer during this period. 3. The informal association with two economists mentioned above will inform pilot testing of a discrete choice experiment (DCE) in cognitive and other interviews, and in the mini-survey of consumers and farmers, to refine the experimental design before we place it in the main surveys. The DCE aims to have people choose between multiple pairs of combinations of diverse pest control options, to identify their preferences and estimate willingness to pay for them. As gene drives are likely to be used in combination with various other pest control options (pesticides, crop rotation, crops genetically engineered for resistance, beneficial pest predators, physical interventions), this research will allow us to assess more realistic scenarios for response to gene drive options. 4. The draft main surveys have been refined several times already, but we will continue to revise them as needed to account for the information that will be coming in from interviews with experts, consumers and farmers, Q analyses, and pilot tests of the DCE.

      Impacts
      What was accomplished under these goals? 1) We have drafted educational materials about gene drives and associated issues in agricultural pest management that we will test in cognitive interviews, and use in subsequent qualitative and quantitative data collection, and have shared these drafts with Dr. Chris Cummings as proposed for planning cognitive interviews 2) We have identified a group of potential advisors for this project, and have begun contacting them individually for their willingness to serve and for their input into the content and phrasing of educational and other materials 3) We have drafted an initial version of the survey to be used nationally with citizen and farmer samples, to help structure our development of educational and related materials 4) We have drafted an initial list of policy issues to be the focus of gene drive policy discussions and subsequently of a section of the national survey instrument 5) We have recruited two economists to collaborate with us pro bono on the design of a choice experiment to further advance understanding of how people make tradeoffs between gene drives and other agricultural pest management options in the presence of the uncertainties involved 6) We have identified a post-doctoral student with a background in anthropology and in field work in Africa on using gene drives as part of Project Malaria who has extensive experience in qualitative research that will greatly benefit our qualitative work, who will be joining NCSU, our partner on this project, in August/September 2023, and is excited about joining our project 7) We have begun recruiting a group of scientists, activists, and policy-makers for a virtual discussion of policy options identified in #4, so as to generate further options and scenarios that will inform our qualitative and quantitative discussions with citizens and farmers

      Publications