Source: UNIVERSITY OF MISSOURI submitted to NRP
EXAMINING ACCESSIBILITY AND INCLUSIVITY OF A PILOT APP TO SUPPORT PARTICIPATION OF CLIMATE-SMART AGRICULTURE INCENTIVE PROGRAMS
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1030747
Grant No.
2023-67023-40217
Cumulative Award Amt.
$642,623.00
Proposal No.
2022-11532
Multistate No.
(N/A)
Project Start Date
Sep 1, 2023
Project End Date
Aug 31, 2027
Grant Year
2023
Program Code
[A1642]- AFRI Foundational - Social Implications of Emerging Technologies
Recipient Organization
UNIVERSITY OF MISSOURI
(N/A)
COLUMBIA,MO 65211
Performing Department
(N/A)
Non Technical Summary
With increased calls for farmers to adopt climate-smart agriculture, agriculture systems and technology must be enabling and help reduce barriers to adoption. A range of cost-share and incentive payment programs exist to support farmers transition to climate-smart systems, but usage remains low and farmers report confusion over how to apply and an overly cumbersome process. In 2023, the University of Missouri will implement a $25million, 5-year Missouri-wide Missouri CRCL project: half of these funds will go towards incentive payments to support specific climate-smart practices. The project is developing a software application to facilitate participation among a diverse range of Missouri producers. To enhance the useability, access, and inclusivity, this proposed AFRI research project will complement the development of this digital technology (priority area 5: agriculture systems and technology). Guided by a Responsible Innovation framework, we will work closely with the app developers, project partners, and farmers (intended end users) to conduct participatory research that will directly inform the development, dissemination, and refinement of the app (Obj. 1). We will further evaluate the socio-economic, ethical, and environmental impacts of this app for different producers in Missouri (Obj. 2). Finally, findings will be put in a broader context to identify and share recommendations for digital innovators to increase access to and inclusivity of incentive programs in climate-smart agriculture (Obj. 3). We will meet these objectives through three phases of mixed methods data collection and feedback with farmers and farm partners, app developers, and Missouri CRCLE project partners.
Animal Health Component
100%
Research Effort Categories
Basic
0%
Applied
100%
Developmental
0%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
8037410303050%
6016010308050%
Goals / Objectives
The overarching goal of this project is to enhance the usability, access, and inclusivity of a sign-up application for farmers to apply for a new incentive payment program to support adoption of climate-smart farming practices. This app is being developed through the Missouri Climate-Resilient Crops and Livestock (CRCL) Project, funded by a USDA-NRCS $25million Partnerships for Climate-smart Commodities award. The app is being developed under contract by FarmRaise, a digital agricultural technology developer. The app will support distribution of $17.5 million to Missouri farmers to incentive adoption of target climate-smart practices. At least 50% of the 2,958 farmers expected to participate in this project will be small and underserved produced. In addition to supporting farmers enrollment in this program, the app will facilitate applications for Farm Service Agency (FSA) numbers, setting them up to participate in other resource opportunities.In this NIFA-AFRI project, we will work with partners of the Missouri CRCL Project, and specifically with the app developers, FarmRaise, and with target stakeholders (farmers across Missouri) using a Responsible Innovation Framework to co-develop this product. The objectives of this project are:Conduct participatory research to directly inform the development, dissemination, and refinement of an incentive payment sign up and reporting app.Evaluate the socio-cultural, economic, and ethical impacts of this app for different producers in Missouri.Identify and share applicable learnings for promoters and developers of digital technologies looking to increase access to and inclusivity of incentive programs in climate-smart agriculture.
Project Methods
To improve resonance of the incentive program app, we will use participatory research methods to collect mixed methods data with farmers and farm partners across Missouri. We will also systematically observe processes of app developers and others contributing to the development and implementation of this digital technology. Activities will be an iterative process that occurs over three phases and four years (see Figure 1).Phase 1Task 1.1 Literature review on potential impactsLiterature review on academic and gray literature to create a map of potential socio-cultural, economic, and ethical impacts applicable to this app.Task 1.2 Train FarmRaise (app developer) to follow Responsible Innovation framework in app development processesProvide training and ongoing consultation to FarmRaise to integrate the four components of a Responsible Innovation framework--anticipation, reflexivity, inclusion, and responsiveness--into the app development processes. An initial training will be held in the beginning of the project to set the groundwork where we will collaboratively establish observational protocols for both groups to maintain written traceability of processes.Observational protocol tools will be used throughout the project to reflect on collaboration and app development. In Year 4, we will revise the tools and publish for public use.Task 1.3 Farmer focus groupsWe will conduct focus groups with farmers representing the various production systems, scales, and farmer demographics in Missouri recruited with support from project partners (Year 1). Farmer focus groups will be 1.5-2 hours and comprise 5-10 farmer participants each.In the first portion of the focus group, we will ask participants how they currently use different support resources, their perspective on using digital technologies to facilitate these processes, previous positive and negative experiences with apps, and their expectations with this app. This baseline data will enable us to assess what criteria the app should include to be useful for the intended end-user. Next, farmers will engage with an early pilot version of the app and initial reactions. Finally, we will collaboratively develop an online tool that we will use over the proceeding years of this study to collect follow-up feedback as the app is further honed.Task 1.4 Interviews with state agencies, commodity organizations, and other farmer support groupsTo broaden our understanding of the opportunities for this app, we will conduct up to 10 semi-structured interviews with farm partners, including state and federal agencies, farm commodity boards, and agribusiness partners that support small and underserved farmers in Missouri (Year 1).Interviews will be one-on-one and last approximately one hour. Interviews will focus on current barriers to accessing incentive payment programs and what challenges they, as farm partners, have in supporting farmers to use these resources.Task 1.5 Analyze and share phase 1 findings and engage app developers and Missouri CRCL partners in findingsAnalyze Phase 1 data from farmer focus groups and farm partner interviews in NVivo 12 using inductive analysis, which allows themes to emerge based on the participants' own words. We will summarize findings to provide briefings to the app developers and to Missouri CRCL partners.We will take written notes on these interactions and the outcomes of them to include in later data analysis as memos.Phase 2Task 2.1 Observations on app development processesUsing the protocols collaboratively decided on in task 1.1 with FarmRaise, we will compile observations on app development processes after the first round of feedback is given to assess how it is incorporated in modifications to the app. These observations will be converted into memos to add to qualitative data collection.Task 2.2 farmer app engagement online surveysIn years 2 and 3, we will use the online tool (Qualtrics) to collect survey data on farmers' experiences using the app. We will recruit participants of the Missouri CRCL program (at least 50% small and underserved farmers). Target of 300 responses in year 2 and again in year 3.These surveys will look at ii) farmers' experiences after using the app, ii) farmers' opinions on how to improve the app and iii) farmers' opinions on app impacts.Task 2.3 Farmer interviewsWe will follow the path of five farmers to understand the specific impacts they identify along the process of using the app. We will conduct 10 semi-structured interviews, 2 with each farmer (one in year 1 and one in year 3).We will select farmers for these mini-case studies considering the intersection of factors including demographics, land size and engagement with the app.Task 2.4 Analysis of data on app usersTo better understand how farmers use the app in their different versions, we will analyze the information captured in the app (e.g frequencies of use, time of use, sections most visited). Access to these reports will be provided by FarmRaise (app developers) as deidentified analytics reports. This will help ground our findings and allow us to see the relationship between the participatory process and app engagement.Task 2.5 Analyze and share phase 2 findings and engage FarmRaise and Missouri CRCL partners in findingsWe will integrate data collected during phase 2, independently analyze each data type. Online data will be analyzed using descriptive statistics for Phase 2 briefings with partners (further analyze described in Objective 2).We will engage FarmRaise and Missouri CRCL partners with our findings through meetings with each partner. Written meeting notes will be taken and included as memos in data collection.Phase 3Task 3.1 Integrate and analyze data and co-interpret through farmer focus groupsAt the end of year 3, we will integrate findings from each type of data to generate a comprehensive set of findings from three years of rolling out this digital technology. Based on findings, we will outline the processes/outcomes of stakeholder engagement, providing feedback, and modifications to the app.We will share our integrated findings with farmer stakeholders through a second round of focus groups (Year 4). We will present findings back to farmers and ask for their feedback to help us improve our interpretation of the results. This is a crucial component of participatory research and makes findings more applicable and grounded in the context.Focus groups will be audio recorded and transcribed to add to the final analysis. We will communicate findings through manuscripts to peer-review journals, conference presentations, and through briefings to project partners.Task 3.2 Share findingsAfter we integrate the feedback from the finding's interpretation workshop with farmers, we will share findings from each phase of data collection with app developers and Missouri CRCL partners.We will communicate findings through manuscripts to peer-review journals, conference presentations, and through briefings to project partners.

Progress 09/01/23 to 08/31/24

Outputs
Target Audience:In our first year, our target audience included: App development company, FarmRaise (developers of the app). Participated in workshop on responsible innovation approach to developing technologies. Also, individual team members participated in multiple one-on-one interviews regarding the app development and collaboration process. Missouri Climate-Resilient Crop & Livestock (CRCL) Project team members (administrative users of the app who contributed to development). Participated in workshop on responsible innovation approach to developing technologies. Also, individual team members participated in multiple one-on-one interviews regarding the app development and collaboration process. Farmers using the app to enroll in and participate in the Missouri CRCL Project's incentive payment programs to adopt climate-smart practices (pilot tests and target user of the app). Conducted pilot tests with farmers to modify the app in year 1. Also conducted year 1 feedback survey to assess usability and the context of using the app to access cost-share funds. Changes/Problems:This project originally planned to conduct focus groups with farmers in the first year to inform the design of the virtual platform. However, due to the Missouri CRCL Project's early launch in Summer 2023, before this project began, the activity was rescheduled to after the first year of participation in the project. As a result, conversations with farmers will now start in the fall of 2024, focusing on understanding the factors that influence their interaction with the virtual platform, their readiness to implement it, and the factors affecting their willingness to engage with digital tools. Additionally, this year, individual interviews with farmers who participated during the first year are scheduled. These interviews will help inform and refine the development of surveys that will provide quantitative insights into farmer participation and their various perceptions. In addition, the scope of this digital platform changed dramatically from the time we submitted this proposal to the time when the Missouri CRCL Project launched due to major changes inferred from the Missouri CRCL Project's funded, USDA. After proposals were accepted, they introduced substantial added requirements for awardees, including collecting multiple different documents from government agencies and collecting a great deal of data from each producer participant. This impacted what the digital platform needed to provide to the team, enlarging the scope significantly. This added workload impacted the amount of time that project team members on all sides could contribute to the project. To account for this, we began conducting systematic observations of team meetings, conducting short one-on-one interviews with team members from different organizations along the way, and engaging in pilot tests as the app developed. What opportunities for training and professional development has the project provided? In this project's context, the team had the chance to deepen their understanding of the Responsible Innovation Framework. This included an internal workshop with the CRCL project team and FarmRaise partners to explore the four dimensions of the framework: inclusion, anticipation, reflexivity, and responsiveness. The PD, Kelly Wilson, also presented on preliminary findings from year 1 at the annual Rural Sociology Society meeting in Madison Wisconsin. We provided qualitative research training to our postdoctoral scholar to improve her ability to conduct interviews, analyze data, and interpret for different audiences. This included trainings on using Nvivo for qualitative data analysis and training on writing manuscripts for peer review. How have the results been disseminated to communities of interest?The results of this project are being directly shared with the team leading the Missouri CRCL Project, the technology development company (FarmRaise). These results are communicated directly through one-on-one conversations and plenary meetings. What do you plan to do during the next reporting period to accomplish the goals?For the next reporting period, we have outlined the following actions, categorized by audience. First, with other programs that use digital platforms to engage farmers within the framework of Partnerships for Climate-Smart Commodities, we will conduct interviews to understand their perceptions, experiences, and rationales in the design, implementation, and management of their digital platforms. To date, we have identified 10 managers from other programs, and these conversations are scheduled to take place during the fall of 2024. We plan to conduct up to 20 interviews with other projects using an online approach to facilitate access to cost-share funding. With the farmers who have completed Year 1, we have planned three data collection mechanisms. First, a survey to gather their general experience with the program, focusing on overall experience, the ease of using the app, and how simple or difficult it was to complete the various activities. We pilot tested this survey in May-July 2024 with participants of the Missouri CRCL Project's Year 1cover crops incentive payment program. We will hone and replicate this survey for other the other practice programs in addition to participants who enroll in the next several year of this project. Second, we will conduct qualitative interviews with a selected group of producers to understand their level of readiness to use the technologies. For this, we will use a readiness framework that focuses on capabilities, motivations, and opportunities. The goal is to have conversations with producers from different programs and with varying levels of prior knowledge and experience with incentive payments. Third, these interviews will inform the design of the survey aimed at understanding the readiness of all farmers who participated during Year 1. This will allow us to deepen our understanding of what enables producers to take full advantage of the technology, make any necessary adjustments to the platform's design, and improve communication initiatives that facilitate the platform's use. Additional information will be gathered during this process from the direct opinions of producers currently participating in the program. These responses will be collected through a feature in the digital platform that allows for immediate feedback after completing an activity. This will enable us to triangulate the results and gain a much more detailed understanding of each producer's experience with the various activities offered by the digital platform. To summarize these results, we plan to develop an article that weaves together the perspectives from both administrators and end-users (farmers) of online digital platforms. This article will review how the Incentive Payments are functioning in terms of enrollment, explore the project experience with a deeper focus on the factors that influence users' readiness to participate in digital enrollment.

Impacts
What was accomplished under these goals? Objective1: Conduct participatory research to directly inform the development, dissemination, and refinement of an incentive payment sign up and reporting app. We established a framework that integrates the four dimensions of Responsible Innovation--anticipation, reflexivity, inclusion, and responsiveness--into our analysis. This framework serves as a foundation for understanding ongoing and future projects that utilize online tools for farmer enrollment in incentive payments. We facilitated the relationship with the Missouri CRCL Project team and FarmRaise partners by participating consistently in weekly meetings. This regular engagement allowed us to actively contribute to the co-creation process and maintain continuous communication, ensuring participant observation and that our involvement was well-integrated and supportive throughout all stages. Pilot tests with end-users (farmers) to iteratively adapt the digital platform to better meet farmers where they are at and make access to cost-share funds more accessible to more and different producers. Findings contributed to steps made to improve the useability of the platform for end-users and administrators. Using the Responsible Innovation approach, we created a systematization report for the first year of the project. This report documents the findings from our participatory study of co-developing this digital platform with the FarmRaise company and the Missouri CRCL Project team members, analyzing offers insights to guide the conversation and understand other projects using similar digital tools in the context of other cost-share programs, including USDA-NRCS programs such as EQIP in addition to emergent projects through theUSDA Partnerships for Climate-Smart Commodities program. Our analysis revealed that technology development is not neutral but is informed by the perspectives, resources, and social capital of organizations, groups, and individuals involved. This understanding has led to a more nuanced view of how technological evolution is influenced by social and power dynamics. Some insights that are relevant for community leaders and farmers understanding on how these digital processes evolve: Understanding the Digital Transition: The analysis underscores the importance of a holistic vision from the beginning of digital projects. Integrating digital tools into agriculture isn't just about technology--it's about aligning all aspects of the project, from inclusion, data management to the farmer's experience, and data privacy to ensure smooth operations and successful outcomes. Collaboration for Better Outcomes: The collaboration between entities, tech companies, and universities presents a path to achieve scale and sustainability in digital initiatives. However, these relationships are also influenced by various interests and motivations that need to be aligned and clearly defined from the outset to ensure they remain in sync throughout the project. Iterative Design and Continuous Learning: The process of designing and implementing digital tools is iterative, meaning it involves ongoing adjustments based on real-world feedback. For farmers and community leaders, this means that their input is vital and that digital tools will evolve over time to better meet their needs. Balancing Commercial Interests with Farmer Trust: While tech companies may have commercial interests, it's essential to maintain clear communication and protect farmer data to build and sustain trust. Community leaders should advocate for transparency and clear guidelines to ensure that the benefits of digital tools are maximized without compromising farmers' privacy or overwhelming them with unnecessary information. Challenges of Data Management and Access: Managing large-scale data and ensuring privacy are significant challenges. Farmers and promoters of these technologies should be informed about the complexities of data collection and how it impacts their participation. Access to critical data, like FSA records, could significantly ease the process, but this requires ongoing dialogue and negotiation with federal agencies. Role of Farmers in Shaping Digital Tools: Farmers' varying levels of comfort with digital technology influence their engagement with new tools. Building mechanisms to deeply understand these varying levels of comfort and the factors that influence them is essential for achieving a digitalization process that is truly inclusive for everyone. Objective 2: Evaluate the socio-cultural, economic, and ethical impacts of this app for different producers in Missouri. Based on the observations and analyses of the first phase of this project, particularly its steps for enrollment and overall participation, we honed in on an important project primary impact: reducing the transaction costs for producers to access incentive Payments or cost-shares to support adoption of conservation practices. As we evaluate the potential for using a digital platform to reduce barriers, we are therefore assessing how transaction costs at various steps--such as researching and seeking information, taking action, planning or implementing, making a contract, and monitoring an action--are being altered at each stage of the farmer's participation. We built a matrix on the potential considerations at each step. This understanding of how time investment is affected will be further explored in the interviews conducted during phase 2 with producers involved in this project, in addition to interviews with other organizations using a digital platform or online approach to engage producers in cost-share programs. Objective 3: Identify and share applicable learnings for promoters and developers of digital technologies looking to increase access to and inclusivity of incentive programs in climate-smart agriculture. We shared findings from the first year of this project with all members of the collaboration process, including FarmRaise and the University of Missouri team. This is key to the continued process of making our program more accessible, but also impacts broader audiences, as FarmRaise works with other projects to similarly improve access to cost-share funding.

Publications