Source: UNIVERSITY OF NEBRASKA submitted to NRP
ODF: NATIONAL AG PRODUCER DATA COOPERATIVE: STRATEGIC DEVELOPMENT OF A NATIONAL FRAMEWORK
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1031239
Grant No.
2023-77039-41033
Cumulative Award Amt.
$957,350.00
Proposal No.
2023-05498
Multistate No.
(N/A)
Project Start Date
Sep 1, 2023
Project End Date
Aug 31, 2025
Grant Year
2023
Program Code
[ODF]- Open Data Framework
Recipient Organization
UNIVERSITY OF NEBRASKA
(N/A)
LINCOLN,NE 68583
Performing Department
(N/A)
Non Technical Summary
To create innovative, data-driven agricultural production systems, producers will need access to data, simulations, forecasts, and modeling to learn how they can transform their operations towards enhancing sustainability. The National Agricultural Producer Data Cooperative (NAPDC) in partnership with land grant universities, stakeholder organizations, and private-sector representatives will continue the development of a national framework to foster agricultural innovation by addressing critical challenges: Leverage and enhance ongoing projects that support stakeholders and collaborative partnerships to demonstrate the effectiveness and scalability of digital resources in capturing, storing, and accessing producer and public data; Develop a clear and complete sustainability plan for updates, expansion, and user support that delineates principles and examples of specific mechanisms for capacity integration that will support effective use of the data; Develop feasible appropriate assurances of regulatory and legal compliance including a data trust structure and FAIR principles; and Further next steps for framework growth and expansion through engagement and support of diverse participation in NAPDC activities, integration of feedback, and communication and dissemination of findings. Expected outcomes include further development of a data repository that leverages tools widely accepted in the industry to ensure access, privacy and transparency while enabling on-farm research; digital tools and resources (e.g., APIs) that enable farmer and livestock producer access and use of both private and public data resources; governance and sustainability plans that ensure long term viability, data quality, and privacy assurances; and white papers, peer-reviewed publications, and other products that help define the future of a national data framework. A diverse and experienced PI team, a comprehensive group of partner organizations, a scientific advisory board of national experts will assist the NAPDC in meeting its objectives and ensuring that its activities coordinate and complement existing programs in agricultural data services and stewardship.
Animal Health Component
30%
Research Effort Categories
Basic
20%
Applied
30%
Developmental
50%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
9037410303060%
8036210303040%
Goals / Objectives
Consistent with the RFA, the overall objective of this project is to continue to develop a national data framework to foster agricultural innovation. The proposed activities will engage agricultural stakeholders across diverse systems and provide knowledge related to interoperability, security, privacy, sustainability and governance that is required for such a framework to succeed.1. Leverage and enhance ongoing projects that support stakeholders and collaborative partnerships to demonstrate the effectiveness and scalability of digital resources in capturing, storing, and accessing producer and public data [advanced cyberinfrastructure; data governance; cybersecurity and access control; prototypes and key use cases]2. Develop a clear and complete sustainability plan for updates, expansion, and user support that delineates principles and examples of specific mechanisms for capacity integration that will support effective use of the data [data fusion and data system interoperability; inventories of existing data sources and platforms; sustainability and resiliency].3. Develop feasible appropriate assurances of regulatory and legal compliance including a data trust structure and FAIR principles [data curation, representation, authentication, and stewardship; data governance; cybersecurity and access control]4. Further next steps for framework growth and expansion through engagement and support of diverse participation in NAPDC activities, integration of feedback, and communication and dissemination of findings [education, training, and workforce development; demonstrating value and return on investment]
Project Methods
Objective 1: Leverage and enhance ongoing projects that support stakeholders and collaborative partnerships to demonstrate the effectiveness and scalability of digital resources in capturing, storing, and accessing producer and public data.The Agricultural Data Coalition (ADC) has been working since 2014 to establish a farmer-controlled data cooperative entity to provide communication and sustainability for a data repository. The goal of this project is to continue enhancing the data repository to enable broader use within the university research and extension systems, including on-farm research results and integration with AgDataCommons.We will build upon the repository functionality by providing a means to not only store the various files in a common database and structure, whilemaintaining an unaltered archive of these original files for the farmer but also implement metadata standards on that common data structure.Data within this common model, also requires the ability to share common meaning. The team will continue its collaboration with AgGateway to implement industry standard semantic resources. While the ADC is a collaborative effort to create a neutral, independent farmer-centric repository forfarmers to store data (Objective 1), the Open Ag Data Alliance (or OADA) is an open-source effort with the goal to enable data security, privacy, and interoperability for the entire industry. The ADC team will determine whether the OADA AGAPECert and Mask & Link tools enable farmers to generate certifications about their data without needing to disclose their data. Critical input and feedback regarding database functionality for cover and specialty crops will be provided by projectparticipants representing land grant universities, nonprofits, and industry partners.The full value of agricultural data is only realized when it can be integrated from multiple, context-rich sources in ways that adhere to trust requirements of its owners. We propose to enable the USDA ARS National Animal Germplasm Program (NAGP)upload and query phenotypic/genotypic data with robust data quality checks, and access both the AnimalGenetic Resources Information Network (Animal-GRIN) and the Bovine Genome Database (BGD). The NAGP maintains a database information system that documents the collection and provides basic descriptors for all species. However, this database requires additional functionality and interoperability to enable the handling of larger amounts of high throughput sequencing data with metadata descriptors.NextGen sequence data has historically been a research tool to enable more refined searches for genome-phenome associations. However, cost declines make this technology appealing in some cases for more routine uses, such as commercial genetic prediction. In both cases, research and industry use, the ability to share sequence data and accompanying metadata is critical. As technologies such as NextGen sequencing become available to industry for routine use, leveraging both industry and research community data is needed to avoid unneeded duplication of efforts and cost. Moreover, data sharing among industry segments enables more accurate management decisions as animals are bought/sold, and enables genome-phenome discoveries when critical phenotypes might only be expressed in industry segments that do not currently use centralized data repositories. With these unique industry features and needs in mind, we will continue to work with UNL beef cattle populations (cow-calf, seedstock, feedlot, on farm research) and the FAANG consortium to develop APIs that enable data transfer and sharing among producers, researchers, and the Germplasm Repository, while we host discussions with stakeholders about a livestock data framework. Standards, expectations, and guidelines for uploading and hosting genotypic and phenotypic data (e.g., bioProject, bioSample) will be adapted from the frameworks for the NCBI Sequence Read Archive (https://www.ncbi.nlm.nih.gov/sra) and dbGap (https://www.ncbi.nlm.nih.gov/gap/).Objective 2: Develop a clear and complete sustainability plan for updates, expansion, and user support that delineates principles and examples of specific mechanisms for capacity integration that will support effective use of the data.The sustainability of these framework advances currently rests on several ongoing efforts. We continue to leverage the Agricultural Data Coalition and AgGateway, whose members and industry partners provide financial support for the maintenance of the database in Objective 1. The APIs and tools developed are based on open source code and are supported by the OATS Center and the NAGP infrastructure (part of ARS). Demand from ADC and AgGateway members, and the NAGP user community, will drive updates, expansion, and user support beyond the award period.Further updates and appropriate integration with current and future tool development, cyberinfrastructure facilities, and programs that will support effective use of the data will rely on both `push' and `pull' mechanisms. For the purposes of this project, integration of tools and facilities will be done with solicitation and input of the Scientific Advisory Board. This said, we will pursue a more formalized approach and develop a roadmap to sustainability motivated by the process adopted by CyVerseand the AgBioData consortium.Objective 3: Develop feasible appropriate assurances of regulatory and legal compliance including adata trust structure and FAIR principles.The 2008 Farm Bill prohibited USDA from releasing producer information at an identifiable level, but it did not prohibit the collection and analysis of the information at an aggregate level (e.g., Confidential Information Protection and Statistical Efficiency Act or CIPSEA). However, many producers remain distrustful of USDA and other government agencies, citing concerns about inappropriate data use and consequent financial risk. Any national data framework must maintain the producer's trust as the primary data providers through transparency, privacy, security, and accountability. The framework that this project will contribute to developing will be "Ag Data Transparent", i.e., willabide by the Privacy and Security Principles for Farm Data as endorsed by almost 40 agriculture groups and businesses. The framework will treat data as a trade secret and prohibit the copying or distributing of data without the producer's consent. These principles are consistent with the NIST Cybersecurity and Privacy Frameworks and cover all five privacy risk management areas: Identify, Govern, Control, Communicate, and Protect. The ADC and AgGateway, along with the members of our Scientific Advisory Board, will use their knowledge of these principles to contribute to the development of feasible appropriate assurances of regulatory and legal compliance.?Objective 4: Further next steps for framework growth and expansion through engagement andsupport of diverse participation in NAPDC activities, integration of feedback, and communication and dissemination of findings.Several activities and aspects of this project are critical to framework growth and expansion. These are outlined below and include a survey to gather stakeholder input and robust communication plans between the project team and stakeholders. These complement any next steps outlined in Objectives 1-3 above. The survey will be launched at the 2023 NAPDC conference in May 2023 when attendees will be asked to complete the survey online. A second round of survey launch and data collection will happen in Fall 2023 in order to capture input from the farming community (many of whom are unavailable during the Summer season). The results of this survey will be collated and form the basis of a peer-reviewed publication. This publication will be made open access for the broader community.

Progress 09/01/23 to 08/31/24

Outputs
Target Audience:The target audience(s) for our efforts were academic researchers in agriculturally-relevant fields, ag tech companies, commodity boards, agricultural producers, cyberinfrastructure professionals (including privacy/security and open source), extension educators and specialists, and experts in data management and FAIR principles. Changes/Problems:1. We had major difficulties with the initial award execution as our Office of Sponsored Programs did not receive the award notice and would not accept the award notice sent to the PI as sufficient. We also have challenges with execution of subawards due to lack of grant support at the primary institution and at subaward institutions. This is an ongoing challenge. We recently engaged a project manager to provide assistance. 2. We have several new investigators as subaward recipients. Receipt of timely invoices and progress reports from subawardees has been very difficult. We are hopeful that the project manager (mentioned in 1.) will be able to assist. 3. The scope of this award far exceeds the amount of funding provided. We have worked very hard as a PI team to identify `solvable' problems and make efficient use of our available resources. The number of worthy project proposals that are submitted to our convening award opportunity far exceeds the number that we can support. This leads to difficulties with how to manage framework growth and ensure that products from subawards are properly maintained. What opportunities for training and professional development has the project provided?1. Annual Precision Ag Technology Expo 2024 hosted at Virginia Tech. This included workshops/trainings on digital farming tools. Virginia Tech also hosted a Drone School, crop water use measurement workshop, and Drone data analysis workshop in 2024. 2. Annual NAPDC project conference hosted at UNL in August 2024 included presentations, a poster session, and networking opportunities for students, postdocs, faculty, and individuals from industry and nonprofit organizations. We shared research knowledge and strategies for strategic planning. 3. We host an online seminar series with invited presentations from organizations whose mission is consistent with the NAPDC. These are opportunities for training and professional development in ag tech and data management/science. How have the results been disseminated to communities of interest?We have maintained and expanded our online presence through the NAPDC webpage (https://www.agdatacoop.org/). We have a listserv with over 300 sign-ups; this is an OPT-IN process for participants and stakeholders. We sponsored a booth at the International Conference in Precision Agriculture for the Ag Data Coalition and NAPDC in July 2024. We shared information about both projects/organizations with attendees including ways to connect. One of our community members, Santosh Pitla, attended the Gathering forOpen Ag Technology (GOAT) in Fall 2023 where he discussed the NAPDC with attendees and made connections with the GOAT organization. This resulted in a subaward to GOAT in Spring 2024 to explore needs for open ag technology among agricultural producers. Lead PI Clarke participated in a panel atthe NASEM Board of Agriculture and Natural Resources meeting in Fall 2023 on the topic of data challenges in ag and natural resources, and presented an overview of the NAPDC project. Lead PI Clarke served on the scientific committee for the TechHubLive conference in July 2024 hosted in Des Moines, IA. She presented an update on the NAPDC project and also participated in a panel on data challenges and needs in agriculture. What do you plan to do during the next reporting period to accomplish the goals?1a. Further development of a user-friendly open-source soil sampling application (SSPOT), from beta testing (current) to deployment through USDA NRCS. Publication of results from extensive testing and demonstration of UAV-based soil sampling protocol (water and organic content). 1b. Continued development of API for beef genetic sequencing data deposition and federation, involving NCBI and USMARC. The goal of this API is to assist the beef genetics community with data management and animal traceability. Publication of associated manuscript on the current state of public data repositories for beef genetics 1c. Continued development of agro-climate viewer based on Google Earth engine by improved integration of multiple sources of information (crop status, growing degree days, temporal growth analysis, soil paramters, weather forecasts, and historical weather data), improved visualizations, and launch of an agriculture stakeholder web-based communication platform. 1d. Further development of the ADC Data repository by completion of integration with ADAPT framework standards for common data structure, and completion of AGAPECert implementation. Also advertising of data repository and recruitment of users. 1e. Nave Analytics will continueevaluating methods for anonymizationof field data, including development of new methods as required. Expectation of completion of evaluation results and associated recommendations. 1f. Purdue University will continue promotion and development of D2Sdata repository for UAV/UAS data and linking with open-source tools for data processing and visualization. 2. PI Calvert and NAPDC participants Ana Castellanos (Portland State) and Dan Lussier (EMILI) will establish a data governance working group for the NAPDC and develop an initial data governance structure to be shared with the NAPDC community for feedback. 3. ADC will work with NAPDC on providing a written document that details how the ADC repository adheres to the NIST Cybersecurity and Privacy Framework. The NAPDC will continue to hold discussions with both the bio and food and ag Information Sharing and Analysis Center (ISACs) to determine areas of shared interest and strategic development. 4. We will continue tomaintainand expandour online presence through the NAPDC webpage (https://www.agdatacoop.org/) and improve communications both through the website and our listserv. We will continue to participate and present at regional and national meetings of potential stakeholders to disseminate information and engage with the NAPDC community

Impacts
What was accomplished under these goals? 1a.Develop a user-friendly open-source soil sampling application (SSPOT), currently in beta testing (Currently in Beta testing (https://modest-edison-e736ca.netlify.app/). Collaboration with USDA NRCS. Extensive testing and demonstration of UAV-based soil sampling protocol (water and organic content). 1b. Continued development of API for beef genetic sequencing data deposition and federation, involving NCBI and USMARC. The goal of this API is to assist the beef genetics community with data management and animal traceability. 1c. Completed survey of agricultural producers in Virginia regarding precision agriculture needs, with follow up in-person focus group sessions in 2024. Continued development of agro-climate viewer baed on Google Earth engine. This viewer will integrate inormation about crop status, growing degree days, temporal growth analysis, soil paramters, weather forecasts, and historical weather data. Future development will include an agriculture stakeholder web-based communication platform. 1d. ADC Data repository has been expanded so it can store various files in a common database and structure (with metadata), following the ADAPT framework, while also maintaining unaltered, original files. Through collaobration with OADA, the ADC repository now has a beta version API for implementing AGAPECert and storing soil testing data. 1e. Nave Analytics is evaluating methods for anonymizationof data by removing spatial-temporal references from agricultural field data. These methods are being evaluated from the perspectives of privacy, cost, and information retention. 1f. Purdue University has implemented a data repository for UAV/UAS data called D2S; this is available to everyone as an `open' platform. The repository has a web-based interface and provides free hosting for such data. Plans for the repository include linking with open-source tools for data processing and visualization. 2. With leadership from PI Calvert and NAPDC participants Ana Castellanos (Portland State) and Dan Lussier (EMILI) we conducted structured interviews with all subaward projects regarding data governance education, needs, and practices. Through this process we gained valuable insights regarding how the initial data governance structure for NAPDC should be organized and what principles are both needed and supported by the community. 3. The NAPDC is a member of `Ag Data Transparent' and follows the principles set by ADT. The current NAPDC activities, including subawards, follow FAIR principles and adhere to the five areas of the NIST Cybersecurity and Privacy Framework. The NAPDC team has established connections with both the bio and food and ag Information Sharing and Analysis Center (ISACs). The lead PI attended the FBI Agriculture Threats Symposium in August 2024 to learn about the perspective of the national security establishment towards agricultural security, 4. We have maintained and expanded our online presence through the NAPDC webpage (https://www.agdatacoop.org/). We have a listserv with over 300 sign-ups; this is an OPT-IN process for participants and stakeholders.

Publications

  • Type: Journal Articles Status: Published Year Published: 2024 Citation: Becker SM, Franz TE, Morris TC, Mullins B. Field Testing of Gamma-Spectroscopy Method for Soil Water Content Estimation in an Agricultural Field. Sensors (Basel). 2024 Mar 30;24(7):2223. doi: 10.3390/s24072223. PMID: 38610435; PMCID: PMC11014223.
  • Type: Websites Status: Published Year Published: 2023 Citation: https://www.agdatacoop.org/
  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2024 Citation: Advancing Non-invasive, Passive Measurement of Root Zone Soil Water Content at the Subfield Scale Using Gamma-ray Spectroscopy. Presentation by Sophia M. Becker, PhD candidate, at the American Geophysical Union (AGU) 2023 Meeting. Awarded Outstanding Student Presentation Citation: Advancing Soil Moisture Science via Monitoring, Modeling, and Remote Sensing II OralEvent: 2023 AGU Annual Meeting Awarding Section: Hydrology
  • Type: Conference Papers and Presentations Status: Other Year Published: 2023 Citation: Panel presentation, Board on Agriculture and Natural Resources Winter Meeting The open sessions of the meeting will include a presentation on research priorities of the USDA Economic Research Service, a panel on disparities in access to data and journal publications; a briefing on a new National Academies report on Accelerating Decarbonization, and a presentation from Colorado State University researchers on a National Climate Change Roadmap: A Research Framework for U.S. Agriculture, Forestry, and Working Lands https://vimeo.com/889226336
  • Type: Conference Papers and Presentations Status: Published Year Published: 2023 Citation: Becker, S., Bierman, D., Bucksch, A., Calvert, S., Caprez, A., Chandel, A., & Clarke, J. (2023, December 19). The NAPDC: Stakeholder Input and Strategic Directions. https://doi.org/10.31219/osf.io/tkg96}{\tt https://doi.org/10.31219/osf.io/tkg96