Source: UNIV OF MINNESOTA submitted to
FACT: DEVELOPMENT OF A NATIONAL MANURE COMPOSITION DATABASE
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
NEW
Funding Source
Reporting Frequency
Annual
Accession No.
1023666
Grant No.
2020-67021-32465
Project No.
MIN-25-G30
Proposal No.
2019-07443
Multistate No.
(N/A)
Program Code
A1541
Project Start Date
Aug 1, 2020
Project End Date
Jul 31, 2024
Grant Year
2020
Project Director
Wilson, M.
Recipient Organization
UNIV OF MINNESOTA
(N/A)
ST PAUL,MN 55108
Performing Department
Soil, Water, & Climate Dept
Non Technical Summary
Animal manures are a valuable nutrient source for crop production if well managed. Manure characteristics vary spatially and temporally depending on animal species, bedding use, collection method, treatment, and storage method. Understanding manure composition is critical to nutrient management planners, regulators, engineers, and farmers interested in manure handling and processing. Available manure characteristic tables are decades old and do not have values for different animal manure handling systems. Engineers that write standards and handbook publishers do not have the resources to collect and report dynamically changing data. They rely on published research to accumulate before the standards or handbooks are updated. Manure composition is a critical piece of nutrient cycling analyses for crop and livestock sectors, which in turn inform supply chain sustainability decisions and actions. This project will develop processes for collecting manure composition data from commercial and university labs to implement a scalable and dynamic database and management system for collecting and combining manure analysis results from around the United States. The ultimate goal is to then provide this data through two interfaces:One to provide research staff with a flexible yet powerful portal to inspect and analyze data, andAnother to provide the public with a simple means to access and download datasummaries by region.The long-term outcomes of this project include improved manure management through increased and more up-to-date knowledge of manure compositionover time and by location (regions). This will result in better use of manure nutrients, increased protection of environmental and natural resources, and improvements in consumer health as fewer pollutants from over-application of manure end up in our environment. The database is designed to reinforce the practice of manure sampling by making the temporal and spatial variability of manure even more apparent.
Animal Health Component
0%
Research Effort Categories
Basic
(N/A)
Applied
100%
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
40339102020100%
Goals / Objectives
The overall goal of this project is to design and implement a scalable and dynamic database and management system for collecting and combining manure analysis results from around the US. This database and management system will be able to provide up-to-date, aggregated information on animal manure composition in user selected terms: spatially, temporally, and by animal system source.More specifically, we aim to:Evaluate historical manure data from several analytical labs to investigate the temporal and spatial variability of manure samples to inform future data collection and analysis needs;Engage stakeholders to develop standards and best practices for manure composition data collection and management, including archiving and sharing;Create a database to accept manure composition data from commercial and/or university labs; andEnsure our database meets FAIR principles (Findable, Accessible, Interoperable, and Reusable) through a management system for end-users.Over the long-term, through continuous stakeholder involvement in these objectives, we aim to identify the mechanisms for a sustained system to maintain manure composition data collection and sharing abilities past the lifetime of this project.
Project Methods
Activity 1 -Develop data standards and identify needs of those that use manure dataThe historical manure analysis data from three commercial laboratories have already been obtained and will be further used to provide initial insight into the variability that we can expect to see within the manure composition data and what standards need to be developed. With this information, we will prepare an initial report for the stakeholder group (described in Activity 2) that will identify and describe data collection needs and opportunities to use existing data standards and ontologies for agricultural practices. We will work to develop consensus regarding various vocabularies, units of measurement, and experimental protocols, while also recognizing that our database platform must be flexible enough to accommodate different standards and approaches.Activity 2-Engage a stakeholder group of manure data usersThe project will engage a stakeholder group involved with manure management, regulation, lab analysis, and research to advise our data collection and management system. The stakeholder group tasks provide consistent and frequent review of database development and ensure the project objectives are met. Stakeholder engagement topics will include:developing a standard manure sample submission survey to obtain similar manure information across participating labs;creating or utilizing existing data dictionaries, or ontologies, for common components contained within the collected data;defining the user groups and database interface requirements for those uploading and downloading data;branding the database and user interfaces;defining the metadata, including the spatial finety of the data (i.e. region, county, zip code);protecting laboratory business interests, including producer-lab relationships and competition between businesses;advocating for inclusion/exclusion of less frequently-measured manure variables (i.e. zinc [Zn], copper [Cu]) in both standard manure analyses and the database; andcommon outputs and analyses that can be made available and automatically updated in public web interfaces as new data are added to the database.The stakeholders will help identify needed information standards and best practices for data management (supporting Objective 2), identify barriers that may prevent laboratory participation and their possible solutions (supporting Objectives 2 and 3), and to provide input regarding the creation of the manure composition database (supporting Objective 2). Those in the group that represent potential database users will also help to identify what information they might want to be associated with the stored and analyzed manure composition data to make the database more valuable (supporting Objective 2 and 4).The project stakeholders will be engaged through conference calls and two face-to-face meetings as outlined below:Conference calls: Monthly conference calls in Year 1, and semi-annual calls thereafter will be held online among the stakeholders and the research team members. The conference calls and web presentations will be used to discuss database goals, assumptions, values, questions, and information needs stakeholders have based on their experiences related to animal manures. Following the face-to-face stakeholder meeting the conference calls will focus on the testing needs of the database system.Stakeholder and Research Team meetings: The first face-to-face meeting with the stakeholders and the research team will be held in Minnesota within twelve months following grant initiation. Stakeholder expertise and experiences will help them provide input on data standards and practices to meet the common database user needs. The stakeholder input will be used as input to activities 1 and 3. A second face-to-face meeting will occur in Year 3 of the project in Minnesota to discuss progress and barriers that we have encountered and possible solutions. We will also strategize on ways to maintain the data upload and database management past the life of the project.Activity 3 -Develop a database and management system for uploading dataWe will leverage and extend the considerable experience, development, and database infrastructure of the GEMS (Genetic, Environmental, Management, and Socioeconomicdata) platform to build the manure composition data ecosystem without having to start from scratch. The stakeholder group will also help to define what customizations will need to be made to the tools for cleaning data, detecting outliers, and generating new metadata.In order to further test the data ingest system, we will identify three to four certified manure testing laboratories to run a pilot program for data collection. After the initial year and once the pilot program has ended, we will continue to add certified laboratories over time, ideally two to four per year through the fourth year of the project with expectations to add more labs beyond the project life. The focus will be to recruit labs with high manure sample throughput in various regions with high livestock production in order to represent the majority of manure analyzed in the country.The project team will assess the collected data's usability and report to the stakeholder group on a bi-annual basis via online tools. This process will allow us to continually refine standards and best practices over time as issues arise and to further refine data ingest, metadata generation, and outlier detection tools, and to make any needed customizations to the manure-based ontology.Activity 4-Create a system for users to access the manure composition database and ensure it meets FAIR principlesAfter data are uploaded, cleaned, and described, the GEMS platform will also be used to support two web-based interfaces to help manage and share data collected under this project. One interface will provide research staff with a flexible yet powerful portal to inspect and analyze data, while another will provide the public with a simple means to access and download well-curated data and data summaries. Members of this proposal will work with stakeholders to define and adjust the specific details of how a data set goes from the point of collection to being available to all of the public.The manure composition database will meet FAIR principles in several ways:Findable-- metadata will be created during data ingest and will be stored in GEMS to facilitate finding these dataAccessible-- data and metadata will be made a part of GEMSOpen so that others can access the data directly from the GEMS platform or via the public manure database.Interoperable-- Jupyter Notebooks are increasingly used to manage and share analyses and are at the core of other growing analysis environments like the National Data Services Workbench. By following a widely adopted analysis framework like Jupyter and by exposing the GEMS functions and data to external repositories and analysis platforms via the GEMS application programming interface (API), we will greatly facilitate interoperability with other analysis platforms data repositories.Reusable-- the Jupyter notebook analysis environment may be saved, shared, and reused in order to facilitate reproducibility. The GEMS platform is also working on a feature that will give GEMS users an easy way to "mint" a new digital object identifier (DOI), so that distinct data set versions and workflows can easily be identified to reproduce results.The project team will assess the usability of the two interfaces and report to the stakeholder group on a bi-annual basis via online conference tools. This process will allow us to continually refine standards and best practices over time as issues arise.

Progress 08/01/22 to 07/31/23

Outputs
Target Audience:The target audience for this project is the community that uses this manure data. This includes farmers developing manure management plans, engineers designing manure storages, state and federal regulators establishing best management practices for manure land application, laboratory managers assessing their performance in a region for manure analysis, or researchers modeling nutrient cycling and gas emissions. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?One graduate student has been training in research and database management skills throughout this project. She has also attended several conferences and workshops for professional development, including presenting her work on this project. How have the results been disseminated to communities of interest?Yes, please see the products listed above. We also hosted two virtual open houses in May 2024 for our stakeholders to view and comment on the current manure database and it's search features. What do you plan to do during the next reporting period to accomplish the goals? Developing data standards and evaluating historical data We will continue to onboard the labs that we already have existing relationships with. Our first official set of data will be uploaded to Ag Data Commons in early 2024. Then we plan to have annual updates thereafter. The graduate student will complete the historical data analysis Engaging Stakeholders A stakeholder meeting will occur in early 2024 to demonstrate updates to the database and search capabilities A small set of stakeholders will be selected to do some informal evaluation of the database search features to see if there are any errors and what can be improved for data-friendliness Database development As mentioned, we'll continue to upload new data through December 2023. All data through that point will be uploaded to the Ag Data Commons and a DOI assigned. The ManureDB.umn.edu website search features will use this version of the database. New data after 2023 will be uploaded on an annual basis. Every annual iteration will be added to Ag Data Commons as well We will finish the filtering capabilities on the website so that farm anonymity is preserved (no fewer than 5 samples of a specific manure type in a given year in a given state/region will be shown). We will make updates as needed according to stakeholder suggestions We will continue to build the database and search tools to ensure they are meeting FAIR principals.

Impacts
What was accomplished under these goals? With an increasing public concern about animal manure issues, better manure characteristics information is needed to better manage and utilize this resource while protecting our natural and public resources. Up-to-date and dynamic manure characteristics information will also enhance opportunities for technologies to extract energy and recycle the nutrients in the manure for crop production. Our aim is to design and implement a scalable and dynamic database and management system of manure analysis results from around the US. During this project period we continued to connect with stakeholders and other community members to continue developing manure data standards and collect initial manure nutrient analysis data. Developing data standards and evaluating historical data Graduate student continued to update our data standaridization template as needed when new situations arose. Historical data was collected from 14 new labs and beginning summaries were developed. These were presented at several conferences. Engaging Stakeholders The stakeholder advisory committee met virtually in March 2023, with the goals of providing updates on database development and to discuss proposals for increasing data specificity. Two Virtual Open Houses were held in May 2023 to introduce the database to current and potential lab partners, the stakeholder advisory committee, and other persons who expressed specific interest in the database. The total number of attendees was 22. Feedback was solicited and prioritized for the developer team. An 8-hr hybrid work session was held in July 2023 with the stakeholder advisory team with the objectives to: document database development, develop rules and structure for sample categorization, sustain database integrity, and gather project evaluation feedback. Database development At the time of this report, we had 14 labs with fully executed Data Use Agreements in place (and we received data from all 14 labs) and 11 additional labs that were considering joining us. We continued to work on the spreadsheet validation tool that ensures that data that is submitted conforms to the "ideal data template". We began to consider what data will be filtered from public view to protect anonymity of farms. As an example, the National Agricultural Statistics Services will not report data if fewer than 5 farms are represented in an area in the Quick Stats guide. We will continue to work on this in the next year. Ensuring database is FAIR Prior to this effort, it has been very difficult to obtain aggregate test results and statistics from manure sampling. Our database and interface has been designed from the outset to ensure this important data is Findable through our search capabilities, Accessible to all users, Interoperable with related data as it uses standard nomenclature and measurement units, and Reusable with richly annotated metadata and data provenance.

Publications

  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2023 Citation: Bohl Bormann, N., Wilson, M., Cortus, E., Janni, K., Silverstein, K., & Gunderson, L. 2022. Recent Manure Test Data Demonstrates Need for Updated Manure Book Values [Abstract]. ASA, CSSA, SSSA International Annual Meeting, Baltimore, MD.
  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2022 Citation: Bohl Bormann, N., Wilson, M., Cortus, E., Janni, K., Silverstein, K., & Gunderson, L., 2023. ManureDB: Creating a Nationwide Manure Test Database. [Proceedings]. Western Nutrient Management Conference, Reno, NV. https://westernnutrientmanagement.org/Proceedings


Progress 08/01/21 to 07/31/22

Outputs
Target Audience:The target audience for this project is the community that uses this manure data. This includes farmers developing manure management plans, engineers designing manure storages, state and federal regulators establishing best management practices for manure land application, laboratory managers assessing their performance in a region for manure analysis, or researchers modeling nutrient cycling and gas emissions. Changes/Problems:Stakeholder meetings were all virtual because of pandemic; the stakeholders feel a face-to-face meeting will be most useful when there is opportunity to test the working database. Work on the database itself has been slower than anticipated due to the pandemic and difficulty in meeting. Externally, it has been noted by our stakeholders that some agronomic labs have shut down due to the pandemic. What opportunities for training and professional development has the project provided?PhD student professional development How have the results been disseminated to communities of interest?As described above, our group has disseminated information at several conferences (the Agonomy, Crop Science, and Soil Science Societies Annual Meeting and the Waste-to-Worth Conference) as well as to topic-related interest groups like the Livestock and Poultry Environmental Learning Community. We have also continued to share information with our stakeholder group. What do you plan to do during the next reporting period to accomplish the goals? Continue to recruit four to six more labs to participate in data sharing. Collect data from participating labs and revise the spreadsheet validation tool if needed, or customize the tool for individual labs if necessary. Begin formal data analysis for spatial and temporal trends. Prepare first iteration of public-facing, database query tool for data evaluation. Meet with stakeholders to evaluate the tool for ease-of-use and effectiveness.

Impacts
What was accomplished under these goals? With an increasing public concern about animal manure issues, better manure characteristics information is needed to better manage and utilize this resource while protecting our natural and public resources. Up-to-date and dynamic manure characteristics information will also enhance opportunities for technologies to extract energy and recycle the nutrients in the manure for crop production. Our aim is to design and implement a scalable and dynamic database and management system of manure analysis results from around the US. During this project period we continued to connect with stakeholders and other community members to continue developing manure data standards and collect initial manure nutrient analysis data. Developing data standards and evaluating historical data Our graduate student conducted some preliminary analyses with the historical data we have collected so far. She presented the results at the Waste-to-Worth Conference in Ohio and during a Livestock and Poultry Environmental Learning Community Webinar in 2022. Engaging Stakeholders The stakeholder advisory committee met virtually in March. The stakeholders had a chance to review the data use agreement, and were excited to see the brevity of the form! One stakeholder retired and his committee position was replaced with an animal scientist specialist. Another stakeholder took a new position, and his committee position was replaced with a representative of the biogas industry. Developed ideal data template with labs. Database development We have formalized a Data Use Agreement to share with laboratories for data transfer between them and the University of Minnesota. These Data Use Agreements have been shared with all participating labs thus far and revisions have been made as needed based on stakeholder input. At the time of this report, we had six labs with fully executed Data Use Agreements in place and two additional labs that were considering joining us. We received data from one lab from 2012-2020. We developed a spreadsheet validation tool that ensures that data that is submitted conforms to the "ideal data template". It validates that only certain values, or range of values, are used in each column. It prevents misspellings, ensures that numbers are used instead of text in certain columns (or vice versa), etc. Ensuring database is FAIR. Prior to this effort, it has been very difficult to obtain aggregate test results and statistics from manure sampling. Our database and interface has been designed from the outset to ensure this important data is Findable through our search capabilities, Accessible to all users, Interoperable with related data as it uses standard nomenclature and measurement units, and Reusable with richly annotated metadata and data provenance.

Publications

  • Type: Conference Papers and Presentations Status: Published Year Published: 2022 Citation: Bohl Bormann, N., Wilson, M.L., Cortus, E., Janni, K., Gunderson, L., Prather, T., Silverstein, K. (2022). Trends in Manure Sample Data. In: Waste to Worth Conference. Oregon, OH. 19-22 April. https://lpelc.org/trends-in-manure-sample-data/
  • Type: Conference Papers and Presentations Status: Published Year Published: 2022 Citation: Wilson, M.L., Cortus, E., Bohl Bormann, N., Janni, K., Gunderson, L., Prather, T., Silverstein, K. (2022). Dynamic manure book values through the U.S. National Manure Database. In: Waste to Worth Conference. Oregon, OH. 19-22 April. https://lpelc.org/dynamic-manure-book-values-through-the-u-s-national-manure-database/
  • Type: Conference Papers and Presentations Status: Published Year Published: 2021 Citation: Bohl Bormann, N., Wilson, M.L., Cortus, E., Floren, J., Miller, R. O., Gunderson, L. (2021). Differences in Manure Total Nitrogen Results due to Total Kjeldahl Nitrogen and Nitrogen Combustion Methods. IN: Agronomy, Crop, and Soil Science Society Annual Meetings. Salt Lake City, UT. Nov. 7-10. https://scisoc.confex.com/scisoc/2021am/meetingapp.cgi/Paper/134506


Progress 08/01/20 to 07/31/21

Outputs
Target Audience:The target audience for this project is the community that uses this manure data. This includes farmers developing manure management plans, engineers designing manure storages, state and federal regulators establishing best management practices for manure land application, laboratory managers assessing their performance in a region for manure analysis, or researchers modeling nutrient cycling and gas emissions. Changes/Problems:Stakeholder meetings were all held virtually because of COVID-19 pandemic. We also had planned on disseminating progress on the database at the Waste to Worth Conference in 2021, but the conference was cancelled and rescheduled for 2022. What opportunities for training and professional development has the project provided?PhD student professional development How have the results been disseminated to communities of interest?As mentioned, results have been primarily disseminated within the current working groups (project team and stakeholder groups). We also opened a discussion with the Livestock and Poultry Environmental Learning Community in order to gain information for the database but also to build awareness that this is being built. What do you plan to do during the next reporting period to accomplish the goals?We intend to develop our formal data user agreements between those sharing the data, those putting it into the database, and those using the data from the database. The initial database entry interface will be finalized. We also will recruit three to four more labs to participate in data sharing. For dissemination purposes, the database and preliminary data will be shared at the Waste to Worth Conference in April 2022 in Maumee, OH in a panel discussion.

Impacts
What was accomplished under these goals? With an increasing public concern about animal manure issues, better manure characteristics information is needed to better manage and utilize this resource while protecting our natural and public resources. Up-to-date and dynamic manure characteristics information will also enhance opportunities for technologies to extract energy and recycle the nutrients in the manure for crop production. Our aim is to design and implement a scalable and dynamic database and management system of manure analysis results from around the US. During this project period we connected with stakeholders to begin developing manure data standards and collect initial manure nutrient analysis data. This helped us to develop our first database schema. We also learned what various manure-user groups will want in a public-facing interface so that the database can meet FAIR standards. Specific details are below. Developing data standards and evaluating historical data - Manure characteristic variability is tied to the myriad of climates, housing, storage and management practices across the various livestock and poultry types. In addition to stakeholders, the participants in a Livestock and Poultry Environmental Learning Community meeting built out an existing list of manure types and associated practices with terminology and practices from across the United States. Stakeholder meetings The stakeholder committee was formalized in the fall of 2020 with twelve active members (and two alternates). The stakeholders provide perspectives from commercial and university analytical labs, state and federal government organizations, policy development, private industry, and research programs. A kickoff meeting occurred in December of 2020 to introduce members, guiding principles for the database, guiding principles for stakeholder participation, and some introductory questions. Interactive virtual work sessions occurred in February of 2021. One working group focused on data sharing wants and needs, and laboratory costs and benefits to participation. There are differences between laboratories in existing practices to ask their clientele for consent to share data. Participants appeared confident with plans for anonymizing any private data associated with manure sample results. Short-term, there are anticipated labor and programming costs to set up export functions to share data with the database; long-term, aggregated data for lab benchmarking as a benefit will likely outweigh labor costs for participation, since functions will likely be established. A second working group focused on data standard needs. The working group raised the issue of identifying standard units for reporting, and when standardization should occur. The working group also identified the challenge that data input by lab customers is minimal, even with well-designed sample forms. Overall, these interactive sessions left the stakeholders with the following impressions and excitement points: the database is not just a fancy spreadsheet; geo locations of samples may have varying degrees of accuracy; there is opportunity to standardize some forms and processes between labs; manure is a hot-spot in environmental modelling and fills a void; and stakeholder participation is a great learning opportunity. A future focus for stakeholders and project team consideration is education and promotion efforts directed toward consultants and customers to enhance data entry on manure sample submission forms. Follow-up correspondence with stakeholders in the spring of 2021 dove deeper into data standard needs, and asked the question of who should perform data standardization (i.e. units): the lab supplying the analytical results or the database? Generally, stakeholders suggested the database curators take on this task as part of the data entry process for consistency. Database development Schema development. After initial discussion with manure testing domain experts in the group, we developed a preliminary database schema. Multiple rounds of community brainstorming sessions ensued that informed the ultimate content and desired functionality for the database. These directly resulted in refinements of the original draft schema. In addition to the schema, explicit use cases were documented to inform the development of the user interface. Database implementation. An initial relational database and user interface has been developed, and is nearly ready for internal user testing and refinement. Ensuring database is FAIR - Prior to this effort, it has been very difficult to obtain aggregate test results and statistics from manure sampling. Our database and interface has been designed from the outset to ensure this important data is Findable through our search capabilities, Accessible to all users, Interoperable with related data as it uses standard nomenclature and measurement units, and Reusable with richly annotated metadata and data provenance.

Publications