Source: OHIO STATE UNIVERSITY submitted to NRP
ADVANCING INTEGRATED WEED MANAGEMENT RESEARCH WITH COMPUTER VISION TECHNOLOGY
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1033034
Grant No.
2023-67012-43365
Cumulative Award Amt.
$119,799.39
Proposal No.
2024-06053
Multistate No.
(N/A)
Project Start Date
Mar 1, 2024
Project End Date
Feb 28, 2026
Grant Year
2024
Program Code
[A1112]- Pests and Beneficial Species in Agricultural Production Systems
Recipient Organization
OHIO STATE UNIVERSITY
1680 MADISON AVENUE
WOOSTER,OH 44691
Performing Department
(N/A)
Non Technical Summary
Commodity crop production is threatened by the evolution of weed biotypes that are resistant to multiple herbicide modes of action. These multiple herbicide resistant (MHR) weeds have rendered many common herbicide chemistries ineffective, causing severe yield losses in commodity crops and leading farmers to increase the number and volume of herbicide products used in their weed management programs. Over the long-term, however, sole dependency on herbicides for weed management will only exacerbate the MHR epidemic. Integrated weed management (IWM) programs that incorporate non-chemical strategies alongside effective chemical control options can reduce selection pressure for MHR . Site-specific weed management programs that use precision technologies to target individual weeds with effective chemical and/or non-chemical controls can also reduce selective pressure by accounting for the inherent spatial heterogeneity of weed populations and simultaneously detecting and preventing escapes of MHR weeds. Developing effective precision IWM strategies that emphasize prevention through multiple complementary tactics is critical for reducing the rate of herbicide resistance evolution and spread.Measuring the success of an IWM program is not based on the efficacy of each individual tactic in a given growing season, but rather on the collective ability of multiple tactics to manage weed populations at levels that prevent interference with crop production over multiple years. Thus, for effective IWM to be developed and adopted, there is a need for ways to monitor weed populations with higher spatial and temporal resolutions than is provided by traditional methods such as manual scouting and visual weed control ratings.Recent advances in computer vision (CV) technology have enabled low-cost sensing systems for estimating weed biomass and density at the species level. Information from these systems can provide high spatial resolution maps of weed populations that can assist with evaluating both short- and long-term effects of weed management tactics individually and in combinations.Demographic information about weed populations (i.e., seedling emergence, mortality, fecundity) obtained from CV systems can also be combined with data on the typical variation in environmental conditions at a site to predict the long-term impacts of combining multiple weed management strategies, thereby reducing the resources needed to directly monitor these effects. Utilizing CV technology to monitor weed populations at the species level will accelerate the development and adoption of effective precision IWM strategies, thereby combatting the MHR epidemic and improving the overall sustainability of weed management.Getting Rid Of Weeds (GROW; www.growiwm.org) is a national research and extension network of weed scientists, agronomists, computer scientists, and agricultural engineers collaborating to develop precision IWM technologies. The GROW team has previously developed Weeds3D, a low-cost CV platform for weed mapping. Weeds3D consists of a GoPro Camera, an Android tablet for camera control, image upload, and displaying weed maps, and a cloud-computing based image processing pipeline. Weeds3D is capable of generating 3D point cloud reconstructions of weed and crop plants at the species level that allow for the estimation of individual plant biomass. While this technology has many potential applications for precision weed monitoring and management, it has yet to be used as a tool for data collection in applied IWM research.This project will test the Weeds3D system's ability to accurately estimate weed demographic data (i.e., weed density, biomass, and fecundity at the species level) in a multi-state field experiment assessing the integration of cover crops (CCs) and residual herbicides for MHR weed control. At each research site three cover crop management treatments (No cover/fallow, cereal rye terminated 2 weeks prior to soybean planting, and cereal rye terminated at or soon after soybean planting) and two herbicide treatments (POST-only, and PRE-residual followed by POST) will be utilized in a factorial randomized complete block design to create a gradient of IWM intensity. Cover crop performance, weed demographics, and soybean yield will be measured using both traditional sampling methods (i.e., quadrat samples of density, biomass, yield) and the Weeds3D system. Data from quadrat sampling will be used to validate the weed density and biomass estimates produced by Weeds3D, and both datasets will be analyzed to evaluate the efficacy of the IWM treatments on weed populations and soybean yield. Results from this experiment will be used to inform best practices for managing cover crops and integrating them with effective herbicide programs to manage MHR weeds and slow resistance development and spread.In addition to evaluating the impacts of a promising IWM strategy on weed population dynamics within a growing season, the proposed project will also develop digital infrastructure and statistical approaches for predicting the long-term impacts of IWM strategies by parameterizing predictive weed population models with demographic estimates generated by the Weeds3D system. In short, this will involve developing simulation models to predict how MHR weed populations respond to IWM tactics over longer periods of time, and integrating these models with the existing Weeds3D image processing software and database through a new application programming interface, also developed as part of the project effort. These combined efforts will result in an improved Weeds3D system with a seamless data processing and analysis pipeline that will allow researchers with minimal programming or modeling experience to quickly and easily collect videos of research trials, extract information about weed demographics at the species level, and predict the long-term impacts of IWM tactics being tested in the trials. By facilitating the data collection and analysis process and thereby reducing the time, labor, and other resources necessary for IWM research, these tools promise to greatly accelerate the development and testing of IWM strategies and thereby provide more options for the sustainable management of MHR weeds.
Animal Health Component
50%
Research Effort Categories
Basic
0%
Applied
50%
Developmental
50%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
2162300114050%
4027299208050%
Goals / Objectives
Project Goal 1.Use computer vision (Weeds3D) and traditional field sampling methods to evaluate the in-season impact ofintegrating CCs and residual herbicide programs on weed suppression and cash crop performance across broad environmentalgradients.Objective 1a: Develop and revise field experiment protocols.Objective 1b: Coordinate field experiment management and data collection with collaborators in seven states (OH, DE, GA, IL, KY, NC, PA).Objective 1c: Collect and process video data with Weeds3D system to obtain weed density, biomass, and fecundityestimates for each species present in experimental transects.Objective 1d: Collect weed density, biomass, and fecundity data using standard quadrat sampling methods.Objective 1e: Validate weed demographic data estimates from Weeds3D using data from quadrat samples.Project Goal 2. Predict long-term effects of CC management and residual herbicides on weed communities, including multipleherbicide resistant weeds, using population models created from CV data.Objective 2a: Develop Weeds3D database API to enable seamless data flow between collection and analysis.Objective 2b: Develop weed population simulation models from Weeds3D demographic data.Objective 2c: Use population model results to evaluate long-term effects of cover crops and residual herbicides on weedcommunities and herbicide resistance development under varying management scenarios.
Project Methods
Field Experiment (Project Goal 1). The Weeds3D system will be used to monitor weed populations in an IWM field experiment carried out at two field sites in each of seven states (OH, DE, GA, IL, KY, NC, PA) over two cash crop growing seasons, for a total of 28 site-years of data. The experiment will use a factorial design with three levels of CC management and two levels of herbicide inputs as treatments. The cash crop will be soybean at all sites in both years. CC management levels will be a bare fallow control, a standard termination timing two weeks prior to cash crop planting, and a planting green termination timing at or up to two days after cash crop planting. The bare fallow treatment will receive a burndown herbicide application at the same time as the standard CC termination timing. Herbicide treatments will be a POST-only herbicide program when weeds reach height-based management thresholds, and a program that includes a PRE-residual herbicide application at cash crop planting followed by the same POST program.This treatment design will produce a gradient of IWM intensity through the interaction of CC and herbicide treatments. It will also provide substantial environmental gradients due to differences in soil types and weather conditions across site years. Weed population response to management and environmental gradients will be measured through both traditional weed population sampling methods (i.e., seedling emergence counts, dry biomass samples, seed production measurements) and the Weeds3D system at times with biological and management relevance during the growing season: 1) at CC termination/burndown, 2) at soybean emergence, 3) three and six weeks after soybean emergence to capture emerging weed cohorts, 4) at soybean physiological maturity, and 5) at soybean harvest. These sampling timings will allow us to capture differences in weed seedling emergence, growth, mortality, and fecundity under varying management conditions that will be used to parameterize life-cycle based population models. CC biomass at termination, soybean stand count at growth stage V3, soybean biomass at growth stage R5, and soybean yield will also be measured to be used as explanatory variables in weed population models. Environmental data will be obtained from the NOAA Climate Data Online database (ncei.noaa.gov/cdo-web) and the NRCS Web Soil Survey Database (nrcs.usda.gov/wps/protal/nrcs/main/soils/survey) and verified by researchers at each site.Cereal rye (Secale cereale L.) wasplanted as a winter CC at all sites in Fall 2022 and 2023. Data collection began at CC terminationin Spring 2023 and will conclude with the second year of soybean harvest in Fall 2024. All sites are currently part of the GROWresearch network and have participated in prior research and development of the Weeds3D system. Thus, all sites already havethe necessary Weeds3D hardware, have experience using the Weeds3D system for data collection, and will receive anyWeeds3D software updates automatically from the GROW technical support team.Data Processing Pipeline for Modeling Weed Population Dynamics (Project Goal 2). Video collected with the Weeds3D system will be processed using existing algorithms for 3D point cloud reconstructions of weed and crop biomass using the structure-from-motion technique that accounts for canopy height and density. Weed density and biomass estimates will be generated by this image analysis pipeline and will be validated using empirical data from the field experiment. New empirical relationships for estimating weed fecundity will be integrated into the current image analysis pipeline using weed biomass data from the field experiment and seed production data from a previous GROW experiment (Lazaro et al. 2022).A new data flow pipeline for building predictive population simulation models from these estimates will be developed using the open-source R PROSPER package (von Redwitz and de Mol 2020). PROSPER was specifically developed for modeling MHR weed populations using demographic parameters and provides functions for introducing experimental data directly into simulation models. Models are built by defining an initial weed population structure (i.e., seedbank density and weed species biology, including herbicide resistance traits) and any number of selection functions (i.e., factors such as climate, competition, or weed management interventions) that determine the likelihood of an individual with a given set of traits proceeding to the next lifecycle or selection step. Initial weed population structure and selection functions for CC weed suppression and the effects of residual herbicides will be calculated based on estimates generated by the Weeds3D data collection over the course of each field season. The modeling data flow will be enabled by the development of an application programming interface (API) that will allow data to be pulled directly from the existing Weeds3D database into the PROSPER modeling environment. Additional model parameters and selection functions, such as the proportion of individual plants exhibiting HR traits in a population of a given species, and weed species life cycle characteristics such as seedbank mortality and annual germination rates will be obtained from site managers or published literature as needed. Population dynamics over multiple years will be simulated using initial population demographics and probabilities of individual weeds surviving and reproducing under a given management regime. Outputs of population models built with PROSPER will include year-to-year weed population growth or decline as influenced by weed demography and IWM practices, and the prevalence of herbicide resistance genes in the population if initialgene frequencies and susceptibility of resistant biotypes to management interventions are provided. All of the data flow infrastructure developed for this project will be hosted in a public Github repository, thereby making it easily accessible and customizable for other researchers and potential end users. Future plans for the Weeds3D system include developing a web application for researchers to easily access and analyze data generated by the system. The Weeds3D API and population modeling workflow developed for this project will eventually be integrated into this application, facilitating their use by other researchers.Evaluation.Success of the project will be evaluated based on the successful completion of data collection from the field experiment testing delayed CC termination and residual herbicide programs, the creation and validation of weed population models using demographic information generated by the Weeds3D computer vision system, and the deployment of an open access web application connecting the current Weeds3D image processing pipeline to a user-friendly interface for evaluating IWM research trials using predictive population models. Progress on each of these objectives and the underlying activities associated with each will be assessed periodically during monthly project team meetings between the PD and the collaborating researchers at each of the participating sites. Additional feedback on project outcomes will be obtained from GROW advisory board members when the PD presents updates at semi-annual GROW meetings. All feedback will be used to revise research objectives and experimental protocols as needed to ensure successful completion of the project.

Progress 03/01/24 to 02/28/25

Outputs
Target Audience:The primary audience for this project is weed scientists who are most likely to utilize the digital tools for weed demographic data collection and analysis developed by the project. The secondary audience for this project is soybean farmers who will benefit from new information on the integration of cover crops and residual herbicides for weed management in soybean crops generated by the field experiment component of the project. Changes/Problems:Progress on Project Goal 2 was delayed significantly by the transition of the PD from his postdoctoral position at the University of Delaware to an Assistant Professor position at The Ohio State University. Due to the PD's reduction from 100% to 8% effort on this project after starting the new position a staff researcher was hired to complete these tasks in August 2024, leaving a gap without full effort on the project from March through August. All field experiment coordination and data collection for Project Goal 1 was still achieved during the summer of 2025. As a result of the delays a one year no-cost extension was requested and approved, which will allow us to complete Project Goal 2 and disseminate research findings through additional conference presentations, Extension meetings, and peer-reviewed articles during the remainder of 2025 and early 2026. What opportunities for training and professional development has the project provided?During this reporting period the PD has had enormous opportunities for training and professional development from this project. In addition to advancing the original project goals by continuing to coordinate a multi-state field experiment and developing computer vision tools for non-destructive data collection, the PD has also had many new experiences enabled by the transfer of grant funds into a faculty position at The Ohio State University. These have included further navigating the NIFA grant system to enact the transfer, and having the opportunity to hire and supervise a research staff member dedicated to the project. The PD also had the opportunity to give several Extension presentations on this project during 2024. The PD was able to attend summer (Pullman, WA) and winter (virtual) meetings of the GROW Integrated Weed Management network during the period that further built collaborations with the researchers contributing to this project as well as others that may participate in future research with the Weeds3D system. How have the results been disseminated to communities of interest?The PD presented preliminary results of this project to three Extension audiences totaling 182 attendees at the Conservation Tillage & Technology Conference in Ada, OH (March 12, 2024), the OSU Weed Science Field Day in South Charleston, OH (July 10, 2024), and the OSU Weeds University workshop (hybrid, November 21, 2024). Preliminary results of the field experiment were also shared with weed science researchers at the Northeastern Weed Science Society (January 2025) and Weed Science Society of America (February 2025) meetings by Grant Hoffer, a graduate student in collaborator Dr. John Wallace's lab at Penn State University. Grant has been working on the broader objectives of the field experiment beyond implementing computer vision for data collection as the focus of his MS research. What do you plan to do during the next reporting period to accomplish the goals?Project Goal 1 will be completed by analysing data from the field experiment to determine 1) efficacy of integrating cover crops and residual herbicide programs for weed management in soybean production across a broad geographic range of the Eastern United States, and 2) validation of weed count and biomass estimated by the Weeds3D system with quadrat sample data. Project Goal 2 will be completed by finalizing the population modeling pipeline using waterhemp as the first weed species of interest, and then replicating the modeling approach with other species (Palmer amaranth, giant ragweed, lambsquarters, velvetleaf). Model scenarios will be run comparing the multi-year effects of cover cropping and residual herbicides on weed population dynamics in crop rotations with soybeans. Results of both Project Goals will be communicated to communities of interest through both scientific and Extension presentations and publications generated during this period.

Impacts
What was accomplished under these goals? Project Goal 1: A second year of data collection (cover crop biomass, weed counts, and weed biomass) was completed using the Weeds3D computer vision system and quadrat sampling. The Maryland and North Carolina sites did not participate in the Weeds3D data collection in 2025, but an additional site was added in Ohio, resulting in six sites that completed the full protocol. Data have been processed and are currently being analysed with conference presentations and manuscripts forthcoming by the end of the 2025 calendar year, at which point this Project Goal will be successfully completed. Project Goal 2: Data were cleaned and formatted and the analysis pipeline for generating matrix population models from vital rates (emergence, survival, fecundity) gathered from the field experiment and the literature has been drafted for waterhemp (Amaranthus tuberculatus), one of the most troublesome herbicide resistant weeds in Midwestern soybean production and a species that was present at several of the research sites. Separate models will be parameterized for the various experimental treatments and population sizes will be projected over several simulated growing seasons to estimate long-term effects of the combinations of treatments. After finalizing the modeling pipeline with this first species, we will replicate it for other species with sufficient data collected from the field experiment.

Publications

  • Type: Conference Papers and Presentations Status: Published Year Published: 2025 Citation: Hoffer, G., Wallace, J., VanGessel, M., Basinger, N., Hager, A., Haramoto, E., Everman, W., Law, E., Gage, K., Miller, E. (2025). Planting Green and Residual Herbicide Interactions in No-Till Soybeans. Weed Science Society of America Annual Meeting, February 24-27, Vancouver, British Columbia.
  • Type: Other Status: Published Year Published: 2024 Citation: Law, E.P. (2024). Precision Sustainable Agriculture: New Technologies for On-Farm Decision Making. 32nd Annual Conservation Tillage & Technology Conference, March 12-13, Ada, OH. Extension presentation with 100 attendees.
  • Type: Other Status: Published Year Published: 2024 Citation: Law, E.P. (2024). Updates on GROW Legacy and PlantMap3D Calibration Trials. OSU Weed Science Field Day, July 10, South Charleston, OH. Extension presentation with 40 attendees.
  • Type: Other Status: Published Year Published: 2024 Citation: Law, E.P. (2024). New Technology in Weed Science. OSU Weeds University, November 21, Hybrid (virtual presentation to six County Extension sites). Extension presentation with 42 attendees.