Source: UNIVERSITY OF CALIFORNIA, DAVIS submitted to NRP
FACT-AI: DATA-EFFICIENT AI PLATFORM FOR LABEL AND LABEL-FREE DETECTION OF FOOD BACTERIAL PATHOGENS
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1025694
Grant No.
2021-67021-34256
Cumulative Award Amt.
$500,000.00
Proposal No.
2020-08945
Multistate No.
(N/A)
Project Start Date
Mar 1, 2021
Project End Date
Aug 30, 2025
Grant Year
2021
Program Code
[A1541]- Food and Agriculture Cyberinformatics and Tools
Recipient Organization
UNIVERSITY OF CALIFORNIA, DAVIS
410 MRAK HALL
DAVIS,CA 95616-8671
Performing Department
Viticulture & Enology
Non Technical Summary
Detection of bacteria in food and agriculture environments is vital for ensuring the safety, shelf life, and security of food. Current detection technologies, however, require significant human and laboratory resources to process and prepare samples, run analysis, and interpret the results, ultimately limiting the efficiency and scalability of existing on-site pathogen detection systems. To address these challenges, the proposed research aims to develop an artificial intelligence (AI) platform for the detection of viable bacterial pathogens that can deliver results within a single work shift (less than 6 hours) at a food production facility. The specific goals of this research are: (a) Develop an AI-based framework for specific detection of viable bacterial pathogens in mixed microbial cultures containing commensal microbes and (b) Evaluate point-of-use detection of target pathogens in a simulated limited testing resource environment using an automated, low-cost "edge AI" data acquisition and analysis platform for food and environmental samples. The research plan is based on a combination of AI and bacteriophages to provide highly specific and rapid detection of viable pathogens using simple microscopy methods. Bacteriophages provides specific microscopic transformation of target viable pathogens that is detected using AI based image analysis in the presence of commensal bacteria. The edge AI compute capabilities enable deployment of AI technologies in field applications including local micro labs with limited resources in food processing and packing house facilities. Overall the proposal addresses the unmet needs for rapid and specific detection of low numbers of viable pathogens in food and environmental samples.
Animal Health Component
80%
Research Effort Categories
Basic
20%
Applied
80%
Developmental
0%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
71240102020100%
Goals / Objectives
Detection of bacteria in food and agriculture environments is vital for ensuring the safety, shelf life, and security of food. Current detection technologies, however, require significant human and laboratory resources to process and prepare samples, run analysis, and interpret the results, ultimately limiting the efficiency and scalability of existing on-site pathogen detection systems. To address these challenges, the proposed research aims to develop an artificial intelligence (AI) platform for the detection of viable bacterial pathogens that can deliver results within a single work shift (less than 6 hours) at a food production facility. The specific goals of this research are: (a) Develop an AI-based framework for specific detection of viable bacterial pathogens in mixed microbial cultures containing commensal microbes and (b) Evaluate point-of-use detection of target pathogens in a simulated limited testing resource environment using an automated, low-cost "edge AI" data acquisition and analysis platform for food and environmental samples.
Project Methods
Obj. 1: Develop an AI-based framework for specific detection of viable bacterial pathogens in mixed microbial cultures containing commensal microbes. In this objective, we will generate microscopic AI training data sets at multiple levels of complexity: (a) a mono-culture of pathogens and (b) a mixed culture of pathogens plus commensal bacteria; both before and after phage-induced lysis (i.e. training input images). Pathogens will be stained using DNA or membrane specific dyes and used for automatically annotating their occurrence, type, and location within microscopic images (i.e. training annotation images). Next, these training input and annotation images will be used use to a train a custom deep neural network (DNN) model to detect the presence of specific pathogens. The specificity and sensitivity of the DNN model to detect pathogens will be evaluated using both label-based and label-free imaging datasets. The mono and mixed cultured bacteria will be labeled for test cases using a DNA specific stain. For the label-free approach, imaging data sets for test cases will be generated using phase contrast and differential interferometry contrast imaging. The specificity and sensitivity of AI model predictions will be validated using standard plate counting assay and RT-PCR. Success in this aim will enable AI based detection of 1-10 CFU/ml of pathogenic bacteria in the presence of commensal microbes within a single work shift (4-6 hours).Obj. 2 Evaluate point-of-use detection of target pathogens in a simulated limited testing resource environment using an automated "edge AI" data acquisition and analysis platform for food and environmental samples. In this objective, we will develop a low-cost AI-enabled hardware system that (a) directly interfaces with microscopes commonly found at food processing facilities and (b) runs the models developed in Objective 1 locally without internet transmission to the cloud (i.e. "on the edge"). We will test the capacity of this "edge AI" data acquisition and analysis platform to detect food-borne pathogens for distinct and common microbial samples in the food industry. These samples will include liquid raw juice samples, fresh produce and meat samples as well as swab samples from environmental monitoring. These distinct samples are selected as they represent diversity of microbial and food backgrounds. Success in this research will transform the current diagnostic paradigm and enable the development of rapid diagnostic approaches to detect bacterial pathogens in food and agriculture systems.

Progress 03/01/23 to 02/29/24

Outputs
Target Audience: The results of this project address the unmet needs for rapid and specific detection of low numbers of viable pathogens in food and environmental samples within the agriculture and food processing industries. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided? This project has supported the research training of a postdoctoral scientist during the past year. This postdoc has presented their findings at professional and academic conferences. How have the results been disseminated to communities of interest? The results of this project were disseminated through research presentations at meetings at UC Davis and other institutions. What do you plan to do during the next reporting period to accomplish the goals? 3. Develop a low-cost mobile AI-enabled hardware system and run the model developed in the past year locally without internet transmission to the cloud (i.e., "on the edge").

Impacts
What was accomplished under these goals?

Publications

  • Type: Journal Articles Status: Under Review Year Published: 2024 Citation: Hyeon Woo Park, J. Mason Earles, and Nitin Nitin. Rapid detection of yeasts in food: A deep learning-based approach using convolutional neural networks and generative adversarial networks.


Progress 03/01/22 to 02/28/23

Outputs
Target Audience:The results of this project address the unmet needs for rapid and specific detection of low numbers of viable pathogens in food and environmental samples within the agriculture and food processing industries. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?This project has supported the research training of a graduate student and two postdoctoral scientists during the past year. These graduate students and postdocs have presented their findings at professional and academic conferences. How have the results been disseminated to communities of interest?The results of this project were disseminated through research presentations at meetings at UC Davis and other institutions What do you plan to do during the next reporting period to accomplish the goals?1. Evaluate the AI-microcolony framework for pathogen detection in mixed microbial cultures containing commensal microbes. 2. Develop more imaging options to increase the adaptability of AI-based framework in different settings of agriculture and food processing industry. In this area, we plan to investigate the phage amplification approach. While phages induce morphological changes in target bacterial cells, they also amplify which can be detected by the increase of signals as a function of time. With a phage-infection time of 1 hour, the progeny phages will be generated and released from the lysed bacterial cells. Since phage particles can be observed using fluorescence DNA staining dye and fluorescence microscopy, phage particles can be enumerated using a simple image analysis. The amplification of the phage particles number indicates the presence of the target bacteria. To apply this method in detection of bacteria in environmental samples with high background noise such as agricultural water, AI approaches may facilitate recognizing phage particles against background noise allowing improved detection sensitivity. 3. Develop a low-cost mobile AI-enabled hardware system and run the model developed in the past year locally without internet transmission to the cloud (i.e., "on the edge").

Impacts
What was accomplished under these goals? A major study was conducted with the follow goals/outcomes. In assessing food microbial safety, the presence of Escherichia coli is a critical indicator of fecal contamination. However, conventional detection methods require the isolation of bacterial macrocolonies for biochemical or genetic characterization, which takes a few days and is labor-intensive. In this study, we show that the real-time object detection and classification algorithm You Only Look Once version 4 (YOLOv4) can accurately identify the presence of E. coli at the microcolony stage after a 3-h cultivation. Integrating with phase-contrast microscopic imaging, YOLOv4 discriminated E. coli from seven other common foodborne bacterial species with an average precision of 94%. This approach also enabled the rapid quantification of E. coli concentrations over 3 orders of magnitude with an R2 of 0.995. For romaine lettuce spiked with E. coli (10 to 103 CFU/g), the trained YOLOv4 detector had a false-negative rate of less than 10%. This approach accelerates analysis and avoids manual result determination, which has the potential to be applied as a rapid and user-friendly bacterial sensing approach in food industries.

Publications

  • Type: Conference Papers and Presentations Status: Published Year Published: 2022 Citation: Yi, J., Wisuthiphaet, N., Raja, P., Nitin, N, Earles, M. Combining AI and biosensing for rapid pathogen detection in food and agricultural water. UC Davis 7th Annual Postdoctoral Research Symposium-Selected Rapid Talk, Davis, CA, Mar 2022.
  • Type: Conference Papers and Presentations Status: Published Year Published: 2022 Citation: Yi, J., Wisuthiphaet, N., Raja, P., Nitin, N, Earles, M. Combining AI and biosensing for rapid pathogen detection in food and agricultural water. UC Davis 7th Annual Postdoctoral Research Symposium-Selected Rapid Talk, Davis, CA, Mar 2022.
  • Type: Journal Articles Status: Published Year Published: 2023 Citation: L Ma, J Yi, N Wisuthiphaet, M Earles, N Nitin (2023). Accelerating the detection of bacteria in food using artificial intelligence and optical imaging. Applied and Environmental Microbiology 89 (1), e01828-22


Progress 03/01/21 to 02/28/22

Outputs
Target Audience:The results of this project address the unmet needs for rapid and specific detection of low numbers of viable pathogens in food and environmental samples within the agriculture and food processing industries. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?This project has supported the research training of a graduate student and two postdoctoral scientists during the past year. These graduate students and postdocs have presented their findings at professional and academic conferences. How have the results been disseminated to communities of interest?The results of this project were disseminated through research presentations at meetings at UC Davis and other institutions What do you plan to do during the next reporting period to accomplish the goals?1. Evaluate the AI-microcolony framework for pathogen detection in mixed microbial cultures containing commensal microbes. 2. Develop more imaging options to increase the adaptability of AI-based framework in different settings of agriculture and food processing industry. In this area, we plan to investigate the phage amplification approach. While phages induce morphological changes in target bacterial cells, they also amplify which can be detected by the increase of signals as a function of time. With a phage-infection time of 1 hour, the progeny phages will be generated and released from the lysed bacterial cells. Since phage particles can be observed using fluorescence DNA staining dye and fluorescence microscopy, phage particles can be enumerated using a simple image analysis. The amplification of the phage particles number indicates the presence of the target bacteria. To apply this method in detection of bacteria in environmental samples with high background noise such as agricultural water, AI approaches may facilitate recognizing phage particles against background noise allowing improved detection sensitivity. 3. Develop a low-cost mobile AI-enabled hardware system and run the model developed in the past year locally without internet transmission to the cloud (i.e., "on the edge").

Impacts
What was accomplished under these goals? Detection of pathogenic bacteria in food and environmental samples is vital for ensuing food safety, shelf life, and food security. However, timely detection of pathogenic bacteria is interfered with by complex and noisy environmental background matrices and requires a well-trained workforce. To this end, we developed an AI-biosensing platform for rapid and automated pathogen identification in food and agricultural water. Overall, this AI-biosensing platform can serve as a foundation of automated and accelerated AI-based pathogen detection in agriculture and food processing industries. Obj 1. Develop an AI-based framework for specific detection of viable bacterial pathogens in mixed microbial cultures containing commensal microbes: For this objective, we developed an AI-biosensing platform by training AI model to detect diffusive microscopic patterns of bacteriophage (phage)-induced lysis of target E. coli. We trained a convolutional neural network (CNN) object detection model with fluorescence microscopic images of bacteria labeled with DNA-specific dye and exposed to phages. E. coli and selected non-E. coli bacteria (i.e., Listeria innocua, Bacillus subtilis, Pseudomonas fluorescens) were used to generate training images, where phages induced lysis only in target E. coli cells. The results show that the trained AI model accurately predicted the number and locations of target E. coli cells for three different initial levels of initial loads, i.e., 10, 102, 103 CFU/mL. Moreover, the results show that the trained AI model could accurately detect and quantify E. coli in unseen food and agricultural water samples, including coconut water, spinach wash water, and irrigation water. The prediction accuracy was 80-100% in 403 images, depending on the sources of background noise (i.e., food debris, organic matter, commensal microbes). In addition, this AI-biosensing platform provides a rapid detection with a reduced assay time of 5.5 h, which within a single food processing work shift (4-6 h). The detection limit of this AI-biosensing platform was 10 CFU/mL, which was better or comparable to the sensitivity of other conventional pathogen detection methods such as plate counting assay and real-time quantitative polymerase chain reaction (RT-qPCR), given the samples prepared by 4-h bacterial enrichment. Obj 2. Evaluate point-of-use detection of target pathogens in a simulated limited testing resource environment using automated "edge AI" data acquisition and analysis platform for food and environmental samples: For this objective, we focused on developing a low-cost AI-based framework for pathogen detection that could potentially be applied to the food processing facilities without multiple sample preparation steps. To this end, we developed another AI-based framework where a model was trained on microscopic images of microcolonies (20-50 bacterial cells) without fluorescence labels or phages. Here, 8 distinct bacterial species, including Bacillus coaqulans, Bacillus subtilis, E. coli, Listeria innocua, Listeria monocytogenes, Pseudomonas fluorescens, Salmonella Enteritidis, and Salmonella Typhimurium, were investigated. The microcolonies of these bacterial species were incubated for 3 h prior to imaging, and the acquired images were split into training and test dataset. A CNN image classification model was then trained on training dataset and the prediction was performed on unseen test dataset, resulting in the accuracy of 87-100% across the bacterial species.

Publications

  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2021 Citation: Nitin, N. AI-Enabled Innovations in Food Systems, LLNL Data Science Seminar, 2021
  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2021 Citation: Nitin, N. Innovations in Food Safety with Machine Learning and Novel Antimicrobial Formulations, UIUC, 2022.
  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2022 Citation: Nitin, N. AI-Enabled Innovations in Validation of Sanitation and Detection of Pathogens, AI for food systems in the southeast US, Auburn University, 2022.
  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2022 Citation: Yi, J., Wisuthiphaet, N., Raja, P., Nitin, N, Earles, M. Combining AI and biosensing for rapid pathogen detection in food and agricultural water. UC Davis 7th Annual Postdoctoral Research Symposium-Poster Presentation, Davis, CA, Mar 2022.
  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2022 Citation: Yi, J., Wisuthiphaet, N., Raja, P., Nitin, N, Earles, M. Combining AI and biosensing for rapid pathogen detection in food and agricultural water. UC Davis 7th Annual Postdoctoral Research Symposium-Selected Rapid Talk, Davis, CA, Mar 2022.
  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2022 Citation: Yi, J. Experimental and Computational Approaches for Food Safety and Process Control. NC-1023 Multi-institutional Food Engineering Seminar, Mar 2022.