Source: SOUTHERN ILLINOIS UNIV submitted to NRP
ENHANCING FOOD SAFETY: RAPID DETECTION OF SALMONELLA IN ONIONS USING MICROSCOPIC IMAGING AND ARTIFICIAL INTELLIGENCE
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1033143
Grant No.
2024-70001-43667
Cumulative Award Amt.
$150,000.00
Proposal No.
2024-02854
Multistate No.
(N/A)
Project Start Date
Aug 15, 2024
Project End Date
Aug 14, 2026
Grant Year
2024
Program Code
[NLGCA]- Capacity Building Grants for Non Land Grant Colleges of Agriculture
Recipient Organization
SOUTHERN ILLINOIS UNIV
(N/A)
CARBONDALE,IL 62901
Performing Department
(N/A)
Non Technical Summary
Foodborne illnesses, especially those caused by Salmonella bacteria, continue to be a major public health issue, impacting millions of Americans annually. These infections not only cause personal suffering, but they also have a significant impact on the economy through medical expenses and reduced productivity. Ensuring the safety of our food supply, particularly in widely consumed products such as onions, is of utmost importance for the health and well-being of the public. Conventional techniques for identifying harmful bacteria in food can be quite time-consuming, often taking several days to produce results. This delay increases the risk of contaminated products reaching consumers before the issue is detected. This project is focused on tackling a pressing problem by creating a quicker and more effective method for identifying Salmonella contamination in onions. It utilizes state-of-the-art technology that combines microscopic imaging with artificial intelligence (AI). In order to accomplish these objectives, we will create and deploy an advanced AI system that can analyze images from phase-contrast microscopes. This system will be able to detect the presence of bacteria in onion samples. Through the utilization of deep learning models and a vast dataset of labeled bacterial images, our objective is to develop a system capable of swiftly and accurately detecting Salmonella. This entails nurturing bacterial samples, capturing intricate microscopic images, and utilizing these images to train our AI models in identifying Salmonella microcolonies. We will also participate in a wide range of educational activities, such as workshops and training sessions, to share this technology with food safety professionals, researchers, and industry stakeholders. This project has a significant potential impact as it aims to improve food safety protocols, decrease the occurrence of foodborne illnesses, and establish a model for incorporating AI into food safety practices. This will lead to a greater safety in food consumption, decreased healthcare expenses, and a stronger public health infrastructure. The long-term goal, this approach has the potential to be applied to various food types and bacteria, which could greatly transform the way we guarantee food safety throughout the entire food supply chain.
Animal Health Component
50%
Research Effort Categories
Basic
20%
Applied
50%
Developmental
30%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
7121451110050%
7035010208050%
Goals / Objectives
The major goal of this project is to develop and implement an innovative artificial intelligence (AI) system for rapid detection of Salmonella contamination in onions using microscopic imaging. This project aims to enhance food safety measures by enabling quick, accurate, and cost-effective identification of foodborne pathogens, specifically targeting Salmonella in onion samples. The overarching purpose is to significantly reduce the time required for pathogen detection compared to traditional culture-based methods, thereby improving food safety protocols and potentially preventing foodborne illness outbreaks.To achieve this goal, the project has the following specific objectives:Construct a large-scale image dataset with labels to capture Salmonella Thompson cells in a model food system. This objective involves: a) Cultivating Salmonella Thompson and E. coli K-12 strains under various conditions. b) Preparing and imaging onion samples inoculated with these bacterial strains. c) Capturing high-resolution microscopic images of bacterial microcolonies at different growth stages. d) Annotating and categorizing the images to create a comprehensive dataset for AI model training. Attainability: This objective is achievable within the first year of the project, utilizing 0.7 FTE of the post-doctoral researcher (1.0 FTE in Year 1) and 0.022 FTE of the faculty member. The Olympus IX70 Inverted Phase Contrast DIC Fluorescence Microscope and Seward Stomacher 400 Circulator Blender will be crucial for sample preparation and imaging. The team aims to collect and annotate approximately 1,800 images (1,400 Salmonella, 400 E. coli) within this timeframe. Administrative support (0.05 FTE) will assist with procurement and scheduling. Part of PI's effort 0.022 FTE includes overseeing dataset creation and team coordination. Departmental support (0.05 FTE) will assist with procurement of supplies and scheduling of imaging sessions.Develop real-time, efficient, and automated deep learning models for early detection ofSalmonella in foods. This objective includes: a) Designing and implementing a CNNarchitecture, such as YOLOv4, for bacterial microcolony detection and classification. b) Training the AI model using the curated image dataset to recognize and differentiate Salmonella from other bacterial species. c) Optimizing the model for high accuracy, sensitivity, and specificity in detecting Salmonella contamination. d) Validating the model's performance against standard laboratory methods for Salmonella detection.Attainability: This objective will be primarily addressed in Year 2, utilizing 0.025FTE of the faculty member and 0.3 FTE of the graduate student. The high-performance computing cluster at the university will support the intensive computational requirements for AI model development and training. The team plans to develop and optimize the CNN model within approximately 6-8 months.Administrative support (.025 out of0.05 FTE) will assist with data management and reporting.Part of PI's effort 0.025 FTE in Year 2 includes supervising model development and validation. Departmental support (0.025 FTE (half of the 0.05 FTE allocated)) will assist with data management and progress reporting.Conduct educational transfer activities to promote the incorporation of AI in food science materials and extension programs. This objective involves: a) Organizing and delivering workshops on AI applications in food safety for students, faculty, and industry professionals. b) Developing training materials on microscopic imaging techniques, data curation, and AI model development for food safety applications. c) Providing hands-on experience with the developed AI system to participants. d) Assessing the effectiveness of the educational programs through pre- and post-workshop evaluations.Attainability: This objective will be spread across both years, using approximately 0.0125 FTE out of 0.05 FTE of the faculty member each year. Two workshops are planned: one in the latter part of Year 1 and another in Year 2. The post-doctoral researcher (0.1 FTE) will assist in developing materials in Year 1, while the graduate student (0.1 FTE) will help with the Year 2 workshop. The team aims to train 5-10 participants over the training sessions.Departmental Administrative support (.025 out of0.05 FTE) will handle logistics and participant coordination.Disseminate these technologies to relevant food industry stakeholders and agencies to encourage the integration of AI-enabled imaging sensors for predictive food safety monitoring and smart decision making. This objective includes: a) Presenting research findings at relevant scientific conferences and industry events. b) Publishing results in peer-reviewed journals and open-access platforms. c) Creating a dedicated webpage to showcase the project's progress and outcomes. d) Engaging with food safety regulators and industry leaders to promote adoption of the developed technology.Attainability: This objective will be ongoing throughout the project, intensifying in the second year. It will utilize approximately 0.0125 FTE out of 0.05FTE of the faculty member each year. The team plans to submit at least one peer-reviewed publication and present at one major conference. The post-doc and graduate students (0.1 FTE) will assist in publications.DepartmentalAdministrative supportwill assist with travel arrangements, publication submissions, and stakeholder communication.
Project Methods
The project will be conducted through the following approaches:1. Preparation of Bacterial InoculumandDevelopment of Image Dataset:Cultivation of Salmonella Thompson and E. coli K-12 strains under controlled laboratory conditions.Preparation of onion samples spiked with known concentrations of bacterial cultures.Utilization of the Olympus IX70 Inverted Phase Contrast DIC Fluorescence Microscope to capture high-resolution images of bacterial microcolonies at various growth stages.Collection of approximately 1,800 images (1,400 Salmonella, 400 E. coli) over multiple experimental runs.Annotation and labeling of images to create a comprehensive dataset for AI model training.2. Deep Learning Model Development:Implementation of CNNarchitecture, specifically YOLOv4, using Python and the PyTorch framework.Division of the image dataset into training (60%), validation (10%), and test (30%) sets.Training of the CNN model using the annotated image dataset, with iterative refinement based on validation set performance.Optimization of model hyperparameters to maximize detection accuracy and minimize false positives.Validation of the final model using the held-out test set.3. Experimental Validation:Application of the optimized AI model to detect Salmonella in mixed culture samples containing both Salmonella and E. coli.Comparison of AI model predictions with results from standard selective agar plating methods.Statistical analysis of model performance, including calculation of sensitivity, specificity, and overall accuracy.4. Technology Transfer and Educational Activities:Development of curriculum materials on AI applications in food safety.Organization of two hands-on workshops (one per year) for students, faculty, and industry professionals.Incorporation of practical demonstrations using the developed AI system.Dissemination of Results:Preparation and submission of research findings to peer-reviewed journals.Presentation of results at relevant scientific conferences.Efforts to Cause Change:Presentations at conferences, publications in journals, and webinars to share research findings.Development of training materials and workshops to educate food safety professionals and students.Training workshops to demonstrate the use of AI-based detection methods in real-world settings.Pilot programs to test the technology in food industry operations.Implementation of AI detection methods in food safety protocols to reduce foodborne illnesses.The performance of the AI model will be evaluated using standard metrics in machine learning and food safety:Accuracy: Percentage of correct predictions (both positive and negative) among the total number of cases examined.Sensitivity: Ability of the model to correctly identify positive samples (true positive rate).Specificity: Ability of the model to correctly identify negative samples (true negative rate).F1 Score: Harmonic mean of precision and recall, providing a single score that balances both metrics.Evaluation Plan:Continuous Monitoring Milestones:Reduction in time required for Salmonella detection in participating facilities.Development of AI model with >90% accuracy in Salmonella detection.Conduct two workshopsImplementation of AI system in at least one food processing facility for trial use.Publication of at least one peer-reviewed article and presentation at one conference.Summative EvaluationsEvaluation of dataset diversity, model performance, and educational workshop effectiveness.Model performance metrics (accuracy, sensitivity, specificity, F1 score).Pre- and post-workshop surveys to assess knowledge gain.Publication metrics (citations, downloads) and conference feedback.

Progress 08/15/24 to 08/14/25

Outputs
Target Audience:During the reporting period untilAugust 31, 2025, our project efforts focused on engaging and informing a broad spectrum of target audiences within the fields of food safety, artificial intelligence (AI), and computational biology. These audiences included academic researchers, students, industry professionals, and interdisciplinary scientists interested in the application of AI for food safety. We reached researchers and scholars in fields such as food safety, microbiology, AI, computing vision, and image analysis through active dissemination of our work. Our team will presentresearch findings at major academic conferences, including the ICPP Companion '25: 54th International Conference on Parallel Processing Companion, San Diego, CA, USA, 8-11 September 2025 at the HARVEST Workshop, where our paper "XAIPath: Explainable AI for Salmonella Detection in Microscopic Onion Images" was accepted and well-received. Additionally, we presented as a position paper "From Pixel to Policy: AI-Driven Microbial Detection" at the BRICCs Research Data Management Conference, allowing us to engage in knowledge exchange and obtain valuable feedback from multidisciplinary researchers, thus contributing to scientific progress and encouraging collaboration. In addition, we submitted"Background-Aware Instance Segmentation for Early Detection of E. coli and Salmonella in Time-Stamped Microscopy Images", 24th International Conference on Machine Learning and Applications (AMLA), (Submitted) Dec 3-4, 2025. In addition, our participation in the ByteBoost Workshop at the University of Pittsburgh and the BIRCC and PACES Workshops 2025 with Texas A&M University--College Station, TX,enabled us to engage with technical audiences focused on scalable AI solutions. We presented our BactoDetect system, a high-performance bacterial detection platform using YOLOv8, targeting rapid and real-time pathogen identification in microscopy images. These presentations reached researchers and developers from the HPC and AI optimization sectors, particularly those working with NVIDIA H100 GPUs (on ACES HPC) and ARM-based A64FX (Ookmi) systems. During this period, a graduate student (June 2 to August 2, 2025) and a post-doctoral researcher (October 15, 2024, to August 31, 2025) were actively involved in data annotation, image acquisition, and early-stage modeling. They received hands-on training through research-based learning and exposure to interdisciplinary computational approaches. Media Coverage This project received national media coverage and public engagement: Food Safety Magazine USDA Awards Researcher $150,000 to Develop Rapid AI Detection System for Salmonella on Onions Food Safety News SIU Researcher Gets $150K Grant to Use AI for Salmonella Detection in Onions SIU Newsroom Feature Article SIU Researcher Gets $150K to Use AI to Prevent Food Poisoning Television Interview TV segment aired locally (12KFVS), where PI Dr. Anas Alsobeh discussed the project in the context of a recent McDonald's onion-linked E. coli outbreak. The interview emphasized the technology's potential to prevent similar events via rapid, AI-powered screening. Link: https://www.kfvs12.com/2024/10/30/siu-researchers-studying-how-ai-can-prevent-food-poisoning/ Invited Talks & Outreach Invited Speaker: Utah Onion Association Annual Meeting (2026) Host: Dr. Milena Oliveira, Utah State University Extension Topic: AI for Real-Time Pathogen Detection in Onion Processing Facilities Goal: Share results with growers and food safety specialists Date: Feb 2026. Planning underway for thefirst workshopto occur after full image annotation and preliminary results are analyzed. Target attendees include food safety specialists, agricultural researchers, and processors. In preparation for our first educational workshop (scheduled post-data collection), we began internal planning involving students and research assistants. Although the workshop has not yet been delivered during this reporting period, planning efforts have focused on curriculum design, outreach materials, and platform selection to maximize impact across stakeholder groups, including extension educators and food industry personnel. Overall, our engagement strategies during this period successfully reached stakeholders in academia, high-performance computing, and microbiology/food safety, laying a strong foundation for future outreach and technology transfer efforts aimed at translating this research into real-world applications. Changes/Problems:1. Data Collection Expansion Beyond Initial Scope (Positive Deviation) The number of microscopic images captured exceeded the original plan (from 1,800 to over 3,800). The initial imaging process yielded more high-quality, time-stamped samples than anticipated, especially across additional onion conditions and incubation times.This change enhanced the robustness of the dataset, increasing the training potential for AI models. No negative impact on budget or timeline; the effort was absorbed through efficient resource use and scheduling. 2. Extended Annotation Timeline Manual image annotation using CVAT took longer than originally anticipated due to the complexity of differentiating overlapping microcolonies and accurately tracking growth stages. High-resolution images with varying visual conditions required greater precision in bounding and polygon annotations for model training. This slightly delayed the handoff of the dataset to the modeling team, pushing initial deep learning experimentation by approximately 3-4 weeks. However, the impact was mitigated through parallel progress on model architecture design. 3. Change in Model Selection Strategy Initially, the project planned to use YOLOv4 for object detection. However, after preliminary experimentation, the team adopted YOLOv8 and added support for segmentation models like Mask R-CNN and CellPose. YOLOv8 provided improved speed, flexibility, and modularity. Mask R-CNN and CellPose were added to address detection of small and overlapping microcolonies, which YOLO alone could not adequately separate.This change has improved model performance and aligns better with the complexity of the biological data. Computational resource usage increased, but the university's HPC system accommodated this shift without additional cost. 4. Workshop Rescheduling The Year 1 educational workshop originally planned for late spring 2025 has been rescheduled to fall 2025. This adjustment was made to align with university scheduling, ensure participant availability, and allow incorporation of more finalized AI models into training content. No long-term effects on project outcomes. The delay will enhance the effectiveness of the workshop by allowing demonstration of more advanced tools. 5. Hire Graduate Student Assignment The graduate student was assigned to the project before June 2025. This isnot an effect of the project budget. With both researchers now active, the team is operating at full capacity. What opportunities for training and professional development has the project provided?The project has provided multiple training and development opportunities: A full-time post-doctoral researcher joined the project in October 2024 and has since received comprehensive interdisciplinary training that includes: Gained experience in purchasing lab equipment (stomacher, microscope). Hands-on experience in preparing and imaging contaminated onion samples using phase contrast and fluorescence microscopy techniques. Learning to annotate time-stamped microscopic images for AI training, organize large image datasets, and follow FAIR data practices. Participated in the design, implementation, and testing of real-time AI models, including YOLOv8 and segmentation models for detecting Salmonella and E. coli. Contributed to the preparation and submission of two academic papers, enhancing public speaking and scholarly writing skills. Participated in collaborative data processing and mentored a graduate student. A graduate student joined in June 2025 and engaged in structured learning experiences related to: Leadefforts in dataset annotation using CVAT software Introduction to object detection techniques and explainable AI (XAI) frameworks for foodborne pathogen analysis. Training in handling biological samples and operating imaging systems. Exposure to tools such as Python, LabelImg, and deep learning libraries (e.g., PyTorch, TensorFlow). Assisted in preparing conference presentations and workshop content for upcoming public outreach and stakeholder training events. Assisted in the HARVEST workshopand was awarded $1,500 to attend and present a poster. The team collaboratively prepared for the first hands-on training workshop on AI in food safety. This process offered learning opportunities in curriculum design, stakeholder communication, and translational research presentation. How have the results been disseminated to communities of interest?Conference Presentations and Submissions: "XAIPath: Temporal-Environmental Explainable AI Framework for Co-Contaminated Food Pathogen Detection in Microscopic Imaging" was accepted and will be presented at the 54th International Conference on Parallel Processing Companion (ICPP Companion '25) in September 2025. "From Pixels to Policy: Explainable AI for Microbial Detection in Food" was presented at the BRICCs Conference 2025 to an audience of many different researchers and data scientists. "Background-Aware Instance Segmentation for Early Detection of E. coli and Salmonella in Time-Stamped Microscopy Images" was submitted to the 24th International Conference on Machine Learning and Applications (ICMLA) for December 2025. Project progress and impact received significant public exposure through media outlets and institutional platforms: Featured in Food Safety Magazine (January 2025): "USDA Awards Researcher $150,000 to Develop Rapid AI Detection System for Salmonella on Onions." https://www.food-safety.com/articles/10084-usda-awards-researcher-150-000-to-develop-rapid-ai-detection-system-for-salmonella-on-onions Covered by Food Safety News: "SIU Researcher Gets $150,000 Grant to Use AI for Salmonella Detection in Onions."https://www.foodsafetynews.com/2025/01/siu-researcher-gets-150000-grant-to-use-ai-for-salmonella-detection-in-onions/ Highlighted by Southern Illinois University (SIU) in an official press release:https://news.siu.edu/2024/10/102924-siu-researcher-gets-150k-to-use-ai-to-prevent-food-poisoning.php A TV interview and university e-newsletters further amplified project visibility. Stakeholder Engagement PI Anas Alsobeh was invited to speak at the Utah Onion Association Meeting (2026) by Extension Vegetable Specialist Dr. Milena Oliveira (Utah State University), opening a potential collaboration with onion growers in Utah. What do you plan to do during the next reporting period to accomplish the goals?We plan to: Develop and Optimize AI Models for Bacteria Detection Finalize pre-processing of annotated image data (using CVAT Box and Pylogon tools). Train and evaluate segmentation and detection models (YOLOv8, ResNet, Mask R-CNN, ViT) on Salmonella and E. coli images. Perform model optimization to increase detection accuracy and reduce false positives/negatives, using cross-validation, hyperparameter tuning, and ensemble learning. Integrate time-stamped metadata (growth stage, temperature, incubation conditions) for temporal-aware detection models. Leverage institutional HPC clusters for efficient training and integrate XAI tools like Grad-CAM for model interpretability. Explore modular deployment options for food industry use (cloud + edge AI). Expand Stakeholder Engagement and Outreach Prepare for invited talk at the Utah Onion Association Annual Meeting, engaging growers and processors interested in emerging food safety technologies. Develop outreach materials including explainer videos and web content to simplify understanding of the AI detection system for non-technical stakeholders. Organize and Conduct Educational Workshops Host a hands-on AI and Imaging Workshop at Southern Illinois University for students, faculty, and food safety professionals, introducing them to: Microscopy image processing. AI model design for bacterial detection. Best practices for data annotation and model evaluation. Offer training modules for food scientists and lab technicians focused on how to integrate AI into routine food inspection processes. Assess participant knowledge and feedback to refine future training. Continue the dissemination of results. Present accepted papers and ongoing research at two major conferences: ICPP Companion 2025 (XAIPath paper, September 2025). ICMLA 2025 (Pending acceptance for segmentation model paper, December 2025). Submit an additional manuscript to a peer-reviewed journal focused on AI in food safety or applied microbiology. Publish dataset documentation and codebaseto Ag Data Commons and GitHub with digital persistent identifiers (DOIs) and proper attribution to USDA-NIFA funding. Advance Outreach and Partnerships: Maintain communication with Utah State University Extension for collaboration.

Impacts
What was accomplished under these goals? 1. Dataset Development and Image Annotation Successfully collected and cultured Salmonella Thompson and E. coli K-12 under varying conditions to simulate realistic contamination environments.We acquired over 3,800 high-resolution microscopic images using the Olympus IX70 Inverted Microscope, exceeding the original target of 1,800 images. These are images:(1)Salmonellawithoutonion (2)Salmonellawith onion (3) E. coli without onion (4) E. coli with onion. These collected over a growth period of 0.5 to 4 hours. We annotated bacterial microcolonies using CVAT (Computer Vision Annotation Tool), categorizing them by strain, onion presence, and growth stage. The dataset supports both classification and instance segmentation tasks using deep learning models. 2. Development of AI Models for Pathogen Detection A prototype object detection model using YOLOv8 was trained on the annotated dataset. Initial results indicate promising accuracy (>92%) in identifying early-stage microcolonies. A prototype object detection model was developed using YOLOv8. Preliminary results show >92% accuracy in identifying early-stage microcolonies. To improve model robustness, we applied background-aware segmentation and augmentation techniques to address image noise and overlapping colonies. Submitted: "Background-Aware Instance Segmentation for Early Detection of E. coli and Salmonella in Time-Stamped Microscopy Images" to the 24th International Conference on Machine Learning and Applications (ICMLA). Accepted: "XAIPath: Temporal-Environmental Explainable AI Framework for Co-Contaminated Food Pathogen Detection in Microscopic Imaging," to be presented at the ICPP Companion 2025. In Press: "From Pixels to Policy: RDM Strategies for AI-Driven Bacterial Detection in Food Safety Research," accepted to the BRICCs-RDM Conference in Alexandria, VA (July 2025) 3. Dissemination and Outreach Our work was presented at multiple national conferences and workshops: BRICCs Conference 2025: "From Pixel to Policy" ICPP Companion 2025: "XAIPath" (accepted) ByteBoost HPC Workshop: "BactoDetect: High-Performance Object Detection of Bacteria in Microscopic Images Using AI" Public and media engagement included: Coverage by Food Safety Magazine and Food Safety News University-wide press release from SIU Local TV coverage Formal invitation to present at the 2026 Utah Onion Association Annual Meeting 4.Education and Workforce Development Trained a post-doctoral researcher and the graduate students on advanced imaging and AI-based bacterial detection methods. Prepared workshop materials to be delivered in the next phase, integrating AI in food inspection processes. The graduate student and post-doc gained hands-on experience in microscopy imaging, annotation, and model development (YOLO, ViT, CellPose), preparing them for independent research roles.

Publications

  • Type: Conference Papers and Presentations Status: Accepted Year Published: 2025 Citation: AlSobeh, A., AbuGhazaleh, A., Dhahir, N., Rababa, M. "XAIPath: Temporal-Environmental Explainable AI Framework for Co-Contaminated Food Pathogen Detection in Microscopic Imaging." 54th International Conference on Parallel Processing Companion (ICPP '25 Companion), San Diego, CA, September 811, 2025. Status: Accepted. https://camps.aptaracorp.com/ACM_PMS/PMS/ACM/ICPPCOMPANION25/30/5b06d196-72fc-11f0-957d-16ffd757ba29/OUT/icppcompanion25-30.html#
  • Type: Conference Papers and Presentations Status: Submitted Year Published: 2025 Citation: Koirala, B., AlSobeh, A., Dhahir, N., AbuGhazaleh, A. "Background-Aware Instance Segmentation for Early Detection of E. coli and Salmonella in Time-Stamped Microscopy Images." Submitted to: 24th International Conference on Machine Learning and Applications (ICMLA), December 34, 2025. Status: Submitted.
  • Type: Other Status: Awaiting Publication Year Published: 2025 Citation: Anas AlSobeh, Malek Rababah, Namriq Dhar, Amer Abu Gazaleh, 2025. From Pixels to Policy: RDM Strategies for AI-Driven Bacterial Detection in Food Safety Research. Research Data Management (BRICCs-RDM) Conference, the Westin Alexandria Old Town, 400 Courthouse Square, Alexandria, VA 22314. July 9-11, 2025. (On press).