Source: UNITED FRESH PRODUCE ASSOCIATION submitted to NRP
INCREASING PEER-TO-PEER TRAINING AND TECHNICAL CAPACITY THROUGH A LISTERIA ENVIRONMENTAL MONITORING CERTIFICATE PROGRAM FOR SPANISH-SPEAKING PRODUCE SAFETY STAFF
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1028722
Grant No.
2022-70020-37592
Cumulative Award Amt.
$200,000.00
Proposal No.
2022-01728
Multistate No.
(N/A)
Project Start Date
Sep 1, 2022
Project End Date
Aug 31, 2025
Grant Year
2022
Program Code
[A4182]- Regional FSMA Center
Recipient Organization
UNITED FRESH PRODUCE ASSOCIATION
1901 PENNSYLVANIA AVE NW STE 1100
WASHINGTON,DC 200063412
Performing Department
Food Safety & Technology
Non Technical Summary
Listeria monocytogenesis a deadly foodborne pathogen that targets pregnant women, their fetuses, the elderly and immunocompromised. Repeated foodborne outbreaks and recalls associated with L. monocytogenesand fresh produce has led to a need for expanded and targeted training and education to those who are involved in the growing, harvesting, packing, handling, holding, processing, and packaging of produce, regardless of the regulatory requirements to implement an environmental monitoring program (EMP).Environmental monitoring for Listeria spp. has long been regarded as a foundational component of the food safety plans for manufactured foods where ready-to-eat (RTE) food products may be at risk of contamination.The concept of environmental monitoring is still relatively new to the fresh produce industry. This is not reflective of a lack of food safety commitment, but likely due to the fact that fresh produce was not widely recognized as a source of listeriosis until advanced pathogen detection methods revealed these associations.Recent produce-related listeriosis outbreaks and recalls have increased industry awareness of the vulnerability that they face, resulting in a subsequent thirst for knowledge and resources to mitigate risk. Research clearly indicates that Listeria, including L. monocytogenes, can readily be found in produce packing and fresh-cut operations. Though many resources already exist to help guide the food industry in developing EMPs, they are often written from the perspective of processed food products and are not easily relatable to the broad variety of produce operation types. Additionally, many produce packing and processing operations struggle as their legacy operations were not designed with sanitation and hygienic design in mind. At the same time, trends and technology for fresh-cut produce (e.g., spiralized vegetables, fresh juices, etc.) create avenues for produce consumption in new ways and produced with new equipment.The produce industry in the U.S. includes many bilingual and Spanish-speaking employees, and a significant amount of fresh produce is additionally imported from Central and South American countries where Spanish is the first language. However, training is often developed and delivered in English, creating language and cultural barriers to the successful application of the information that is taught. Few comprehensive Spanish-language resources exist in the areas Listeria management in the produce industry.The proposed Collaborative Education and Training project will develop a Listeria produce safety training and education cohort program in Spanish, targeting small and medium size farms, produce packing and processing facilities, and other parts of the produce supply chain in the Southern United States. Because of the role that states are playing in providing education and enforcement this program will also be available to bilingual state produce regulatory program representatives. Organizing the trainings by cohort will provide an expanded learning environment which will promote critical thinking, engaged problem solving, and peer-to-peer coaching. Participants will be supported through ongoing mentorship throughout the two-month program, with the opportunity to advance and serve as trainers/mentors.Through the collaborative efforts of the International Fresh Produce Association, Food Safety Consulting & Training Solutions, LLC (Food Safety CTS), and the Association of Food and Drug Officials (AFDO), this proposed Listeria food safety training and education program will impact produce operations who may have language and/or financial barriers that prevent them from taking advantage of specialized trainings.
Animal Health Component
(N/A)
Research Effort Categories
Basic
(N/A)
Applied
(N/A)
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
7121199303050%
7121499303050%
Goals / Objectives
The proposed Collaborative Education and Training project will develop a Listeria produce safety training and education cohort program in Spanish, targeting small and medium size farms, produce packing and processing facilities, and other parts of the produce supply chain in the Southern United States, with the overarching goal of decreasing listeriosis illnesses related to fresh produce. Because of the role that states are playing in providing education and enforcement of 21 CFR 112 Produce Safety Rule (PSR), this program will also be available to bilingual state produce regulatory program representatives. Organizing the trainings by cohort will provide an expanded learning environment which will promote critical thinking, engaged problem solving, and peer-to-peer coaching. Participants will be supported through ongoing mentorship throughout the two-month program, with the opportunity to advance and serve as trainers/mentors.Through the collaborative efforts of the InternationalFresh Produce Association, Food Safety Consulting & Training Solutions, LLC (Food Safety CTS), and the Association of Food and Drug Officials (AFDO), this proposed Listeria food safety training and education program will impact produce operations who may have language and/or financial barriers that prevent them from taking advantage of specialized trainings.This project will address the key challengesand strategies for preventing L. monocytogenes contamination on farms (particularly packinghouses) and in produce processing and handling facilities, focusing on the southern region, based on our previous work and existing organizational relationships in this region and the unique demographic it represents. To accomplish this goal, we will develop a training program that includes both asynchronous modules and virtual, interactive experiential learning sessions facilitated by mentors, culminating in a formal program certificate. Supplemental Train the Trainer (TTT) materials will also be developed and taught virtually to further increase the L. monocytogenes and environmental monitoring training capacity within the participants' regions. Overall, the cohort training program will support national alignment in fresh produce Listeria management-based curriculum while leveraging regional partnerships to tailor discussions and activities to meet specialized needs of produce operations. The four objectives are:Raise awareness and understanding of L. monocytogenes risks and management specific to the fresh produce industry through the development of Spanish-language asynchronous interactive educational materials blended with live (online) instructionSupport long-term improvement in L. monocytogenes management by tailoring discussions and activities to meet the specialized needs of program participantsDevelop a sustainable model and increased training capacity for Listeria education within the produce industry by developing Spanish-language Train the Trainer (TTT) opportunitiesMeasure positive change in L. monocytogenes management programs through post-evaluations following learning experience
Project Methods
Approach to Objective 1 (Raise awareness and understanding ofL. monocytogenesrisks )The ADDIE development process will be used.Analysis: Development and finalization of course and learning objectives for the cohort learning experience and TTT program to ensure they are observable and measurable and also appropriate for a virtual learning environment.Design: Creation of a course design document (CDD) based on the project objectives. The CDD will take into account creating a learning experience full of personal reflection opportunities, networking, and real-life experiencesDevelopment: Course deliverables will be developed and translated into Spanish, including a Facilitator/mentor guide, participant guide, production manager guide, andsupporting materials forthe TTT program.Evaluation phase: We will use the first three levels of Kirkpatrick's Training Evaluation ModelThe proposed project willevolve raw, technical material on this topic into an interactive and engaging course. An AFDO educational design expert will adapt the existing technical content into an engaging learning experience and design the "train the trainer" materials. Food Safety CTS staff will translate these materials.Course content will be delivered through 8 asynchronous launch-now modules. The platform provides:Conversion of text-heavy content into an engaging learning experience.Assessment and quizzing options.Responsive design so learners can experience their learning on a device of their choosing.Interactivities based on the learning objectives.Over the course of the 2 months of asynchronous learning, 20 cohort participants will have 4, live virtual meetings as a cohort with threementorsto discuss outstanding questions and begin to apply the technical content to their situations.The course will be piloted toward the end of the first project year. Texas International Produce Association (TIPA) and the Southern Center are willing to identify and/or encourage participation in the program. Feedbackwill be used to modify the content, structure, or other aspects of the program. Select individuals from the pilot cohort will also serve as mentors for subsequent cohorts. We expect to train three cohorts of primary Spanish-speaking or bilingual produce industry professionals.Approach to Objective 2 (Support long-term improvement inL. monocytogenesmanagement)The target audience for this program is members of the produce industry in the southern region who may lack access to sufficient training and ongoing support to improve their Listeria management, as a result of time, financial, and/or language barriers. Training cohorts of up to 20 people will be assembled so that learners will benefit both from the comfort of working with individuals who are similar to them (in terms of commodity, type of operation, region, business size, etc.) as well as by learning from their peers facing similar challenges. Mentors fluent in Spanish will be identified amdbe assessed for specific qualifications related to both prior training experience as well as subject matter expertise in produce safety and Listeria management.We will leverage existing state and regional partnerships, utilizing their close regional relationships to market and communicate availability of the course, identify target members for these cohorts, and offer feedback prior to the course launch to assist in tailoring the live virtual sessions to meet the specialized needs of the cohort audience. Course information and registration will additionally be shared with the Produce Safety Alliance.The program's launch-now modules are specifically designed for flexibility and are not time-dependent. Participants' schedules will additionally be polled prior to scheduling the interactive live online sessions that are time dependent, to ensure the maximum amount of participation.Approach to Objective 3 (Develop a sustainable model and increased training capacity forListeriaeducation within the produce industry by developing Spanish-language Train the Trainer (TTT) opportunities)As described above, the project's educational design expert will use the ADDIE method to develop TTT materials opportunities, increasing the sustainability and impact of the program. Following each cohort iteration, cohort mentors will be responsible for identifying five high aptitude, highly motivated learners who, with further support, could lead their own cohorts, either as part of this funded program, or on their own, using the course materials.If these individuals are interested in becoming trainers, they will receive additional instruction during a supplemental virtual training session(s) and be provided with the Facilitator/Mentor guide. 1-2 TTT participants will then have the option of being paired with an experienced mentor and serve as an assistant mentor for a subsequent cohort in project year 2 or year 3. Based on their performance, they will be eligible to serve as mentors for the program beyond the project period, and will also be capable of coordinating training cohorts within their own region.IFPAwill maintain a list of 'trained' trainers and facilitate connections through an alumni or other email list, should trainers in the same region wish to collaborate on training cohorts to expand Listeria management and training capacity within their regions.At the conclusion of the grant period, course content suitable for dissemination will be uploaded to the NECAFS clearinghouse and/ or eXtension so that participants, particularly those who participated as TTT, can continue to implement the program.Approach to Objective 4 (Measure positive change inL. monocytogenesmanagement programs through post-evaluations following learning experience)Program Evaluation, Communication Plan & Reporting OutcomesBoth quantitative and qualitative input will be collected, analyzed, and provided. This will include the total number of cohorts, total number of participants who began the program, demographic information on participants based on type of operation, commodity(ies), role in the operation, and years in the produce industry. Demographic information will be aggregated and non-identifiable. The number of individuals who complete the two-month program will be reported, as well as the number of individuals who advance through the TTT process.Qualitative and quantitative feedback from the pilots will be collected and analyzed, and mentor feedback will also be solicited. Qualitative feedback on approaches that are successful for particular audiences, as well as the blended learning approach, will also be reported. Changes in knowledge and/or behavior of learners will be based on the Kirkpatrick Model:Level #1: ReactionWe will evaluate how the learners reacted to the training by asking questions that will establish the learner's thoughts. The questions will determine if the learners enjoyed their experience and if they found the content in the learning experience useful for their work. This feedback will be used to improve the mechanics of the program.Level #2: LearningA pre and post evaluation based on the course objectives will be taken by the learners. Results will be complied and compared against one another for improvement, andshared with the Southern Center and project groups. Improvements will be made to the program based on evaluation feedback.Level #3: Behavioral Change/TransferWe will determine if the learning is being applied by the learners. Each learner will complete a post-implementation follow-up 4-6 months after course completion with targeted quantitative and qualitative questions elucidating specific changes and improvements the learners have made to their food safety programs.

Progress 09/01/23 to 08/31/24

Outputs
Target Audience:The target audience for the course is Spanish-speaking workers employeed in the U.S. produce industry, with a focus on the southeastern region of the United States. A secondary audience is regulatory professionals (mainly state representatives) responsible for inspecting produce farms, including packinghouses, and evaluating sanitation and hygienic design of equipment which could be associated with Listeria risk. The target audience for the Train-the-Trainer (TTT) supplemental training is Spanish-speaking produce safety experts, whether from industry (preferably), regulatory agencies or academia, who demostrate competence in content and delivery of Listeria management information. Changes/Problems:In 2024, the International Fresh Produce Association expereinced 100% staff turnover meaning the original team who initiated this project left the organization and there was a delay in progress while those positions were backfilled and the new staff brought up to speed. Unfortunately, there was little to no overlap between the departing original team members and the new team members brought in to backfill those positions so the knowledge transfer was incomplete. Thisfurther exacerbated delays on sevearl of the project tasks including the execution of the train-the-trainer program and follow up with past co-horts. Now that the staff is back to 100% capacity and the new team members have been onboarded and are up to speed on the project, no further delays are expected in 2025. What opportunities for training and professional development has the project provided?We continue to improve and deliver our Listeria management training to Spanish-speaking workers employed in the produce industry. Since the inception of this program, we have reached 38 participants (16 in 2023 and 22 in 2024). Of those in 2024 training cohort, 7 volunteered to complete the TTT course in 2025 (scheduled for January/February 2025). The 2023 TTT cohort has committed to using the developed course to train their co-workers within their fresh produce company. Additionally, 2 of 5 reported the intent to involve, and train key partners outside of their facility, such as U.S. based growers and foreign suppliers. How have the results been disseminated to communities of interest?Evaluation findings are being used to improve the 2025 training as well as to inform the TTT course. Additionally, due to 100% staff turnover at IFPA, several project tasks were delayed, such as monitoring if the previous TTT cohort delivered this training to their co-workers and the next volunteers undergo the improved TTT. These project activities will be reported during the next reporting period. Additionally, feedback from one participant suggested that marketing should highlight this is a basic course. Consequently, an advanced short course is being proposed for release in 2026. The advanced course will center around higher-level knowledge of Listeria management. What do you plan to do during the next reporting period to accomplish the goals?In 2025 we will establish a formal protocol to conduct routine follow-up with the TTT participants to ensure they have the support needed to ensure completion of local training programs. Also, we will be reviewing and updating our evaluation tools. In addition, we will conduct a retrospective assessment of past participants to understand how the knowledge they gained during this course has been incorporated into the food safety programs at their company. These findings will be used to further inform future program evaluation. Finally, we will be developing a plan for socializing awareness of the content developed under this grant to make the curriculum available to other groups once the grant term ends. Given that Spanish is the second most common language behind English within the produce industry, this is critical that this course continue to be offered to Spanish-speaking workers.

Impacts
What was accomplished under these goals? Objective 1: The training curriculum was created and piloted with 16 participants in 2023. Evaluation data was positive. Additionally, we received constructive feedback, such as, increasing the communication and interactive assignments to strengthen relationship between mentor and mentee and track progress, and ways to improve the delivery of the content in the learning platform. All feedback was considered and used to improve training delivery in 2024. In April/May 2024, 22 participants completed the training. Participants received information about Listeria management specific to the produce industry, engaged in discussions of real-world scenarios, to allow for customized strategies to better manage Listeria in produce operations. Post-training evaluation data demonstrated that 80% of the participants showed an increased awareness and understanding of L. monocytogenes risk and 100% increase in awareness in the importance of proper management of L. monocytogenes in fresh produce operations. Objective 2: Previously developed English-language guidance documents were translated into Spanish for use by training participants, mentors/facilitators, and project collaborators. During Summer 2024, a Spanish-speaking student intern was hired to review the accuracy of translated content documents. No changes were made to the content, but several copy edits were made to better align the Spanish course with the English version. Objective 3: An updated version of afour-hour Train-the-Trainer (TTT) course underdevelopment was updated based on feedback from the 2023 and 2024 instructors. Seven of 22 participants from the 2024 cohort volunteered to participate in the TTT course in early 2025. This experience will allow new trainers to deliver the content as co-trainers for workers in their facilities. From the TTT under developement and administered in 2023,individuals volunteered to collectively train at least 25 produce industry professionals within their companies and/or supply chains. Scheduling these courses has been a challenge due to business-related circumstances, such as being in high season and shortage of staff. Objective 4: Evaluation data from participants and mentors from the 2024 Cohort included two suggestions for improving the curriculum. General improvements include: (1) increased and consistent time slot to accommodate a more in-depth discussion with larger groups and (2) more examples or case studies where practical approaches are needed to manage Listeria. The positive change after the course was reflected in the participants' personal understanding of Listeria as measured through participant pre- and post-course surveys.For example, there was an increased awareness of the practical and economic implications of pathogen presence in one's facility. To mitigate this risk, it is important to build a strong team internal and external to the operation to better troubleshoot and manage pathogen presence.

Publications


    Progress 09/01/22 to 08/31/23

    Outputs
    Target Audience:The target audience of the 8-module training, supplemented with four live-online sessions and mentoring, is Spanish-speaking produce safety professionals and other Spanish speakers with produce safety responsibilities in the Southeastern United States. A secondary audience for the training is regulatory professionals (mainly state representatives) responsible for inspecting produce farms, including packinghouses, and evaluating sanitation and hygienic design that drives Listeria risk. The target audience of the "train the trainer" supplemental training is Spanish speaking produce safety experts, whether from industry (preferably) or from regulatory agencies or academia, who show a strong grasp of the subject matter based on the successful completion of the initial training program and who can serve as effective communicators of the content. Changes/Problems:One unanticipated challenge was the participant's comfort level with the online platform and clear expectations around preparation for each live session and required exercises to complete the course. To address this challenge, we have added on an additional 'live' session prior to the true start of the course to asnwer any questions from participants about the online training platform, live session details, and expectations for completion of assignments built into the course. A handful of participants did sign up relatively late, and therefore did not have much time to prepare for the start of the course. All marketing activities and registration processes will occur significantly earlier than the pilot. In addition, trainers for the course will be assigned "mentees" to do periodic check ins throughout the course to ensure they do not have any questions or misunderstanding in the expectations for course completion. This is in addition to the mentorship already provided for the technical content (e.g., reviewing EMP plans, course assignments). What opportunities for training and professional development has the project provided?As this project is focused on developing and delivering training the the identified underserved audience, the pilot was our first step in achieving the proposal's goals. As noted above, the first pilot of the Spanish-language training was conducted in May-June 2023 with current plans for developing 5 trainers from that cohort in a TTT course this fall. How have the results been disseminated to communities of interest?Though there are not currently "results" to share with the communities of interest, a focused marketing campaign was conducted in spring of 2023 to recruit participants for the pilot training in May/June. After the completion of the TTT course this fall, it is our intent to continue to share the value of attending this course and garner interest in developing additional trainers to impart a multiplier effect. What do you plan to do during the next reporting period to accomplish the goals?In the next reporting period, we will be conducting the first Train-the-Trainer Course with 4-5 individuals from the first training cohort. From there, these individuals will be prepared and matched with experienced trainers to assist with a participant course in 2024. Revisions to the course based on feedback and evaluations from the pilot will be incorporated.

    Impacts
    What was accomplished under these goals? Under the first objective, a pilot training course was held with 17 participants from the target audience in May/June 2023. Participants received information on Listeria management specific to the produce industry, thereby raising their awareness to the potential issue. To support the second objective, discussions and activities were tailored from the English course to meet the needs of a Spanish-speaking audience. In addition, a summar intern developed supplemental resources which can be utilized by future trainers of the course for additional outreach to produce industry members or for use directly with the established course materials. The objectives under the third bullet are currently underway. A four hour Train-the-Trainer course has been developed and currently being translated. Five individuals have been identified from the first training cohort to participate in the TTT course in Nov/Dec 2023. This multiplier effect will allow new trainers to co-train in 2024 with experience trainers to deliver the participant's course. Evaluations from the pilot from both participants and the instructors leading the course have been incorporated into the TTT content and will be revised for the 2024 offering of the participant's course. Postive change was noted by all participants who enrolled in the pilot, with constructive feedback noted for future improvements.

    Publications