Source: UNIV OF IDAHO submitted to NRP
FOOD SAFETY EDUCATION AND BEHAVIORAL CHANGES AMONG DEAF AND HARD-OF-HEARING POPULATION: A MODEL STUDY
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
COMPLETE
Funding Source
Reporting Frequency
Annual
Accession No.
1000502
Grant No.
2013-68003-21279
Cumulative Award Amt.
$424,930.00
Proposal No.
2012-04292
Multistate No.
(N/A)
Project Start Date
Sep 1, 2013
Project End Date
Aug 31, 2019
Grant Year
2013
Program Code
[A4181]- Improving the Safety of Fresh and Fresh Cut Produce
Recipient Organization
UNIV OF IDAHO
875 PERIMETER DRIVE
MOSCOW,ID 83844-9803
Performing Department
(N/A)
Non Technical Summary
Foodborne illness remains an important public health issue while safety of fresh and fresh-cut produces are of increasing concern. Since cooking or kill steps to reduce pathogenic microorganism are not available, proper food handling practices are particularly important in preparation of fresh and fresh-cut produce. However, such control measures, as simple as hand washing, are not properly excercised among the public as well as food service employees. Therefore, it is important to identify barriers and factors affecting behavioral compliance to prevent foodborne illnesses. In addition, as about 16% of deaf and hard of hearing young adults are employed in food service industry with an increasing trend, it is necessary to provide an up-to-date produce safety education program before this hard-to-reach population enter into workforce. This project addresses such needs by developing a culturally sensitive education program destined for deaf and hard of hearing while unique strategies to promote behavioral compliance are investigated in this model system. To achieve this goal, mixed method research will be conducted including surveys, in-depth interviews, Delphi focus groups, and observation, followed by development of education materials and evaluation of progam effectiveness. Appointed partner organizations and an advisory board of experts in food safety, behavioral psychology, and deaf education will assist with research activities, implementation, and dissemination of this education program to stakeholders.
Animal Health Component
100%
Research Effort Categories
Basic
(N/A)
Applied
100%
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
7126010307050%
7126099302050%
Goals / Objectives
The long-term goal of our research is to promote food safety by changing behaviors of food handlers and consumers. The goal of this study is to develop a culturally sensitive fresh and fresh-cut produce safety education program for deaf and hard of hearing. In addition, barriers and factors influencing long-term behavioral changes will be investigated. This project will specifically target the deaf and hard of hearing population that often have limited access to up-to-date information and training in food safety with emphasis on safe handling of fresh and fresh-cut produce. We propose to achieve these goals by pursuing specific objectives of: (1) Evaluation of knowledge, attitudes, and handling practices towards fresh and fresh-cut produce using a mixed-methods approach for a nationally representative survey of deaf and hard of hearing complemented with in-depth interviews to understand the food safety culture among the target population, (2) Development of a culturally sensitive education strategy for deaf and hard of hearing on safe handling of fresh and fresh-cut produce using Delphi focus groups based on the findings from the survey and in-depth interviews, (3) Development of educational materials based on the identified education strategy for deaf and hard of hearing on safe handling of fresh and fresh-cut produce, (4) Implementation and evaluation of effectiveness of the education program by assessing the changes in knowledge, culture, and behavior toward fresh and fresh-cut produce handling after training with the education program, (5) Dissemination of the education program to stakeholders including schools for deaf and hard of hearing in the U.S.
Project Methods
All methods for the proposed study will be reviewed and approved by the Institutional Review Board (IRB) at University of Idaho (UI) prior to data collection. Objective 1: Evaluation of knowledge, attitudes, and handling practices towards fresh and fresh-cut produce using a mixed-methods approach of a nationally representative survey of deaf and hard of hearing complemented with in-depth interviews to understand food safety culture among the target population. To address the first objective, a mixed-method approach will be used to evaluate knowledge, attitudes, and handling practices regarding fresh and fresh-cut produce and foodborne illnesses. The first step will involve a national survey of deaf and hard of hearing between the ages of14-18. This survey will be used to collect quantitative data on the knowledge, attitudes, and self-reported handling practices among the target population. Results of the in-depth interviews as well as survey data will be used to develop the education strategy for deaf and hard of hearing (Objective 2). Additionally, the data collected will be submitted for presentation at a national meeting such as the International Association for Food Protection and Conference of Education Administrators of Schools and Programs for the Deaf. The results will be published in an appropriate peer-reviewed journal including Journal of Food Protection, American Annals of the Deaf, and Journal of the Rehabilitation for the Deaf. Objective 2: Development of a culturally sensitive education strategy for deaf and hard of hearing on safe handling of fresh and fresh-cut produce using Delphi focus groups based on the findings from the Objective 1. A food safety education strategy for the target population will be developed based on the two parts of studies in sequence: (i) the data collected from Objective 1 and (ii) Delphi focus groups. The strategy will be developed to be culturally sensitive for the deaf and hard of hearing so that the science based information on fresh and fresh-cut produce safety can be correctly and effectively understood by the target audience. The focus group is a useful research tool to investigate qualitative factors and to explore opinions and practices of participants towards given circumstances. A Delphi focus group brings together experts to explore specific topics, in this case the fresh and fresh-cut produce safety and effective education strategy for deaf and hard of hearing. The focus groups will be conducted to explore the development of strategies based on the data collected from the surveys and in-depth interviews in Objective 1. The focus groups will be conducted with the experts in produce food safety, food safety education, and deaf education. Objective 3: Development of education materials based on the identified education strategy for deaf and hard of hearing population on safe handling of fresh and fresh-cut produce. Education materials to train deaf and hard of hearing will be developed based on the results of Objective 1 and 2. A storyboard plan will be constructed in collaboration with media consultants at the UI Video Production Center and deaf friendly media technology services such as Deaf Empowerment Awareness Foundation, Inc. (DEAF, www.deafinc.org). Appropriate education media will be determined based on the preference identified during the survey. Possible media formats include Digital Versatile Disk (DVD), CD-ROM for computer-based training (CBT), or a web-based training (WBT) module. Objective 4: Implementation and evaluation of effectiveness of the education program by assessing the changes in knowledge, culture, and behavior toward fresh and fresh-cut produce following training with the education program. This objective will be achieved by conducting five steps of efforts: (i) Implementation of education program, (ii) Development of evaluation instruments, (iii) recruitment and selection of participants for program evaluation, (iv) Evaluation of education materials, and (v) Follow-up. Objective 5: Dissemination of the education program to stakeholders including schools for deaf and hard of hearing population in the U.S. Dissemination of the results will occur through a variety of means. A copy of the education materials will be sent to all survey respondents. Additionally, announcements for the fresh produce food safety education program will be sent to educational institutions and programs for deaf and hard of hearing in the U.S. The research team will also coordinate our effort to acknowledge the importance of fresh produce safety issues and benefits of the program by communicating with the teachers at the schools for deaf and hard of hearing. Depending on the educational medium used, the education program will be sent to the stakeholders upon request or a website will be developed to allow for access to the education program.

Progress 09/01/13 to 08/31/19

Outputs
Target Audience:The target audience for this project is Deaf and hard of hearing teenagers (14-18 years old). During this reporting period, deaf teenagers enrolled in the deaf schools in the states of California, Oregon, Utah, and Washington were reached. In addition, completed food safety education program was disseminated to the schools of deaf education nationwide. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?One master's and one doctoral students were trained to conduct studies with human subjects while they were conducting research in this project. How have the results been disseminated to communities of interest?Printed and electronic copies of all education materials including manual, lesson plan, and other materials for activity were printed and mailed to public/state schools for the Deaf in all 50 states. In addition, video was also made available online (YouTube) to reach broader audience. What do you plan to do during the next reporting period to accomplish the goals?While this project is completed and expired, the research team is planned to reach out to partner institutions for follow-up. The PD will also be made available for further comments and communication with the deaf community as well as the public to ensure maximum and prolonged impact of this food safety education program.

Impacts
What was accomplished under these goals? During the last and final project year, we completed production of video and accompanying education materials. In particular, the video was edited to be a total of 38 min 05 sec in length with six parts. The entire video segments were recorded in American Sign Language (ASL) and closed-captioned with an option to be on or off from the frame they are playing in YouTube. It should be noted that all characters appeared in the video are deaf and/or hard of hearing as the use of deaf and/or hard-of-hearing actors/actresses (i.e. native ASL users) was identified as most critical to maintain cultural sensitivity from both the surveys and in-depth interviews. In its content, measures to address concerns regarding fresh produce safety and food allergy were emphasized in addition to standard/traditional food safety. A corresponding written manual was developed to complement the video's educational material. In addition, a teacher's guide was prepared along with activities to enhance students' learning. To achieve Objective 4, completed food safety education program was implemented in classroom settings in collaboration with the partner institutions in Idaho, Oregon, Washington, and Utah - i.e. teachers in each school adopted this program and implemented in their classrooms. A total of 45 students participated from these four schools for implementation and evaluation. The participants received pre-test and the education with culturally sensitive safety education material developed for the target population. Since the implementation was done during the regular classroom hours, the intended food safety education was implemented over two separate days (classroom hours to meet the bell schedule). Results showed that the knowledge in food safety improved after implementation of food safety education program. In addition, students responded that their attitude and behavior toward handwashing improved. It may be noted that the results were varied depend on the location/school as the method of delivery by the classroom teacher was not exactly the same. Nonetheless, students appreciated the food safety education program over existing or previously encountered food safety related instruction as it was truly culturally appropriate and easy to understand. All teachers agreed that the effectiveness of food safety education program and willing to adopt as their regular classroom content. Printed and electronic copies of all education materials including manual, lesson plan, and other materials for activity were printed and mailed to public/state schools for the Deaf in all 50 states. In addition, video was also made available online (YouTube) to reach broader audience.

Publications


    Progress 09/01/17 to 08/31/18

    Outputs
    Target Audience:The target audience for this project is Deaf and hard of hearing teenagers (14-18 years old). During this reporting period, deaf teenagers enrolled in the deaf schools in the states of California, Utah, and Texas were reached. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided? Nothing Reported How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?The education materials will be introduced to the partnering institutions for testing with the target audience, teenagers between 14-18 years of age, in the deaf and hard of hearing school setting. Potential sites have been identified in Arizona, California, Oregon, Texas, Utah, and Washington. Participant will complete both pre- and post-test instruments. The purpose is to create a culturally appropriate food safety education program for this target audience to improve overall food safety education and provide participants with food safety related job skills to assist in their transition to life post-secondary education.

    Impacts
    What was accomplished under these goals? Because of the information gathered from the surveys, in-depth interviews, and Delphi Focus Group sessions (Objectives 1 and 2), team members began collaborating with the UI Video Production Center to develop culturally sensitive scripts and storyboards using ASL. Videos and still photographs were taken in Texas, California, and Utah using both educational and commercial sites. The scripts follow the FDA's 2017 Food Code to achieve 5 core videos: Introduction to Food Safety, Personal Hygiene, Food Handling, Temperature, and Cleaning and Sanitizing. An additional fun video was created to further emphasis the importance of handwashing using the GolGermTM product. One retail facility in Texas, owned and operated by a deaf family, employs only deaf and hearing-impaired individuals on their staff, serving both the hearing and deaf community. Employees participated as actors demonstrating behaviors including proper handwashing, the use of a three-compartment sink for manual ware-washing, and cleaning and storage of produce items as well as other food safety techniques. The use of deaf and hard of hearing actors was identified as being important to maintain cultural sensitivity from both the surveys and in-depth interviews. Instructors and students from the California School of the Deaf participated in demonstrating the importance of handwashing using GloGermTM to simulate germs in the kitchen environment. The footage was taken at the school in the student kitchen used for training students. A well-known deaf chef participated in editing the script and acting portions of the script for the video product to provide an introduction and conclusion to each video part. Finally, additional video footage and photographs were taken at the Utah School for the Deaf and Blind outside of Ogden, Utah, with the assistance of instructors, staff, students, and members of the local community as actors. Editing of the videos into 6 short segments began and is on-going. Closed captioning, another important element identified during Objectives 1 and 2 will also be incorporated. A corresponding written manual is being developed simultaneously to complement the video's educational material.

    Publications


      Progress 09/01/16 to 08/31/17

      Outputs
      Target Audience:The target audience for this project is Deaf and hard of hearing teenagers (14-18 years old). During this reporting period, deaf teenagers enrolled in the deaf schools in the states of Arizona, California, Idaho, Oregon, and Washington were reached. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?PD (Ryu) and a collaborator (Ball) attended the Council for the Deaf and Hard of Hearing meeting in Boise, Idaho, and introduced the project and discussed collaboration. How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?Based on the results of the in-depth interviews, Delphi focus group with deaf education experts will be conducted and analyzed. During the Delphi focus group, it is our goal to develop new culturally sensitive signs for "foodborne illness" and "food safety" to be included in ASL to achieve better communication and education for the Deaf and hard of hearing population. Such culturally sensitive signs will be introduced in the education program, including training videos, to allow penetration among the target population, which in turn to bring national attention and maximize the impact of the education program to be developed in this project. The results from the in-depth interview, including the gap in/among food safety knowledge, attitude, and practice will also be addressed during the focus group of deaf education experts. Beginning January 2018, the educational curriculum will be developed in collaboration with stakeholder groups including schools of Deaf culinary and career skills programs, national food safety education programs, and restaurants with experience training Deaf employees. Once completed, the education program will be introduced to the partner institution's curriculum followed by evaluation. The purpose is to create a culturally appropriate food safety education program for this target audience to improve overall food safety education and provide participants with food safety related job skills to assist in their transition to life post-secondary education.

      Impacts
      What was accomplished under these goals? We completed individual in-depth interview with Deaf and hard of hearing students to assess understanding of food safety concepts asked in the survey, attitudes towards food safety, perceived risk of getting food borne illness, perceived control in preventing food borne illness, food safety practices intentions, behaviors, and perceived norms. The interviews conducted in American Sign Language (ASL), each lasted 25-30 minutes, were video recorded and transcribed. We are now analyzing the data with emphasis on the barriers in learning food safety concepts and changing attitudes and practices towards food safety. Preliminary results showed that there is a lack of understanding in food safety concept partly due to inadequate or insufficient education. It was also found that appropriate signs for "foodborne illness" or "food safety" do not exist in ASL. Since the standard educational program and instruction for the Deaf and hard of hearing in the U.S. mainly rely on ASL, appropriate signs to define key concepts such as foodborne illness or food safety may be consideredcriticalin developing a culturally sensitive and effective food safety training program.

      Publications


        Progress 09/01/15 to 08/31/16

        Outputs
        Target Audience:The target audience for this project is Deaf and hard of hearing teenagers (14-18 years old). During this reporting period, deaf teenagers enrolled in the deaf schools in the states of California, Idaho, Oregon, and Washington were reached. Changes/Problems:One year no-cost extension was granted. What opportunities for training and professional development has the project provided?PD (Ryu) and his graduate research assistant (Hunter) attended International Association for Food Protection (IAFP) Annual Meeting (7/31 - 8/3/16) held in St. Louis, MO, to give an invited oral presentation on the progress of this project. How have the results been disseminated to communities of interest?An oral presentation on the progress of this project was made during the IAFP Annual Meeting. What do you plan to do during the next reporting period to accomplish the goals?The final in-depth interviews and Delphi focus group with deaf education experts will be completed and analyzed by November 2016. Based on the survey, interviews, focus groups, and literature review a culturally sensitive education strategy will be finalized by December 2016 (Objective 2). Beginning January 2017, the educational curriculum will be developed in collaboration with stakeholder groups including schools of Deaf culinary and career skills programs, national food safety education programs, and restaurants with experience training Deaf employees. The purpose is to create a culturally appropriate food safety education program for this target audience to improve overall food safety education and provide participants with food safety related job skills to assist in their transition to life post-secondary education.

        Impacts
        What was accomplished under these goals? After the development of an in-depth interview guide created to explore survey results, comprehension of food safety concepts, food safety behaviors, attitudes, and practices the interviews were piloted in both online and in-person sessions lasting 25-30 minutes. The interviews conducted in ASL were video recorded and transcribed. The interview questions were evaluated using a rubric for evaluating the quality and clarity of the interview guide based on interview technique best practices. Then, modifications were made to the final in-depth interviews included a more structured approach to assess understanding of food safety concepts asked in the survey, attitudes towards food safety, perceived risk of getting food borne illness, perceived control in preventing food borne illness, food safety practices intentions, behaviors, and perceived norms. The final in-depth interview is completed with emphasis to explore common food safety education concepts such as the FoodSafety.gov 4 steps to food safety program as well as ASL signs for food safety and other common terminology used in food safety education. These in-depth interviews conducted in ASL were videotaped and being transcribed for the data analyses. In addition, following the focus group studies conducted on July 26, 2015 at the International Association of Food Protection in Portland Oregon with a total of 15 food safety experts, another focus group guide is under development to identify culturally sensitive education strategies targeting deaf teenagers. The results from the in-depth interview, including the gap in/among food safety knowledge, attitude, and practice will also be addressed during the focus group of deaf education experts.

        Publications


          Progress 09/01/14 to 08/31/15

          Outputs
          Target Audience:The target audience for this project is Deaf and hard of hearing teenagers (14-18 years old). During this reporting period, deaf teenagers enrolled in the deaf schools in the states of Arizona, California, Idaho, Oregon, Texas, and Washington were reached. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?PD (Ryu) and his graduate research assistant attended the NIFA Project Directors' meeting (7/24/15) and International Association for Food Protection (IAFP) Annual Meeting (7/25 - 7/28/15) held in Portland, OR. How have the results been disseminated to communities of interest?A poster presentation on the pilot survey was made during the IAFP Annual Meeting. What do you plan to do during the next reporting period to accomplish the goals?The final in-depth interviews and Delphi focus group with deaf education experts will be completed and analyzed by November 2015. Based on the survey, interviews, focus groups, and literature review a culturally sensitive education strategy will be finalized by December 2015 (Objective 2). Beginning January 2016, the educational curriculum will be developed in collaboration with stakeholder groups including schools of Deaf culinary and career skills programs, national food safety education programs, and restaurants with experience training Deaf employees. The purpose is to create a culturally appropriate food safety education program for this target audience to improve overall food safety education and provide participants with food safety related job skills to assist in their transition to life post-secondary education.

          Impacts
          What was accomplished under these goals? As outlined in Objectives 1 Evaluation of knowledge, attitudes, and handling practices towards fresh and fresh-cut produce, the development of the national survey instrument ( modified from the pilot survey instrument) was completed in a print and online format with American Sign Language (ASL) translations . Survey participant recruitment occurred through outreach to Schools for the Deaf in all schools with 100+ students in grades 9-12. Participating schools and participants were from the following states California, Connecticut, Idaho, Indiana, Oregon, North Carolina, Maryland, Massachusetts, Texas, and Washington. A website (www.foodsafetysurvey.org) containing project information, parent or guardian information/consent forms, and ASL translation videos was developed and promoted in recruitment efforts. The survey was administered either on paper with accompanying ASL translations DVD or online (Qualtrics) with embedded ASL videos. A total of 298 participants completed the survey. Statistical analysis of the survey revealed a Cronbach's alpha score of 0.761 for the hand washing behaviors section indicating the internal reliability of the survey instrument was adequate in capturing the hand washing behavior constructs. The final survey was shortened and modified to improve readability, visual appeal, decrease fatigue, and address specific food safety knowledge, attitude, behavior, and perceived risk constructs. After the development of an In-depth interview guide created to explore survey results, comprehension of food safety concepts, food safety behaviors, attitudes, and practices the interviews were piloted in both online and in-person sessions lasting 25-30 minutes. The interviews were video recorded. Transcriptions of both the translated interview and participant ASL were completed. The interview questions were evaluated using a rubric for evaluating the quality and clarity of the interview guide based on interview technique best practices. The interview sessions were analyzed and coded using both exploratory techniques and a-priori coding scheme based on food safety constructs of the survey. Modifications to the final in-depth interviews included a more structured approach to assess understanding of food safety concepts asked in the survey, attitudes towards food safety, perceived risk of getting food borne illness, perceived control in preventing food borne illness, food safety practices intentions, behaviors, and perceived norms. The final interview guide is designed to explore more of the awareness and understanding of common food safety education concepts such as the FoodSafety.gov 4 steps to food safety program as well as ASL signs for food safety and other common terminology used in food safety education. These concepts replace more general questions regarding survey structure and the dissemination of the curriculum. A focus group guide was developed to explore the key food safety concepts critical for inclusion in the food safety curriculum with emphasis on tailoring the messages to the target population of Deaf teenagers. Two focus groups were conducted on July 26, 2015 at the International Association of Food Protection in Portland Oregon. The 15 participants, 5 male- 10 females work in a variety of setting from the USDA food safety programing to industry food safety education and consumer food safety extension programs. 40% (n= 6) reported working in extension and 60% (n=8) work directly with consumer food safety education. The average work experience in food safety was 10-15 years. Focus group participants were asked to rank the importance of both general food safety education (4 steps to food safety) and fresh produce safety (Produce Pro) in terms impact on reducing risk for food borne illness. Additionally the focus group explored barriers to communicating food safety concepts, strategies for teaching food safety concepts effectively, consensus on critical consumer food safety behaviors, and a concise definition for food safety that might be adapted into the food safety education curriculum. The focus groups were videotaped. The focus group sessions were transcribed and exploratory coding technique was applied in addition to the a-priori coding scheme established in the focus group guide.

          Publications


            Progress 09/01/13 to 08/31/14

            Outputs
            Target Audience: The target audience for this project is Deaf and hard of hearing teenagers (14-18 years old). During this reporting period, deaf teenagers enrolled in the deaf schools in the states of Arizona, California, Idaho, Oregon, Texas, and Washington were reached. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided? One graduate student attended the Tools for Change conference in Idaho spring of March 2014. This conference is for transitioning youth with disabilities and the people who support them in this transition to post-secondary school life. This opportunity was in collaboration with the University of Idaho’s Center for Disabilities and Human Development. The same graduate student is being trained in qualitative research methods to develop the in-depth interview (Objective 1) and focus group questions (Objective 2). In addition, PD (Ryu) attended the NIFA Project Directors’ meeting (5/7 - 5/8/14, Washington, DC). How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals? Once we complete Objective 1 by concluding the national survey and in-depth interviews, Delphi focus group studies will be conducted to develop a culturally sensitive education strategy (Objective 2). The purpose is to create a culturally appropriate food safety education program for this target audience to improve overall food safety education and provide participants with food safety related job skills to assist in their transition to life post-secondary education.

            Impacts
            What was accomplished under these goals? As outlined in Objective 1, Evaluation of knowledge, attitudes, and handling practices towards fresh and fresh-cut produce, the development of the national survey instrument was completed in a print and online format with American Sign Language (ASL) translations in May 2014. The project team identified key food safety knowledge and behaviors required to reduce the risk of foodborne illness. These factors were grouped into the following construct areas: General Food safety attitude and knowledge, Frequency of food preparation specifically fresh produce, Food handling practices, Hand washing knowledge and practices corresponding to key food safety recommendations (WHO, USDA, and FDA). Additionally the pilot survey contained questions measuring factors influencing hand washing frequency and familiarity with common food safety related words and phrases. Statistical analysis of the pilot survey revealed a Cronbach’s alpha score of 0.697 overall, the internal reliability of the survey instrument was adequate to conclude it captured the constructs consistently throughout the survey. Evaluation of the pilot survey results and feedback lead to the revision of the survey instrument, which was completed by September 2014. Video ASL translations of the final survey instrument will be included in a DVD accompanying the survey (Objective 1). The survey was shortened and modified to improve readability, visual appeal, decrease fatigue, and address specific food safety knowledge, attitude, and behavior constructs more efficiently with improved internal reliability. Recruitment for administration of the national survey is completed. Schools in California, Idaho, Indiana, Maryland, North Carolina, Oregon, Texas, and Washington have agreed to administer the surveys to students. Completion of the national survey is expected by late November to early December 2014. Data from the pilot survey responses inform the development of the national survey and the in-depth interview questions as well as the development of food safety education approaches.

            Publications