Source: WASHINGTON STATE UNIVERSITY submitted to NRP
DEVELOPING AND EVALUATING BILINGUAL EDUCATIONAL TOOLS FOR TRAINING UNDERSERVED SECTORS OF COMMERCIAL HONEY BEE OPERATIONS
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1029865
Grant No.
2023-68008-39275
Cumulative Award Amt.
$300,000.00
Proposal No.
2022-10466
Multistate No.
(N/A)
Project Start Date
Apr 1, 2023
Project End Date
Mar 31, 2026
Grant Year
2023
Program Code
[A1701]- Critical Agricultural Research and Extension: CARE
Recipient Organization
WASHINGTON STATE UNIVERSITY
240 FRENCH ADMINISTRATION BLDG
PULLMAN,WA 99164-0001
Performing Department
(N/A)
Non Technical Summary
Commercial beekeepers provide the vast majority of pollination services necessary to sustain pollination-dependent crop production in the US. Similar to much of the agriculture sector, those commercial beekeepers are dependent on Spanish speaking Hispanic/LatinX and H-2a labor. The skill, experience and education of laborers within beekeeping operations has profound impacts on the quality of life, health, safety and economic viability of the industry. Stakeholders have identified a lack of knowledge about bee biology, common pests and diseases, and bee management as a major hurdle for current and incoming employees. The lack of currently available resources necessary for training these individuals (especially material in Spanish) limits the ability of employers to provide sufficient crew training. As a result, employees are less able to make critical decisions in the field that could enhance colony health and survival in these operations.This project aims to address this inadequacy in existing crew training materials by developing digestible training videos, backed by peer-reviewed, scientific research and delivered by experienced, native Spanish-speaking commercial beekeeper employees. We propose to produce a series of three video modules (each containing 4-6 short videos) that will increase the knowledge of individual beekeeper employees. The educational material will be delivered via online content and advertised via national and regional beekeeper meetings. We will also assess the retention of critical information and effectiveness of these training materials in improvement in beekeeping operations via surveys. Beekeeper crew members make many daily decisions in the field that cumulatively result in major impacts on the sustainability and quality of the US commercial pollination force as a whole. Addressing this critical need for additional crew training in core biological, management and safety knowledge will therefore have a profound impact on this agricultural sector. Ultimately, improving the knowledge and safety of this workforce will improve the quality of life, health, safety and economic sustainability of this critical sector of agriculture and those that depend on pollination.
Animal Health Component
100%
Research Effort Categories
Basic
(N/A)
Applied
100%
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
21130101130100%
Goals / Objectives
This project aims to address this inadequacy in existing crew training materials by developing digestible training videos, backed by peer-reviewed, scientific research and delivered by experienced, native Spanish-speaking commercial beekeeper employees. We propose to produce a series of three video modules (each containing 4-6 short videos) that will increase the knowledge of individual beekeeper employees. The educational material will be delivered via online content and advertised via national and regional beekeeper meetings. We will also assess the retention of critical information and effectiveness of these training materials in improvement in beekeeping operations via surveys. Beekeeper crew members make many daily decisions in the field that cumulatively result in major impacts on the sustainability and quality of the US commercial pollination force as a whole. Addressing this critical need for additional crew training in core biological, management and safety knowledge will therefore have a profound impact on this agricultural sector. Ultimately, improving the knowledge and safety of this workforce will improve the quality of life, health, safety and economic sustainability of this critical sector of agriculture and those that depend on pollination.Long-term Goal:To improve honey bee colony health and survival through increased successful implementation of best management practices (BMPs). BMP implementation will be increased through the development, dissemination, and evaluation of science-based extension and training materials in Spanish to directly serve Spanish speaking employees of commercial beekeeping operations across the US.Extension Objective:Create and disseminate science-based video training modules in Spanish specifically tailored to Spanish-speaking employees of US commercial beekeeping operations.Research Objectives:Assess the short term learning effectiveness, and long term retention of information provided in training modules among employees of commercial beekeeping operations.Assess the impact of video training modules on commercial beekeeping operations using survey data on changes in disease incidence and colony mortality.Assess the impact of video training modules on the quality of life of the participants and operations.
Project Methods
Extension Objective: Create and disseminate science-based video training modules in Spanish specifically tailored to Spanish-speaking employees of US commercial beekeeping operations.Methods:Stakeholder's input on training modulesIn order to ensure that the modules are relevant and germane, stakeholder input will be solicited to choose the topics of the three pilot modules. We will hold a focus group to inform the choice of topics to ensure content is relevant and corresponding to the demands of stakeholders. Stakeholders will rank their preference of topics and we will use their rankings to give each potential topic a cumulative score. The three topics scoring highest will be shared with stakeholders for final approval, and will be used to develop the three pilot modules.In addition to seeking stakeholder input on topics to be included in modules, we will also solicit stakeholder input after modules are developed. We will pilot the modules for a panel of stakeholders including beekeepers, researchers, Bee Informed Partnership bee health specialists, and a sociologist to solicit feedback on format and presentation. The panel will grade each module based on both information accuracy and presentation to ensure that videos are informative and engaging. Feedback will be used to fine tune modules before moving onto the research objectives.Course developmentThe team will develop all of the materials necessary to complete the course (video, subtitles and voice over (EN and SP), supplementary resources, summary notes). Translation of written materials will be done by a professional translation company who's services have been included in the budget. Videos will be filmed in Spanish (see Video Production section below), but subtilties will be provided in English by the professional translation company. Our goal is to develop the course content, structure, and information delivery following approaches that are optimized for online learning (Bae et al., 2019).The course will be available in English and Spanish. The Spanish version will be narrated by a native Spanish speaker. Native Spanish speakers with understanding of beekeeping terminology and practices will be sourced from producer collaborator operations, as well as Washington State University Bee Program personnel.The team will develop scripts directly based on research and data-driven best practices for commercial beekeeping operations in the US. Detailed scripts will be developed for each of the topics selected, and will be sent to review by the multidisciplinary panel discussed in the stakeholder input section above, to verify both the quality of the content and its practicality (See Timeline: Content Development).Video productionOnce scripts have been validated and finalized, we will move to video production. The team has ensured the collaboration of a professional video team with experience in filming in apiary settings, and personal experience beekeeping. Filming will occur in the field with real time, hands on demonstrations performed by the Spanish speaking (bilingual) beekeeping crew member. The exact timing and locations of filming will depend on the final topics stakeholders choose, as some are seasonally dependent. We plan on completing most filming on site in a commercial operation in northern California and North Dakota.For each module, the narrator will read from a teleprompter provided by the film crew for ease of recitation and to ensure information remains accurate. Each module will consist of 3-5 short (< 3 minutes) videos to ensure ease of digestibility and retention. We envision that this format will also allow for the easy addition of future videos to each module with minimal editing. Once all material has been filmed in the field, the video production company will edit and produce the videos. Videos will then be sent to a translation company to have English subtitles added. We envision other languages being added in the future as identified by stakeholder needs. Finally, videos will be hosted in an online format for ease of access and dissemination. Once videos are complete, we will move to begin research objectives to test the effectiveness of these videos in both long-term retention of information and in outcomes for colony health and survival.Dissemination PlanFor this initial proposal, the three initial training modules will be hosted in an online home via a Washington State University WordPress site specifically designated for these modules. Each module will be hosted on its own site including videos and supplemental materials (handouts, figures, etc.) available for download. During the initial phases of testing, only select stakeholders will have access to training modules for the purposes of the research objectives below. Modules will remain available to select stakeholders only until learning retention and effectiveness is studied in years 2 and 3 of this proposed project.?Research Objectives: 2)Assess the short term learning effectiveness, and long term retention of information provided in training modules among employees of commercial beekeeping operations. 3) Assess the impact of video training modules on commercial beekeeping operations using survey data on changes in disease incidence and colony mortality. 4) Assess the impact of video training modules on the quality of life of the participants and operations.Methods:Objective 2) Assess the short term learning effectiveness, and long term retention of information provided in training modules among employees of commercial beekeeping operations.We will partner with three commercial beekeeping operations (letters of support from each of these beekeepers is included: Miller, Heitkam, and Noyes) to test the retention of material presented in our video training modules. Within each operation, we will aim to track the learning of 10 Spanish speaking employees over an entire beekeeping season. Learning effectiveness will be tested by providing a pre-questionnaire to assess the starting point of knowledge. Another questionnaire will be provided immediately post-training to assess the immediate effectiveness of the training materials. Finally, a follow-up questionnaire at the end of the season will be provided to assess long-term retention. Questionnaires will be developed by team personnel but we will seek input from the sociologist we recruit to our review panel referenced in the Stakeholder Input section of Extension Objective 1.Objective 3) Assess the impact of video training modules on commercial beekeeping operations using survey data on changes in disease incidence and colony mortality.We hypothesize that through increased education of employees, commercial operations will see measurable improvements in colony health outcomes and survival. In order to measure these outcomes, we will employ survey methods used by the Bee Informed Partnership in annual loss and management surveys since 2007 (vanEngelsdorp et. al. 2008). We will assess the following outcomes:? Comparison of disease incidence and honey bee colony mortality rate before/ after implementation ; Our 3 producer collaborator owned operations will each provide this data for a total of three years (Year 0 (before), Year 1 (season following first trainings), Year 2 (second season implementation trainings)? Comparison of management performed before/ after implementation: we expect a reduction of the prophylactic use of chemical treatments and antibiotics.Objective 4) Assess the impact of video training modules on the quality of life of the participants and operations.We hypothesize that the training will improve the quality of life of participants and operations by improving the worker's safety, enjoyment, and by increasing the rate of worker retention and return.? Comparison of the perception of safety and enjoyment by the participants? Return rate of the participants compared to non-trained workers

Progress 04/01/24 to 03/31/25

Outputs
Target Audience:During this reporting period, we connected with Jason Miller, one of the project advisors for this grant, and worked with him and a video recording team to film the first series of videos along with one of his apiary workers. We have not yet finalized videos so we have not reached beyond this small group yet. Changes/Problems:There were many major changes to this project during this reporting period. Dr. Kelly Kulhanek, the previous PI on thie project, left Washington State University (WSU) to pursue a career with the EPA. Additionally, Bee Informed Partnership (BIP), a collaborating organization with the project, filed for bankruptcy. As a result, Dr. Rae Olsson of WSU took over project leadership in place of Dr. Kulhanek in July 2024, and Dr. Katie Lee of University of Minnesota joined in place of BIP as she has a lot of skills and professional connections that BIP was to provide. The departure of Dr. Kulhanek and the dissolution of BIP delayed progress on this project, so we weren't able to be as methodical as planned for our survey work, however we feel positively about the surveys we did, and have gotten positive feedback from beekeepers on the proposed video training topics. What opportunities for training and professional development has the project provided?This project has allowed our team to work alongside the beekeeping industry and better provide outputs that will be useful, rather than outputs researchers think will be helpful. Additionally, we have been in contact with Project Apis M, a honey bee research non-profit organization, about the possibility of them hosting the videos on their site, which will increase access and viewership. How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?During the next reporting period, we will collect the remaining needed footage in March 2025, and will finish all the editing on each video. We will create modules and deliver video modules to our beekeeping stakeholder partners to start. We will also attend regional and national honey bee research conferences to promote these videos and solicit survey respondants so that we can evaluate the efficacy of these training videos.

Impacts
What was accomplished under these goals? During the reporting period, we developed a total of 12 scripts that will be included in 3 modules on honey bee health and beekeeping best practices.These scripts were developed after we surveyed leading beekeeping operation owners on the topics they feel would be most useful for their workers to understand, including: Basic bee biology Overview of bee biology Honey bee life cycles Nutrient requirements Overwintering honey bees Caring for bees and assessing hive health, including beekeeper safety Handling bees and hives Beekeeper safety Evaluating nutrient needs and feeding Assessing honey bee queen and brood health Pests, pathogens, and other potential harmful impacts on bee health Varroa mites Other parasites and predators Brood diseases Adult diseases After writing scripts in English, we also worked with a translator to translate all 12 scripts into Spanish, and worked with the videographers to make shot lists. We consulted with beekeepers and apiary workers to ensure appropriate language use, including regional jargon so the videos will be accessible by as many people as possible. In October 2024, we traveled to North Dakota to collect film on bees in the late part of the season. We have an actual Spanish speaking apiary worker doing the on-screen delivery of information, which animated shots and images to support the spoken portion of the videos. We gathered about 50% of the total needed footage to create all videos for this project.

Publications


    Progress 04/01/23 to 03/31/24

    Outputs
    Target Audience:The target audience for this project is Spanish speaking beekeepers. The majority of entry level and middle-management workers in commercial beekeeping operations are Spanish speakers, however, nearly all training materials available to workers in the US are created in English. Changes/Problems:Major changes to personnel and slightly compressed timeline due to the loss of Project Director Kulhanek and BIP collaborators. New PD Rae Olsson and co-PD Katie Lee have amended plans and budget distribution to align with new work plan and feel confident we will meet the objectives of this project. What opportunities for training and professional development has the project provided? Nothing Reported How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?During the next reporting period (4/1/2024 - 3/31/2025) the team will survey beekeepers to select the three topics our video modules will focus on, and write scripts for all 3 video modules (12-16 short videos total). We will also travel during the fall and spring to record videos, and work with Wonderstone Visuals on editing and post production of videos. We will create pre-and post video training surveys to assess learning outcomes, and delivery pre-video surveys to establish a baseline of understanding for our target audience.

    Impacts
    What was accomplished under these goals? Project Director Kelly Kulhanek departed from WSU very shortly after this award was granted, and did not complete any major objectives during the first year. Additionally, Bee Informed Partnership (BIP), a primary collaborator on this project proposal, recently filed bankruptcy and is no longer operational. In an effort to fulfil the objectives of this project within the established period of performance, Rae Olsson (Washington State University) will be taking over as PD on this award,with the support of co-PI Katie Lee (University of Minnesota) and the additional support of Brandon Hopkins (WSU). During the first year, (4/1/2023 - 3/31/2024), Olsson, Lee, and Hopkins met several times to renegotiate the roles and responsibilities of each team member. 1. No major activities were completed 2. No specific objectives were met 3. No significant results achieved 4. Key outcomes and accomplishments: Redefining roles and responsibilities, establishing new plan to achieve all proposed objectives within the period of performance.

    Publications