Source: UNIVERSITY OF NEBRASKA submitted to NRP
A NOVEL SYSTEM FOR OBJECTIVE SCORING OF ANIMAL HANDLING
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1032239
Grant No.
2024-67015-42376
Cumulative Award Amt.
$300,000.00
Proposal No.
2023-08145
Multistate No.
(N/A)
Project Start Date
Jul 1, 2024
Project End Date
Jun 30, 2026
Grant Year
2024
Program Code
[A1251]- Animal Health and Production and Animal Products: Animal Well-Being
Recipient Organization
UNIVERSITY OF NEBRASKA
(N/A)
LINCOLN,NE 68583
Performing Department
Animal Science
Non Technical Summary
For many trades and professions, there is a well-defined path for learning the essential skills that ensure worker safety.This is not the case for animal caretakers, as there is no industry standard that defines skill level for them. This sector of the workforce relies on self-reported years of experience (i.e. growing up on a farm) when describing their job qualifications. Years ago, when most people were more familiar with animal husbandry, this may have been realistic. With the migration away from family farms, it can be an unrealistic and even deadly assumption that familiarity with agriculture is enough. U.S Bureau of Labor reports indicate fatal injuries are steadily increasing for animal workers (U.S. BOLS, 2024). Handler skill level can significantly impact overall welfare during an animal's lifetime, and currently, an objective measure of handler skill level does not exist.We hypothesize a positive correlation exists between handler skill level, safety, and animal behavior.Our objectives are:To develop and test a skill assessment tool for scoring handler skill levelTo investigate the relationship between self-reported handler experience, expert-scored skill level, and animal behaviorTo investigate the relationship between self-reported years of experience, handler stress, and animal behavior during controlled cattle handling eventsA skill assessment tool could substantially reduce the risk for injury to both humans and animals. This project will contribute to the long-range improvement in and sustainability of U.S. agriculture and food systems by improving animal welfare through the provision of skilled care and handling.
Animal Health Component
100%
Research Effort Categories
Basic
(N/A)
Applied
100%
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
3153399102085%
3153399307015%
Goals / Objectives
1) To develop and test a skill assessment tool for scoring handler skill level2) To investigate the relationship between self-reported handler experience, expert-scored skill level, and animal behavior3) To investigate the relationship between self-reported years of experience, handler stress, and animal behavior during controlled cattle handling events
Project Methods
Human participants (N = 108) will be recruited from students, staff, and faculty affiliated with the University of Nebraska system, and will include cattle producers from the communities where extension and research centers are located, when possible. Enrollment in this study is voluntary, and all participants must have a baseline of animal experience to ensure the safety and well-being of animals and humans. Potential participants will go through a screening process, and will be asked to describe their cattle handling skills as low (n = 36), medium (n = 36), and high (n = 36) in an effort to maintain a balanced study population.Once enrolled, participants will be scheduled for a trial day. Upon arrival on the scheduled day, eligible participants will be fitted with a wearable EDA monitor, to be worn until completion of a post-trial survey. The pre-trial survey will include basic demographic information and self-reported experience (in years), whether the individual grew up on a farm, species involvement, and highest level of education. Prior to handling events, participants will receive an instructional handout detailing the tasks they will perform; and a researcher will demonstrate the tasks. Participants will walk the pattern twice while wearing an EDA monitoring device in order to establish individual baseline patterns at rest and during activity (without cattle). Participants will complete three handling trials on a single day. Following the completion of their trials, participants will complete a post-trial survey to evaluate perceptions of their performance and self-reported stress during each trial and animal responses during each trial.Cattle will be selected for participation in the study from the teaching and research herd housed in the Animal Science complex. Cattle will be randomized into trials from a pooled herd, where they will remain until or unless selected for a trial, to mitigate separation stress. Trials will include the handling of three cattle (to support natural herding behavior); cattle will be randomly assigned to handler and order within each handling trial. Cattle will spend 72 h under trial; 48 h prior to each trial date, a wearable HR monitor will be applied, and each animal will wear a HR monitor until 24 h post handling trial. To minimize handling stress, a 10 min maximum will be imposed on each trial. Though one animal might have several trials, different herd mates will be present during respective trials. In this manner, an element of novelty may be retained.Individual CHS obtained from the AHSS will consist of 10 skills with four associated scores for each skill. Scores will be assigned by marking a line between two points, indicating the level of skill by marking a point on a continuous line. The distribution of all numeric scores for each skill (and for each sub-category) will be tested for normality and fit to a curve. Human- physiological (EDA) data, pre- and post-trial survey results, handler proficiency scores, and animal outcomes will be merged into a single data set for analysis. Correlations and ANOVA tests will be used to make comparisons between human-handler physiological data, self-reported experience, self-reported performance during trials, handler proficiency scores, and animal outcomes. Each of these data points support a different component of describing animal handler competency/proficiency. The CHS help trainers provide specificity in training. This allows trainers to meet handlers where they are, subsequently allowing trainers to engage a steeper learning curve with their handlers. These results, compared with pre- and post-trial survey results will allow the research team to assess gaps and risks associated with using self-reported skill level as a primary measure of proficiency.

Progress 07/01/24 to 06/30/25

Outputs
Target Audience:During this reporting period, project efforts were directed toward engaging key audiences to establish awareness, build trust, and secure buy-in for future data collection activities. Although full-scale participant recruitment and handling trials were delayed pending IRB/IACUC approval, several stakeholder groups were reached: Livestock producers and industry partners: Project goals and anticipated outcomes were introduced through Nebraska Beef Extension programming and producer-focused events that extened across the countryincluding the New Mexico Cattle Growers Mid-Year Meeting, several nationally hosted podcasts, and more. These interactions helped clarify the project's relevance to workforce development, cattle welfare, and market readiness, and served to establish early support among stakeholders who will be critical to recruitment and adoption. Academic and Extension peers: Preliminary concepts and methodological approaches were presented at the U.S. Precision Livestock Farming Conference (June 2025), which convened approximately 200 attendees from universities, Extension systems, and industry research. This outreach fostered professional dialogue on the integration of physiological measures, behavioral scoring, and handler self-assessment, generating constructive feedback and interest in collaboration. Students: Undergraduate students in ASCI 270 (n = 63) and ASCI 370 (n = 22) were introduced to the project as a case study in applied welfare research. Graduate and undergraduate research assistants (1 PhD, 2 MS, and 4 undergraduate students) were directly trained in project-relevant skills, including behavioral scoring, survey development, and data management. These experiences not only advanced student learning but also built internal capacity for the project's next phase. By engaging these audiences early, the project cultivated the necessary foundation of understanding and buy-in required to support upcoming participant recruitment and data collection. While direct human-animal trials are scheduled for the next reporting period, Year 1 successfully established the relationships and shared expectations that will enable smooth execution and enhance the ultimate impact of the work. Changes/Problems:? The most significant issue during this reporting period was a delay in initiating live cattle handling trials with human participants. The delay was due to the extended timeline for obtaining Institutional Review Board (IRB) and Institutional Animal Care and Use Committee (IACUC) approvals. This project presented a novel approach that combined human participant research, live cattle handling, and physiological monitoring. The IRB had not previously encountered research of this type, and the review process required extensive clarification and documentation. The board requested detailed explanations regarding potential risks to participants, how those risks would be mitigated, and where responsibility would fall in the event of an adverse outcome. Addressing these questions was painstaking and required multiple rounds of revision, but ultimately successful. IRB approval has now been secured, allowing recruitment and trial implementation to begin in the next reporting period. To maintain momentum during this approval process, the project team concentrated on preparatory activities, including: Developing and pilot-testing the skill assessment tool, Finalizing pre- and post-trial survey instruments, Training and calibrating graduate and undergraduate scorers, Analyzing pilot data comparing self-reported skill and expert scores, Testing wearable physiological monitoring devices, and Conducting dissemination activities to build stakeholder awareness and support. Although these steps minimized the long-term impact of the delay, the shift in schedule may affect the overall timeline for completing all project objectives within the award period. The team will continue to monitor progress closely, adjust resource allocation as needed, and communicate promptly with NIFA if modifications to the project timeline become necessary. There were no changes to the approved Data Management Plan, and no changes in approved protocols for animal care or biohazards. The scope and objectives of the project remain intact, and the team is now positioned to move forward with implementation. No additional reporting requirements beyond those already specified in the award Terms and Conditions are anticipated at this time What opportunities for training and professional development has the project provided?This project provided training and professional development opportunities for both students and faculty audiences during the reporting period: Graduate students: One PhD student and two MS students gained training in behavioral data coding, survey development, inter-rater reliability testing, and integration of human and animal outcome data. Graduate students also engaged in project management, manuscript preparation, and presentation of project aims at professional meetings. These experiences contributed directly to thesis/dissertation progress and professional skill development. Undergraduate students: Four undergraduate research assistants received training in behavioral scoring methods, data entry, and project-specific standard operating procedures. They participated in calibration sessions with graduate students and gained hands-on exposure to applied animal welfare research, strengthening their technical and analytical skills. Classroom integration: The project was incorporated into undergraduate coursework, reaching 63 students in ASCI 270: Fundamentals of Animal Behavior and Welfare and 22 students in ASCI 370: Animal Welfare. Students were introduced to the project as a case study in applied research, linking classroom learning to real-world challenges in cattle handling and welfare. Professional development via conferences: Graduate students and the PI engaged in dissemination at major meetings, including the U.S. Precision Livestock Farming Conference (~200 attendees), the American Society of Animal Science Annual Meeting (~150 attendees), and the New Mexico Cattle Growers Mid-Year Meeting (~100 producers and industry stakeholders). These activities developed skills in science communication and provided opportunities for networking with peers, industry professionals, and producers. Skill-building infrastructure: Standardized onboarding protocols and calibration exercises were developed for student researchers, ensuring consistency in behavioral coding and data handling. These processes provided a structured model of professional development that will support future students entering the project. Summary In total, the project supported training and professional development for 3 graduate students, 4 undergraduate students, and over 80 classroom students. It also enhanced professional visibility and communication skills through participation in national and regional conferences. These opportunities advanced both technical competencies (e.g., behavioral scoring, survey design, physiological monitoring) and professional skills (e.g., teamwork, project management, public communication), directly aligning with the project's emphasis on workforce development across the livestock sector. How have the results been disseminated to communities of interest?During this reporting period, dissemination efforts focused on building awareness of the project, sharing preliminary analyses, and securing stakeholder buy-in in advance of live data collection. Scientific community: Preliminary analyses and project objectives were presented at the U.S. Precision Livestock Farming Conference (June 2025; ~200 attendees) and the American Society of Animal Science Annual Meeting (July 2025; ~150 attendees in the relevant session). These venues reached academic peers, Extension specialists, and industry researchers, providing early feedback on methodological approaches and opportunities for collaboration. Producer community: Project goals and early findings were introduced at the New Mexico Cattle Growers Mid-Year Meeting (August 2025; ~100 producers and industry representatives). This facilitated dialogue with cattle producers and allied industry partners, highlighting the project's relevance to workforce development, stockmanship, and cattle welfare outcomes. Extension outlets: Project updates were incorporated into Nebraska Beef Extension programming, including newsletters and producer-facing presentations, to maintain awareness among regional stakeholders. Educational integration: While not dissemination in the traditional sense, project aims and preliminary outcomes were shared with undergraduate students in ASCI 270 (n = 63) and ASCI 370 (n = 22) as case studies in applied welfare research, extending reach into the next generation of animal science professionals. Summary Through professional conferences, producer meetings, and Extension programming, the project reached more than 450 individuals across academic, producer, and student communities. These dissemination activities established early visibility, generated constructive feedback, and built essential support for the implementation of live handling trials in the next reporting period. What do you plan to do during the next reporting period to accomplish the goals?Goal 1: Develop and test a skill assessment tool for scoring handler skill level Recruitment and scheduling: Begin participant enrollment using the finalized screening survey to ensure balanced representation across low, medium, and high self-reported skill groups. Implementation in live trials: Conduct controlled cattle handling events where participants complete defined handling tasks. Expert raters will apply the skill assessment tool in real time to score performance. Video capture and archiving: Record all handling trials to allow for secondary review, scoring validation, and use in coder training. Coder training and calibration: Continue structured reliability exercises for graduate and undergraduate scorers, with recalibration checks scheduled periodically. Refinement: Use trial data and feedback from raters and participants to refine categories within the skill assessment tool to improve clarity, reliability, and usability. Goal 2: Investigate the relationship between self-reported handler experience, expert-scored skill level, and animal behavior Survey administration: Collect pre-trial demographic and experience data (e.g., age, gender, farm background, years of experience, species involvement, education) and self-reported skill ratings. Post-trial surveys: Gather participants' perceptions of performance, stress, and observed cattle responses following each trial. Data integration: Link survey data with expert-assigned scores from the skill assessment tool and cattle behavioral outcomes. Preliminary analysis: Assess the degree of alignment or discrepancy between self-reported skill ratings and expert scores, and begin exploring correlations with cattle behavior. Goal 3: Investigate the relationship between self-reported years of experience, handler stress, and animal behavior during controlled cattle handling events Human monitoring: Fit participants with electrodermal activity (EDA) and heart rate (HR) monitors during trials to capture physiological stress measures. Cattle monitoring: Fit cattle with HR monitors 48 hours prior to trials and maintain them until 24 hours post-trial to measure responses to handling. Dataset development: Merge human physiological measures, survey results, expert scores, and cattle outcomes into an integrated dataset. Analytical testing: Conduct initial analyses (correlations, ANOVA) to examine relationships among handler experience, stress measures, and cattle behavior. Cross-cutting plans Dissemination: Present initial trial results at the 2026 ASAS Annual Meeting and regional producer meetings; prepare Extension fact sheets to translate findings for producer audiences. Manuscripts: Prepare at least one peer-reviewed article from pilot or early trial data for submission to Applied Animal Science or a comparable journal. Educational integration: Use trial data as case study material in ASCI 270 and ASCI 370, and support graduate student thesis/dissertation progress. Extension engagement: Provide ongoing updates through Nebraska Beef Extension newsletters, producer presentations, and industry meetings to sustain stakeholder buy-in. Summary With IRB approval secured, the next reporting period will focus on transitioning from preparation to active data collection. Recruitment and cattle handling trials will generate the first complete datasets combining surveys, skill assessment tool scores, physiological measures, and cattle outcomes. These activities will provide the first large-scale test of the tool, establish relationships between handler skill, stress, and animal responses, and lay the foundation for peer-reviewed publications and producer-focused outreach.

Impacts
What was accomplished under these goals? Goal 1: Develop and test a skill assessment tool for scoring handler skill level A draft skill assessment tool, adapted from the Animal Handling Skills Scoring (AHSS) framework, was developed. Pilot data were analyzed, including participants' self-reported skill ratings and expert-assigned scores for specific handling tasks, with a smaller subset of video footage used for cross-checking. Analyses demonstrated that the tool could capture meaningful differences between perceived and observed handler skill, while also identifying areas requiring refinement. Graduate and undergraduate research assistants were trained in coding procedures, with inter-rater reliability exercises conducted to establish calibration protocols. Standard operating procedures (SOPs) for onboarding and coder training were created to ensure consistency and repeatability. These activities provided early validation of the skill assessment tool and prepared the project team for implementation in live handling trials. Goal 2: Investigate the relationship between self-reported handler experience, expert-scored skill level, and animal behavior A screening survey was finalized to classify participants into low, medium, and high skill categories to maintain balanced enrollment in trials. Pre- and post-trial survey instruments were designed and pilot-tested to capture demographic data, prior livestock experience, self-reported skill, and perceptions of performance and stress. Preliminary analysis of pilot data comparing self-reported experience with expert task scores revealed discrepancies between how handlers rated their ability and how their skills were evaluated by trained observers. These early findings underscore the importance of using standardized, objective assessment rather than relying on self-report alone. While full integration with animal outcome data awaits live trials, this preliminary work confirmed the utility of linking self-reported and expert-assigned data streams. Goal 3: Investigate the relationship between self-reported years of experience, handler stress, and animal behavior during controlled cattle handling events Wearable devices for human physiological monitoring (electrodermal activity and heart rate) were procured and tested for reliability and usability. A data integration plan was developed to combine human physiological measures, survey data, expert scores, and animal outcomes into one comprehensive dataset. Statistical analysis protocols (correlation, ANOVA) were outlined to guide testing once full-scale trial data collection begins. Although live cattle trials with human participants were delayed pending protocol approvals, preparatory work ensured readiness for immediate implementation in the next reporting period. Summary During this reporting period, the project advanced its goals through development and pilot testing of the skill assessment tool, preliminary analyses linking self-reports and expert scores, preparation of survey and monitoring protocols, and foundational work needed to integrate human and animal data streams. While full-scale live trials were not yet launched, these accomplishments established the necessary foundation for comprehensive data collection and analysis in the next reporting period.

Publications