Source: UTAH STATE UNIVERSITY submitted to NRP
ENGAGING EDUCATORS THROUGH A DRONE CURRICULUM PROJECT TO DELIVER 21ST CENTURY FANH SKILLS TO GRADES 4-12 STUDENTS
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
COMPLETE
Funding Source
Reporting Frequency
Annual
Accession No.
1021799
Grant No.
2020-67037-31045
Cumulative Award Amt.
$282,312.00
Proposal No.
2019-04936
Multistate No.
(N/A)
Project Start Date
May 1, 2020
Project End Date
Apr 30, 2023
Grant Year
2020
Program Code
[A7501]- Professional Development for Agricultural Literacy
Recipient Organization
UTAH STATE UNIVERSITY
(N/A)
LOGAN,UT 84322
Performing Department
School of Applied Science Tech
Non Technical Summary
The specific objectives for this project are as follows:Develop a drone curriculum project that assists teachers in delivering 21st Century FANH (food, agriculture, natural resources, and human science) skills to students in grades 4-12.Deliver teacher professional development workshops in three selected school districts, providing teachers with strategies, lessons, and equipment/resources to be successful in teaching the curriculum.Facilitate implementation of this curriculum in grades 4-12 (three selected school districts).Provide ROAVcopter outreach challenges (three selected school districts).Develop sustainability plan for future implementation and replication of drones curriculum project locally, regionally, and nationally.The Agriculture and Food Research Initiative (AFRI) priority areas and specific topics addressed in this project include:• Agriculture systems and technology• Agriculture economics and rural communitiesThe targeted participants for this project are Utah teachers of students in grades 4-12 (60 participants). These teachers will be identified by education specialists at the Utah State Board of Education. The focus will be to select teachers in both urban and rural communities with underserved populations of students in the aforementioned grade levels.Long-term project outcomes are to (a) improve the professional capacity of K-14 educators to implement innovative and immersive learning experiences to K-14 students' in food and agricultural sciences, and (b) increase students' awareness, appreciation, and understanding of food systems and agricultural sciences.
Animal Health Component
(N/A)
Research Effort Categories
Basic
(N/A)
Applied
(N/A)
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
40472102020100%
Goals / Objectives
Immersive learning experiences in FANH sciences for teachers of grades 4-12 students will be provided via the following project efforts:Goal: Develop curriculum for grades 4-12 students Objectives:Establish a scope and sequence for twelve grade-appropriate lessons for each group of elementary (grades 4-6), middle (grades 70), and high school (grades 9-12) studentsWrite instruction in the use of DJI/Tello Edu quadcopters (grades 4-6) and Parrot Anafi drones (grades 7-12)Create lesson content to include flying drones safely, flying drones remotely, flying drones autonomously, and collecting data autonomously (see sample lessons at *Curriculum for Parrot Mini Drones)Tie lessons and resources to Utah core standards in science, social studies, and career and technical education and written in the 5E model (engage, explore, explain, elaborate, evaluate; see sample lesson at *Drones in High-tech Farming). Include the content's relation to practical applications in agriculture.Pilot and modify lessons with participating Utah teachers*These lessons are ot part of the project's curriculum; they are provided as examples of content and format.Goal: Deliver professional development workshops Objectives:Deliver two workshops (one for grades 4-6 and one for grades 7-12--a combined workshop format for secondary grades but using grade level appropriate curriculum) in each of three Utah school districtsGoal: Facilitate ROAVcopter Challenge Tournaments Objectives:Establish ROAVcopter Challenge rulesSchedule and run tournamentsGoal: Develop sustainability plan for future implementation and replication of drones curriculum project locally, regionally, and nationally. Objectives:Collaborate with Utah State Board of Education to develop and implement a drone component as part of the current Transportation Pathway.Tie the project to the emerging afterschool STEM outreach challenge--ROAVcopters.Make curriculum free-of-charge via the Utah Agricultural Literacy Curriculum Matrix and the National Agricultural Literacy Curriculum Matrix to provide replication and dissemination on state and national scales.
Project Methods
Efforts:Establish a scope and sequence for twelve grade-appropriate lessons for each group of elementary (grades 4-6), middle (grades 70), and high school (grades 9-12) studentsWrite instruction in the use of DJI/Tello Edu quadcopters (grades 4-6) and Parrot Anafi drones (grades 7-12)Create lesson content to include flying drones safely, flying drones remotely, flying drones autonomously, and collecting data autonomously Tie lessons and resources to Utah core standards in science, social studies, and career and technical education and written in the 5E model (engage, explore, explain, elaborate, evaluate). Include the content's relation to practical applications in agriculture.Pilot and modify lessons with participating Utah teachersDeliver two workshops (one for grades 4-6 and one for grades 7-12--a combined workshop format for secondary grades but using grade level appropriate curriculum) in each of three Utah school districtsEstablish ROAVcopter Challenge rulesSchedule and run tournamentsEvaluation:The evaluation plan follows the Targeting Outcomes of Programs (TOP) model (Rockwell & Bennett, 2004). This framework guides identification of the gap between current and desired social, economic, and environmental conditions in K-14 education relating to food, agricultural, natural resources, and human (FAHN) sciences. The TOP also allows a clear description of the relationship between short-, medium-, and long-term project outcomes to ensure the evaluation activities capture relevant data to show program impact. Therefore, the integrated (formative and summative) evaluation plan is designed to demonstrate the impact of this project on grades 4-12 educational outcomes in food and agricultural sciences.Evaluation data will be gathered primarily through a survey methodology. A one-group pre-and-post-test design will be used to assess educators' knowledge and skill gain. Further, an exit survey will be implemented to measure the educators' level of interest and willingness to implement innovative teaching methods in the classroom and their aspirations to participate in continuous professional development training sessions. A three-month follow-up survey will be used to assess educators' adoption of recommended pedagogical methods and the supporting curriculum, and their actual engagement and sustained interest in professional development training. A one-year follow-up survey targeted to the participating educators will be used to measure long-term outcomes. This brief questionnaire will gather data on educators' experiences from using the immersive learning methods in the classroom, their perceptions towards students' receptiveness of the methods, and their perceptions of the impact of the methods on students' awareness, appreciation, and understanding of food systems and agricultural sciences.Outputs will be measured through formative evaluation activities geared towards assessing program fidelity (Rossi, Lipsey, & Freeman, 2004). The Milestones and Tasks (see Project Management Plan) are benchmarks that will be monitored throughout the program's lifespan. Successful completion of all milestones and tasks indicate effective program implementation. Results of the evaluation will be communicated via quarterly reports to stakeholders to promote increased participation in the program by grades 4-12 educators, annual formative reports to NIFA to show ongoing program accomplishments, and a summative report to NIFA to show program impact. No major pitfalls are expected in implementation of the evaluation plan.

Progress 05/01/20 to 04/30/23

Outputs
Target Audience:Targeted participants for this project were Utah teachers of students in Grades 4-12. Selected teachers--based on their teaching assignments in appropriate areas of STEM (science, technology, education, and math) were identified by school district Career & Technical Education (CTE) directors, elementary education directors, and superintendents. The focus was to select teachers in both urban and rural communities with underserved populations of students in the aforementioned grade levels. Changes/Problems:The only major change in our approach to this project was the goal to develop curriculum for grades 4-12 students. During the delay of the project due to COVID restrictions, the DroneBlocks company produced an excellent drones curriculum which met the needs of our targeted teachers and a goal of this curriculum project. Consequently, grant funds were used to purchase software licenses for the participating teachers. The workshop instructors guided teachers through the use of this software, and teachers were able to practice/model these lessons during the workshop. Additonally, lessons from the National Agricultural Literacy Curriculum Matrix that are related to drone technology were curated and added to the workshop web page. Thelessons and resources were tied to Utah core standards in science, social studies, and career and technical education and written in the5E model(engage, explore, explain, elaborate, evaluate; see sample lesson at *Drones in High-tech Farming). Included is the content's relation to practical applications in agriculture. What opportunities for training and professional development has the project provided?Workshops were conducted by a team of Utah educators including: Dr. Joseph Furse, assistant professor in Utah State University's (USU's) Department of Applied Sciences, Technology, and Education; Austin Knudsen, technology teacher at Roy Jr. High; Dr. Cory Ortiz, professional practice assistant professor in USU's Department of Technology, Design, and Technical Education; and Denise Stewardson, USU Extension Associate Professor and director of Utah Agriculture in the Classroom. Targeted participants for this project were Utah teachers of students in Grades 4-12. Selected teachers--based on their teaching assignments in appropriate areas of STEM (science, technology, education, and math) were identified by school district Career & Technical Education (CTE) directors, elementary education directors, and superintendents. The focus was to select teachers in both urban and rural communities with underserved populations of students in the aforementioned grade levels. Fifty-six teachers, one CTE supervisor, one CTE coordinator, two tech services staff, and one instructional coach participated in the workshops. Each participant received seven hours of face-to-face instruction in the programming and flying of drones, setting up practice and competition fields and safety nets, and accessing online curriculum resources (see aforementioned agenda hyperlink). How have the results been disseminated to communities of interest?This program provided professional development training to teachers in grades 4-12 to develop their knowledge of and ability to use UAV technology in the classroom, and also provided them with an agricultural context within which to utilize this technology to teach agricultural literacy. Based on the evaluation results, participants' knowledge levels of UAV technology and knowledge of the Utah Agriculture in the Classroom Curriculum Matrix were significantly increased by participating in the professional development workshop. In addition, participants' self-efficacy in using drones for classroom instructional activities was also significantly increased. Following one of the trainings, a school district official contacted the workshop team to inform us that several teachers from his rural school district had already ordered classroom sets of quadcopter drones for their classrooms within a week of completing the training. Based on these findings, we conclude that the training workshops were effective in developing participants' ability to use UAV technology in the classroom and to provide an agricultural context for the use of UAVs to promote agricultural literacy. These teachers will be more able to effectively engage students in highly motivating instructional activities which teach both technical skills and agricultural literacy. Future activities are in the planning stages to provide develop a self-replicating training model help agricultural education teachers and technology education teachers utilize flexible laboratory spaces and emerging technologies to implement cross-disciplinary instruction to promote agricultural and technological literacy for their students. What do you plan to do during the next reporting period to accomplish the goals? Nothing Reported

Impacts
What was accomplished under these goals? Funded by a USDA National Institute of Food and Agriculture grant, three professional development workshops were held for Utah teachers in grades 4-12--one in each of the following school districts: Davis, Iron/Beaver (combined), and Weber. Workshops were held on January 31, 2023; February 10, 2023; and March 20, 2023, respectively. In addressing the need for teaching 21st Century Skills, the objectives of these workshops included: explaining the importance of drones in agriculture, explaining drone FAA regulations and safety practices, programming a drone using DroneBlocks and/or Python, setting up a ROAV (Remotely-operated Aerial Vehicle) tent and competition field, flying a drone autonomously and remotely, and accessing resources on the Utah Agricultural Literacy Curriculum Matrix. The agenda and resource links for workshops is available here. Workshops were conducted by a team of Utah educators including: Dr. Joseph Furse, assistant professor in Utah State University's (USU's) Department of Applied Sciences, Technology, and Education; Austin Knudsen, technology teacher at Roy Jr. High; Dr. Cory Ortiz, professional practice assistant professor in USU's Department of Technology, Design, and Technical Education; and Denise Stewardson, USU Extension Associate Professor and director of Utah Agriculture in the Classroom. Our evaluation followed a one-group pre-post-test design, and quantitative data were gathered from teachers using a self-assessment instrument (n = 59). We assessed participants' immediate reactions to the workshop as a proxy indicator of program quality. Results showed most teachers rated all quality indicators as very good. The majority of participants rated the following as very good (%): the amount of information provided (69%), organization of the workshop (49%), usefulness of topics covered (67%), length of the workshop (51%), instructor's knowledge (77%), and instructors' communication (74%). Overall, nearly all participants (93%) rated the workshop as very good and/or excellent. Outcome 1--Knowledge Gain: Baseline pretest data indicated teachers entered the workshop with low knowledge of using drones for agricultural education (M = 1.98 out of 5). Results of a one-sample t-test indicated participants experienced a statistically significant increase in their knowledge of using drones for instructional activities after the workshop (t = 23.61, p < 0.01, Mean diff. = 1.91). With respect to effect size, the workshop had a large effect on participants' knowledge based on Cohen's d (d = 3.10). Descriptive frequencies showed participants left the workshop with high and/or very high knowledge of using drones in agriculture (76%), the FAA rules for flying drones outdoors (62%), rules for flying drones in schools (59%), the terms "pitch," "yaw," and "roll" (93%), using DroneBlocks or Python to fly a drone in a square pattern (60%), the limitations of flying a drone indoors (62%), and the Utah Agricultural Literacy curriculum matrix (64%). Outcome 2--Self-efficacy: Consistent with their pre-knowledge levels, baseline data showed participants entered the workshop with very low to low self-efficacy in using drones for instructional activities (M = 1.54 out of 5). However, the results of a one-sample t-test indicated participants experienced a statistically significant increase in their self-efficacy in using drones for instructional activities after the workshop (t = 15.53, p < 0.01, Mean diff. = 1.77). Based on Cohen's d, the workshop had a large effect on participants' self-efficacy (d = 2.03). Upon completion of the workshops, most participants rated their ability level as "intermediate" on flying a drone autonomously to complete a mission (41%), flying a drone in a square pattern using pitch and roll controls (43%), setting up a drone field or tent with challenge elements (35%), and flying a drone to conduct an inspection using the drone internal camera (35%). Most participants rated their ability as "advanced" in supervising students who are flying drones to ensure safety procedures are followed (40%). One participant commented, "This was a wonderful workshop. I have learned so much, and I can't wait to integrate drones into my teaching. Thank you for everything you have provided to help me get started."

Publications

  • Type: Journal Articles Status: Published Year Published: 2023 Citation: Stewardson, D., Ortiz, C., Narine, L. K., & Furse, J. (2023). Engaging Utah Educators to Teach 21st-Century Skills Using Drones. Outcomes and Impact Quarterly, 3(2). Retrieved from https://digitalcommons.usu.edu/oiq/vol3/iss2/3


Progress 05/01/21 to 04/30/22

Outputs
Target Audience: Nothing Reported Changes/Problems:Now that COVID restrictions in schools have been eased, there are no foreseeable challenges in meeting the project objectives. What opportunities for training and professional development has the project provided? Nothing Reported How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?All curriculum will be completed and delivered to teachers particpating in workshops. All proposed workhops will be conducted Fall 2022. Evaluation of project will be conducted and completed.

Impacts
What was accomplished under these goals? Goal: Develop curriculum for grades 4-12 students Work on the curriculum continues. Goal: Deliver professional development workshops Workshops are being scheduled through three district curriculum coordinators; proposed fall 2022

Publications


    Progress 05/01/20 to 04/30/21

    Outputs
    Target Audience: Nothing Reported Changes/Problems:Although COVID challenges have put us behind in our planned schedule, there have been no major changes in the approach to the project. We are continuing as planned with a new graduate student and the same goals/objectives. There may be a need to request a no-cost extension depending on our ability to work with teachers due to COVID restrictions, but we will work with our Sponsored Programs office (at the advice of Dr. Carlos Ortiz) to make that request, if appliable. What opportunities for training and professional development has the project provided? Nothing Reported How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?Due to COVID challenges, this project has faced several setbacks. However, solutions have been created to solve those, and work will begin in May 2021 to accomplish the project goals: A graduate student will be hired to replace the student who left last May (originally written into the project) All curriculum will be completed COVID restrictions are changing which will, hopefully, allow us to present teacher professional development workshops in fall 2021 and winter/spring 2022

    Impacts
    What was accomplished under these goals? Goal: Develop currriculum for grades 4-12 students Currently working on the scope and sequence for twelve grade-appropriate lessons for each group of elementary, middle, and high school students Writing instruction in the use of quadcopters and drones Completed three of twelve lessons for elementary and middle school grades

    Publications