Source: UNIVERSITY OF ILLINOIS submitted to
ROBOTICS INTEGRATED HIGH TUNNELS (ROBINHIGHTS): CREATING PROFITABLE FOOD OASES IN URBAN ECOSYSTEMS
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1029772
Grant No.
2023-70019-39365
Cumulative Award Amt.
$1,000,000.00
Proposal No.
2022-10543
Multistate No.
(N/A)
Project Start Date
Mar 1, 2023
Project End Date
Feb 28, 2026
Grant Year
2024
Program Code
[UIE]- Urban, Indoor and Emerging Agriculture Initiative
Project Director
Krishnan, G.
Recipient Organization
UNIVERSITY OF ILLINOIS
2001 S. Lincoln Ave.
URBANA,IL 61801
Performing Department
(N/A)
Non Technical Summary
This project seeks to identify and promote Robot Integrated High Tunnels (RobInHighTs) as a major economic driver for successful urban, indoor and emerging agricultural platforms. High tunnels are ephemeral structures that cover and protect crops, thereby extending the growing season by several months in midwestern climate zones. They have gained popularity over the last two decades in the urban and peri-urban setting due to their cost-effectiveness, adaptability, and low environmental costs. Though advantageous, high tunnels require an extra degree of management to ensure a quality crop and good production rates as the urban environment brings new challenges with unique pests and soil quality. Sustenance and economic viability of urban high tunnels are thus limited by the shortage and rising inequities in urban agricultural workforce. The primary objective of the projectis to demonstrate that the RobInHighTs platform can greatly automate routine high tunnel operations leading to increased crop yield, reduced manual intervention, while simultaneously preserving soil quality for sustained use. Our approach, guided by our past research, will integrate compact mobile platforms and novel hybrid soft-rigid manipulators within high tunnel environments in the Illinois Student Sustainability Farm and demonstrate the potential to navigate autonomously through rows of crops in high tunnels, use AI-powered perception to identify targets such as berries, leaves and possible pests, and perform fine dexterous manipulation tasks such as berry harvesting, pruning and precision spraying. Furthermore, the proposal seeks to understand and evaluate the economic implications of such a platform, barriers to entry for urban and minority farmers, and scalable business models for industry involvement through focused group surveys, workshop demonstrations and other extension activities. The proposal brings together a team of roboticists, crop scientists with expertise in high tunnels, agricultural economists, and education and extension experts from University of Illinois Urbana-Champaign and Tuskegee University.
Animal Health Component
50%
Research Effort Categories
Basic
20%
Applied
50%
Developmental
30%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
20453102020100%
Goals / Objectives
Urban farms can enable efficient and fresh local food production, minimize food miles, and open new avenues of income for minorities and small communities. However, urban farms face unique challenges associated with achieving profitability at small production scales, maintaining air and soil quality, irrigation, pest management and the climate required for efficient and economically viable produce. In this project, we emphasize High Tunnels (HTs), which are low cost, unheated, metal-tube structures covered with one or two layers of greenhouse plastic to create a protected environment for crops, as ideal solutions for urban farming. HTs are gaining in popularity as they prolong the production season especially in midwestern and northeastern climatic zones, increase yields and improve the quality of high-value specialty crops such as fruits, vegetables and cut flowers. The primary goal of the projectis to investigate the feasibility of robot-aided autonomy to streamline labor intensive operations in the urban setting. Specifically, the goal of the Robot Integrated High Tunnels (RobInHighTs) platform is to integrate recent advances in robot hardware design, vision-based perception, autonomous navigation, and manipulation towards automating high tunnel operations such as harvesting, pruning and pest management thereby achieving sustainable increases in yield and profitability. A secondary goal is to map the economic implications that accompany the increase in yield and identify barriers to adoption by engaging with urban and minority farmers in Illinois and Alabama through our Extension activities. Furthermore, we aim to train the next generation agricultural workforce through curriculum development and workshop activities steeped in robotics.
Project Methods
Our approach consists of well-integrated research and Extension activities to conceptualize and evolve the RobInHighTs platform. For the scope and duration of this project, we will create the first iteration of RobInHighTs by integrating matured robotic fundamentals with High Tunnel operations. The evaluation of the technology together with stakeholder involvement will inform our understanding of adoption and profitability. Our long term approach will seek to integrate and incorporate feedback from the stakeholders to guide best HT integration practices, which will in turn will inform the need for new fundamental robotic capabilities. The specific research aims of the project are (i) SA1: Robustification of fundamental robotic operations, (ii) SA2: Demonstrate and evaluate RobInHighTs for intensive farming, and (iii) SA3: Assessment of profitability, socioeconomic barriers for adoption and workforce training.In SA1, we will build on the team's past expertise in automated navigation, vision-based perception and manipulation of fruits and leaves. These operations are fundamental to automating routine high tunnel tasks such as harvesting, pruning, and monitoring for pests. Our robot platform will be comprised of the commercial TerraSentia mobile robot with a unique hybrid (soft-rigid) manipulator and a gripper that is capable of dexterous manipulation and reach. Specifically, we will (i) Use a combination of stereo camera vision, inertial measurement units and LiDAR to navigate through rows of high tunnel crops, (ii) Use images from onboard cameras and tip camera on the manipulator to automate the identification and localization of targets such as berries and potential pests by employing deep learning-based object detection (fast R-CNN and YOLO) or instance segmentation (MaskRCNN, YOLACT), and (iii) Combine trajectory planning and controls, and visual servoing methods to approach and manipulate a target.In SA2, we will integrate and validate the robot platform within high tunnels at the Student Sustainability Farm at the University of Illinois. Two high tunnels will be used, one RobInHighTs, and another control high tunnel, which is similar in all aspects but managed without robotic intervention. Both high tunnels will grow tomatoes during the summer and early fall, and greens (lettuce, spinach etc.) during late fall. Specifically, we will (i) Program subroutines for harvesting, pruning and pest management of tomato vines based on existing best practices in the high tunnel, (ii) Understand the effect of frequent robotic monitoring on crop spacing and density in greens, and (iii) Evaluate the effect of RobInHighTs on the yield and manual labor hours by comparing it with the control high tunnel.In the Extension and education specific aim, we will engage with stakeholders, specifically urban growers and consumers to identify socioeconomic factors that can promote or hinder adoption of RobInHighTs. Specifically, we will (i) Conduct detailed crop budgets for the RobInHighTs by using estimates of yield, and labor effort from SA 2, (ii) Identify barriers for adoption through focused group interviews and (iii) Conduct statewide educational activities and workshops for training personnel to operate high tunnels with robots, leading to faster adoption. We will also engage with industry to better understand the barriers involved in providing robotics-based services for urban growers.

Progress 03/01/23 to 02/29/24

Outputs
Target Audience:Urban Farmers:Dixon Springs Agricultural Center High Tunnel Production Day at Dixon Spring, IL, University of Illinois Extension Twilight Meeting Series. Simpson, IL (July 13) (attendance of 29 people), 2023 Specialty Crops Field Day. Urbana, IL (August 7) (attendance of 15 people). Agricultural Robotics Researchers: A workshop at International Conference on Intelligent Robotics Systems (IROS 2023, Detroit, Michigan, USA) that brought together agricultural roboticists all over the world to discuss the state of the art, gaps and future directions for robotics in agriculture https://sites.google.com/illinois.edu/iros2023-agrobotics/home?authuser=0 Changes/Problems:High tunnel was not built. Instead Student Sustainability High tunnels (two out of the existing three) will be used for this project. One will be control and other will have the robots assisting in the manipulation and scouting tasks. What opportunities for training and professional development has the project provided?In the first year, two graduate students, and three undergraduate students have been supported by the project. Two graduate students from Engineering were trained in the design, assembly and system integration of agricultural robots, and specialized algorithms for implementing vision-based intelligence for manipulation The undergraduates were involved in assisting the graduate students with the robot platform learning skills in hardware assembly and ROS. One Natural Resources and Environmental Sciences undergraduate was employed to create crop budgets in high tunnel. She received training in conducting cost and return studies and applying them to identify break-even parameters / thresholds for farmer adoption of robotic harvesting. Dr. Athey presented the work on this project to crop science undergraduates on October 23rd in CPSC 102 course. How have the results been disseminated to communities of interest?Engagement with Research Community: The unique low-form factor dexterous manipulator on a mobile platform RoHighT and its ability to detect and grasp fruits and berries with high precision was submitted to IROS 2024. Furthermore, a workshop that brought together agricultural roboticists all over the world to discuss the state of the art, gaps and future directions for robotics in agriculture Engagement with Farmers/Growers: Our team made significant strides in engaging with urban farmer stakeholders in the last one year through participation in Dixon Springs Agricultural Center High Tunnel Production Day at Dixon Spring, IL, University of Illinois Extension Twilight Meeting Series. Simpson, IL (July 13) (attendance of 29 people), 2023 Specialty Crops Field Day. Urbana, IL (August 7) (attendance of 15 people). What do you plan to do during the next reporting period to accomplish the goals?In year II of the project, we will build on the success of our robotic platform to achieve the following goals: Integration of navigation module that enables autonomous row following in the HT. Integration of localization module to enable localization of interested plant for the downstream manipulation tasks. Preparation of open source datasets for robot navigation and manipulation in high tunnels. Incorporate training protocols on urban agriculture in courses in Tuskegee and UIUC As the field work for this project gets underway Dr. Athey and her team will be talking about this project at the summer field days. In addition, the team will also disseminate the information at the winter meetings to growers.

Impacts
What was accomplished under these goals? This proposal seeks to identify and promote Robot Integrated High Tunnels (RobInHighTs) as a major economic driver for successful urban, indoor and emerging agricultural platforms. We made significant progress in all our specific aims Robustification of Robotics Fundamentals: Towards this, our team undertook the assembly and systems integration of a unique low form-factor robot for operating in high tunnels. The robot constitutes a mobile rover platform with autonomous navigation capabilities on which is retrofitted a 6-dof robotic arm with a custom gripper end effector. The robot is equipped with vision capabilities both in the rover platform and at the end of the gripper. We have integrated state-of-the-art detection and segmentation algorithms for identifying the exact location of berries/fruits. When berries are detected, a visual servoing algorithm iteratively centers the fruit within the camera image and then proceeds toward it, resulting in grasping berries with a 100% success rate in 11.35s on average. Our initial work shows the potential for low-cost and low-form factor robots for use in high tunnels. Demonstrate and evaluate RobInHighTs for intensive farming: With the robot capabilities validated in the lab settings, we are in the process of deploying it in high tunnels at the Student Sustainability farms. In the summer of 2024, we will conduct additional tests on the usefulness of the robot to complement human labor in routine high tunnel operations. (expand) Assessment of profitability, socioeconomic barriers for adoption and work. We have developed a draft crop budget for a harvesting robot in a tomato high tunnel. The crop budget compares manual vs robotic harvesting for several values of robotic harvesting speed and robotic lease rates.We plan to receive peer review for the crop budget and release it among farmers this year. Furthermore, our team made significant strides in engaging with urban farmer stakeholders in the last one year through participation in Dixon Springs Agricultural Center High Tunnel Production Day at Dixon Spring, IL, University of Illinois Extension Twilight Meeting Series. Simpson, IL (July 13) (attendance of 29 people), 2023 Specialty Crops Field Day. Urbana, IL (August 7) (attendance of 15 people). Furthermore the award was used to co-sponsor an 'Agricultural Robotics for Sustainable Future" workshop at the International Conference in Intelligent Robot and Systems held at Detroit, MI in October 2023.

Publications