Source: AUTONOMOUS TRACTOR CORPORATION submitted to
SEMI-AUTONOMOUS FOLLOW-ME BIOMASS BALER
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
COMPLETE
Funding Source
Reporting Frequency
Annual
Accession No.
1015982
Grant No.
2018-33610-28234
Cumulative Award Amt.
$94,172.00
Proposal No.
2018-00245
Multistate No.
(N/A)
Project Start Date
Jun 15, 2018
Project End Date
May 14, 2019
Grant Year
2018
Program Code
[8.13]- Plant Production and Protection-Engineering
Recipient Organization
AUTONOMOUS TRACTOR CORPORATION
4302 13TH AVE S
FARGO,ND 58103
Performing Department
(N/A)
Non Technical Summary
This project addresses USDA-NIFA's research priorities regarding crop management systems that promote energy conservation and efficiency, including the use of alternative and renewable energy resources. This proposal outlines a plan to prove the research concept of a Single-pass Autonomous Follow-me (SAF) Baler. The SAF baler is intended to bale the available supply of corn stover during corn harvest by following the combine autonomously while allowing for a sufficient amount of stover to be reserved in the field for appropriate soil management practices.The single-pass baler is independently-powered and follows the combine without being physically attached. This baling method can reduce stover ash content and labor and equipment costs. The SAF Baler helps resolve issues with current baling practices: high stover ash content and operating costs associated with multi-pass methods; stress on the combine, slower operations and restricted combine maneuverability associated with single-pass operations wherein the baler is physically attached to and powered by the combine.This technology could contribute to the steady growth of the bioeconomy by reducing feedstock costs and improving the biomass quality for downstream biorefineries. The full development of a corn stover bioeconomy can unlock $2.1 billion dollars of additional income for American farmers.The proposal includes a complete 3D CAD model for a SAF Baler with engineering simulations to estimate stability, strength, power and cost characteristics. Safe, follow-me operations will be tested with a physical robot under varying conditions to prove the feasibility of autonomous follow-me operations. A cost-benefit analysis is included in the project's deliverables.
Animal Health Component
80%
Research Effort Categories
Basic
(N/A)
Applied
80%
Developmental
20%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
4025310202080%
4026110301020%
Goals / Objectives
The objectives of this Phase I project are:1. To ensure the engineering feasibility of building a Single-pass, Autonomous, Follow-me (SAF) Baling system2. To ensure the technical feasibility of designing a navigation and safety system for the SAF baler to operate without physical attachment to the combine and one driver operating only the combine3. To assess the economic viability of a SAF baling system using data obtained from Objectives 1 and 2 and information contained in the many reports included in the BibliographyProject Design - the project will be executed in two parallel work streams:Work Stream 1 - CAD ModelingATC's engineers and design staff are highly trained, with decades of experience in CAD modeling for companies such as Ford Motor Company. This team will assemble a full 3D CAD model of the proposed SAF baler in SolidWorks and gather the technical information required to ensure the SAF baler can be built and will operate efficiently in the field once the product is built. The team will select the components required the SAF baler consisting mostly of off-the-shelf products: a square baler as a reference platform; a diesel generator set; ATC's eDriveTM motors and ATC's proprietary eDriveTM variable torque controllers to control the speed and power of the motors. From the dimensions, weight and performance characteristics of these components, a complete CAD model will be constructed and will undergo a series of engineering tests and simulations including structural integrity, stability / center of gravity, manufacturability, complete cost of manufacturing, speed of travel, speed of baling, etc.The ATC team has done this very sort of retrofit installation many times in the past including a large John Deere 8760 articulated tractor and a John Deere 4930 self-propelled sprayer, both shown in Figure 5. Currently, ATC is working with a large OEM to do a similar retrofit of their 100hp tractor to demonstrate the feasibility of electrifying their tractor platform with the intent to go into production in 2-3 years.Work Stream 2 - Follow-me Navigation TestingThere are many economical navigation technologies today that allow for drones (both aerial and ground) to follow a desired object. These technologies have not yet been tested in the proposed SAF Baler application. Indeed, most of these technologies are designed for hobby use. However, they have proven able to control even large vehicles such as tractors (Ardupilot, 2016). ATC's electronics engineers believe that one of these off-the-shelf systems could be repurposed for the SAF baler, allowing for reasonably precise following of the combine by the baler. Most of these systems also have object detection and safety functionality that would make the SAF baler safe to operate in the field.The technology most attractive to ATC's engineers is the open-source technology found in Ardupilot. This software system supports Arduino board-based drones for aerial, aquatic and ground use (Ardupilot, 2016). This technology has multiple sensors for follow-me technology including GPS "breadcrumbs," optical sensors, ultrasonic beacons and infrared cameras. It has been used in hundreds of applications including agriculture to create self-driving tractors. There is also a Kalman filter available to fuse the various tracking sensors into a single guidance path. There are hundreds of ready-built libraries that ATC's engineers can leverage to get through testing and validation quickly.The proposed vehicle on which to test this follow-me safety and navigation system using Ardupilot is the Erle Rover, a complete robot vehicle kit that is made to run with Ardupilot (Erle Robotics, 2017). While the vehicle is obviously much smaller than a baler, the principle of follow-me safety and navigation features are very similar and its scale will allow for more extensive testing and validation of the Ardupilot system. Since the code is open-source it can be more easily adapted to a larger-scale implementation like the SAF baler.In order to test the accuracy of the Ardupilot safety and navigation system, ATC proposes using the Erle Rover following another vehicle under varying conditions using an on-board, high resolution camera to track the movement of the Erle Rover relative to its intended target on the back of the lead vehicle. Analyzing this footage will give strong indicators of the distance and lateral position of the Rover versus the lead vehicle. To facilitate this analysis, ATC intends to use the open-source digital image analysis software Tracker, developed by Douglas Brown at Cabrillo College. Originally intended for physics classes to learn about trajectories, acceleration and other concepts, the software's applications have grown over the years and it is now possible, when the experiment is set up correctly, to analyze video footage to determine relative X, Y, Z positions of various objects with a high degree of accuracy. The footage obtained in this experiment will analyze an individual target on the back of the lead vehicle and determine the movement of this target from its starting orientation and position (e.g., dead center). X, Y, Z changes of this target during vehicle travel will indicate how accurately the following vehicle is tracking the lead vehicle's course.One key thing to note about this navigation and safety technology is that the performance hurdle is not very high: if the baler misses some of the harvest material coming off the combine because it is slightly out of position, there is really no harm, just a reduction in system efficiency. Furthermore, there are actually very few objects or people in the field during harvest that the baler would have to avoid on its own. As there will always be a driver in the combine and the baler is following the combine in very close proximity, there are few instances imaginable in which the baler's independent safety systems would need to be activated. There are currently no legal restrictions to the use of autonomous ground equipment on private property and the use of the SAF baler would be constrained only to private property. For transport to and from the field, the baler would be towed by a pickup or tractor on a flatbed trailer or with a hitch as a conventional baler is today.
Project Methods
Efforts:The ProjectTeam will assemble a full 3D CAD model of the proposed SAF baler in SolidWorks and gather the technical information required to ensure the SAF baler can be built and will operate efficiently in the field once the product is built. The team will select the components required the SAF baler consisting mostly of off-the-shelf products: a square baler as a reference platform; a diesel generator set; ATC's eDriveTM motors and ATC's proprietary eDriveTM variable torque controllers to control the speed and power of the motors.ATC's electronics engineers believe that the off-the-shelf "Ardupilot" systemcould be repurposed for the SAF baler, allowing for reasonably precise following of the combine by the baler. Most of these systems also have object detection and safety functionality that would make the SAF baler safe to operate in the field. This navigation and safety system will be placed on a test platformErle Rover, a complete robot vehicle kit that is made to run with Ardupilot.Ardupilot is a complete software and hardware system that supports Arduino board-based drones for aerial, aquatic and ground use (Ardupilot, 2016). This technology has multiple sensors for follow-me technology including GPS "breadcrumbs," optical sensors, ultrasonic beacons and infrared cameras. It has been used in hundreds of applications including agriculture to create self-driving tractors. There is also a Kalman filter available to fuse the various tracking sensors into a single guidance path. There are hundreds of ready-built libraries that ATC's engineers can leverage to get through testing and validation quickly.Finally, amore thorough economic model including equipment capital and operating costs, handling costs, storage, feedstock quality and other economic considerations will be constructed as part of this Phase to provide a clearer understanding of the economic benefit that could be achieved by farmers and biorefineries using a SAF baling system.Evaluation:CAD Model: From the dimensions, weight and performance characteristics of these components, a complete CAD model will be constructed and will undergo a series of engineering tests and simulations including structural integrity, stability / center of gravity, manufacturability, complete cost of manufacturing, speed of travel, speed of baling, etc.Follow-me System: In order to test the accuracy of the Ardupilot safety and navigation system, ATC proposes using the Erle Rover following another vehicle under varying conditions using an on-board, high resolution camera to track the movement of the Erle Rover relative to its intended target on the back of the lead vehicle. Analyzing this footage will give strong indicators of the distance and lateral position of the Rover versus the lead vehicle. To facilitate this analysis, ATC intends to use the open-source digital image analysis software Tracker, developed by Douglas Brown at Cabrillo College. Originally intended for physics classes to learn about trajectories, acceleration and other concepts, the software's applications have grown over the years and it is now possible, when the experiment is set up correctly, to analyze video footage to determine relative X, Y, Z positions of various objects with a high degree of accuracy. The footage obtained in this experiment will analyze an individual target on the back of the lead vehicle and determine the movement of this target from its starting orientation and position (e.g., dead center). X, Y, Z changes of this target during vehicle travel will indicate how accurately the following vehicle is tracking the lead vehicle's course.Eonomic Model: The economic model will be assembled and evaluated by comparing the delivered cost and quality of corn stover to a biofuel plant using the SAF baling method versus conventional multi-pass harvest method and single-pass harvest method (Cost/Beneift Analysis). Although the focus of this project will be on corn stover, the applicability of designed SAF Baler and its costs/benefits will be discussed for other biomass feedstocks such as switchgrass and miscanthus. This work will be overseen by Dr. Ebadian who has published several papers on system economics of biofuel production.

Progress 06/15/18 to 05/14/19

Outputs
Target Audience:The intended Target Audiences for this project include farmers, biofuel industry experts, equipment manufacturers and technology experts / researchers who are looking at farm automation and autonomous vehicles more broadly. During the course of this project the team was able to reach many of these audiences: Farmers: One key event at which we were able to discuss this work was at the Forage Symposium sponsored by the Wisconsin Custom Operators on February 19, 2019. This was a chance to show our vision to potential end-users. The feedback we got was very supportive and positive.We also spoke to several farmers looking at similar problems the SAF Baler project is addressing. One example is a pistachio farmer in the San Joachin valley. Harvesting pistachios requires coordination of two tractors operating on opposite sides of a tree - one to shake the tree and the other to gather the falling pistachios. Labor costs are high (in excess of $17 / hour) and pistachio farmers are looking to cut out labor. Using very similar technology to the SAF Baler, this farmer is undertaking a retrofit of his existing equipment to have one "follow" the other, eliminating one driver. Other farmers we talked to could see application in grain carts, planters and small-scale sprayers (primarily for orchards). Biofuel Industry Experts: the team discussed the baler project with various stakeholders in industry, universities, and government labs who are currently doing various projects on biomass and biofuel production and logistics in the US. Dr. Ebadian was part of a project entitled "Evaluation of Agricultural Equipment Manufacturing for a Bio-based Economy " andpresented the SAF baler as one of the potential transitions in ag equipment industry to support the commercial productions of biofuels and bio-products in the US. The general sense on the ideawas very positive, especially that we are using many off-the-shelf systems and ATC's eDrivediesel-electric propulsion system that thas beenproven reliable in similar applications. They also found the retrofit of the existing baling equipment and using off-the-shelf systems as the right approach to de-risk the commercialization of the SAF and reduce the adoption time. They generally supported this project as a good idea to reduce both biomass costs and improve its quality, especially ash content and reduce labor and equipment costs. The two main questionsraised were1) the trade-off between the retrofit costs and potential savings in operating costs and biomass quality and how the quality of biomass should be monetized; and 2) The need to educate both biomass producers and users on the benefits of the new approach compared to the conventional baling equipment as the adoption of new equipment is typically slow in agricultural industry. Equipment Manufacturers: the team did speak with equipment manufacturers about the SAF Baler. We reached out to single-pass baler equipment manufacturers who were generally quite interested in our technology but expressed concern about how ATC's technology might interfere with the largest OEMs' ambitions in the baling market.Other equipment manufacturers could see the benefits of being able to self-power and steer various types of equipment using the Baler technology including a large navigation equipment manufacturer. Technology Experts / Researchers: We have shared our work with numerous technology experts in robotics, sensors, propulsion systems and agricultural vehicles. The feedback was generally very positive and many were surprised at how we could use relatively inexpensive and old technology to perform the "follow-me" operations. Many technologists assume that for such operations we would have to employ much more sophisticated technology such as artificial intelligence, LIDAR and expensive microprocessors. Changes/Problems:The most significant change to the project was in designing the "follow-me" technology. The original design used "breadcrumb" technology and ultrasonic positioning sensors and removed the hitch entirely. It was determined, however, that this system would not meet our objectives. First, removing th hitch made created a problem in bringing the baler to / from the field as it must be acceptably tethered to the lead vehicle while on public roads. Second, the sensors were too slow to react to the rapid movements in the field, especially during sharp turns. They also would be more costly and posed a risk of losing connectivity with the on-board computer. Therefore, the team decided to leave the hitch on the baler but modify it with analog fore-aft and lateral sensors that were much faster in response time, posed virtually no threat of losing connectivity and were a much more economical solution. Testing of this system yielded the +/- 3" accuracy the team was aiming for in the design at field speeds. What opportunities for training and professional development has the project provided?Dr. Ebadian worked closely with ATC's advisor, Harold Wallace, a custom harvester of many years. Mr. Wallace was able to give Dr. Ebadian significant real-world insights into harvesting techniques, opportunities and challenges that deepened Dr. Ebadian's understanding of harvesting operations. Mr. Wallace used the Wisconsin Custom Harvesters' meeting to sharpen his presentation skills and speak to an audience of peers about the benefits and challenges of biomass harvesting including the SAF Baler. Mr. Schulz worked very closely with ATC's founder, Terry Anderson, to design and implement the "follow-me" navigation technology. Mr. Schulz learned a tremendous amount about navigation technology, electronics and vehicle control during the process. How have the results been disseminated to communities of interest?High-level results were discussed publicly at the Wisconsin Custom Operator's meeting in February, 2019. Discussions with other communities of interest (investors, OEM partners, academics and biofuel industry leaders) are either ongoing or planned for 2019. What do you plan to do during the next reporting period to accomplish the goals? Nothing Reported

Impacts
What was accomplished under these goals? 1. A design and engineering CAD model of the SAF Baler was developed and analyzed. This work indicated that a SAF Baler was feasible to build and would theoretically meet the performance and stability requirements. 2.A pre-prototype SAF Baler rover was constructed with the "follow-me" navigation system that controlled the speed and direction of the rover based on the movements of the lead vehicle. Video analysis indicated that the rover could follow the lead vehicle at approximately +/- 3 inches off dead-center accuracy at normal field speeds. 3.A cost-benefit model was built and populated with the most realistic data available to understand the potential cost savings and payback period for farmers using the SAF Balerand biofuel producersusing the product from the SAF Baler. It found that this technology could save approximately 23-47% in the cost of harvesting corn stover versus convention multi-passand single-pass methods.

Publications

  • Type: Conference Papers and Presentations Status: Published Year Published: 2019 Citation: "Single-pass, Autonomous, Follow-Me Biomass Baler," Wisconsin Custom Operators Association Meeting, Wisconsin Dells, WI, February 19, 2019.