Source: MICHIGAN STATE UNIV submitted to NRP
INTEGRATED SYSTEMS RESEARCH AND DEVELOPMENT IN AUTOMATION AND SENSORS FOR SUSTAINABILITY OF SPECIALTY CROPS
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
COMPLETE
Funding Source
Reporting Frequency
Annual
Accession No.
0217117
Grant No.
(N/A)
Cumulative Award Amt.
(N/A)
Proposal No.
(N/A)
Multistate No.
W-1009
Project Start Date
Oct 1, 2008
Project End Date
Sep 30, 2013
Grant Year
(N/A)
Program Code
[(N/A)]- (N/A)
Recipient Organization
MICHIGAN STATE UNIV
(N/A)
EAST LANSING,MI 48824
Performing Department
Biosystems & Agric Engineering
Non Technical Summary
The continuing trend of declining available labor, combined with an increasing consumer desire for a safe and high quality food supply, the pressure of global competition, and the need to minimize the environmental footprint, represents challenges for specialty crop sustainability in the US. Producers and processors are urgently seeking new devices and systems which will aid them during production, harvesting, sorting, storing, processing, packaging, marketing, and transportation while also minimizing input costs. Currently, there is a lack of effective and efficient sensors and automation systems for specialty crops (fruits, vegetables, tree nuts, dried fruits and nursery). This is because many of the underlying biological processes related to quality and condition of fruits and vegetables are difficult to translate into engineering concepts. Biological variability, coupled with the variable environmental factors, makes it difficult to develop sensors and automation systems for effective implementation at various stages of the production, harvest and postharvest handling chain. Additionally, obtaining measurement of biological factors internal to the commodity is difficult using external, nondestructive sensors, as such devices or processes used must adapt to a wide variation in shape, size, and maturity of the commodity being processed. It is a challenge for any single specialty crop sector to afford the cost of research, development, and commercialization of this complex level of automation. It is thus important to assist this economically vital agricultural sector with sensor and automation research and development to address economic and environmental sustainability challenges. This project will investigate spectral properties of materials and electronic sensor technology which have the potential to detect and quantify differences in biological materials, whether the differences be physical or chemical based. Timely monitoring and measurement of biological factors can assist producers in reducing input costs, maximizing returns, and minimizing the environmental footprint.
Animal Health Component
(N/A)
Research Effort Categories
Basic
(N/A)
Applied
(N/A)
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
4042410202070%
7124099202010%
7235010100010%
7235010106010%
Goals / Objectives
Adapt biological concepts associated with specialty crop production, harvest, and postharvest handling into quantifiable parameters which can be sensed Develop sensors and sensing systems which can measure and interpret the parameters Design and evaluate automation systems which incorporate varying degrees of mechanization and sensors to assist specialty crop industries with labor, management decisions, and reduction of production costs Work in partnership with equipment and technology manufacturers to commercialize and implement the outcomes of this project
Project Methods
The methods and general procedure of this project include studying, identifying, and increasing knowledge of properties of biological materials that potentially change and are related to important information for optimizing production and handling of various specialty crops. This also includes understanding environmental factors that influence production. More specifically, develop an understanding of biological (physical or chemical) factors that are indicators of maturity, storage potential, or other processing or marketability potential as well as orchard environmental factors such as insect or disease pressure which impact production. This will be accomplished through literature and working in collaboration with horticulture, entomology, and pathology scientists to understand what factors can potentially be monitored to more precisely manage a commodity from production to consumer. The project will identify spectroscopic and spectral imaging electronic technologies, capable of detecting and potentially quantifying the various quality or production influencing factors. Additionally, the potential exist to identify bio-based sensors to detect food safety and/or airborne organisms that are of importance to the specialty crop system. The project will then narrow focus to a limited number of factors to address based on importance to the specialty crop industries, the availability of measurement instrumentation, and the potential for successful development. Samples of factors to be measured, such as fruit, insects, diseased tissues, etc. will be collected and measured with appropriate laboratory-based spectral and image instrumentation and compared against ground truth basis measurements. Evaluation of concepts will be based on the ability to successfully detect the desired factor(s) and the potential for practical implementation based on cost and ability to transfer technology to a field-based system. The final procedure will be to develop dedicated instrumentation which can be tested as a field-based prototype.

Progress 10/01/08 to 09/30/13

Outputs
Target Audience: The chestnut commodity industry producers and processors. The tart cherry commodity industry producers and processors. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided? These projects provided unique design and technology learning experiences for at least two graduate students and the opportunity to interact internationally with other reseachers and commercial development entities. How have the results been disseminated to communities of interest? Both the cherry and the chestnut harvest projects have been shared with interested communities through in-field demonstrations and industry-level conferences. Additionally, project activities and results have been disseminated in achived journal articles and in some cases periodicals. What do you plan to do during the next reporting period to accomplish the goals? Nothing Reported

Impacts
What was accomplished under these goals? In relation to Objectives 3 and 4: Evaluation of existing specialty crop havest systems for potential application to tart cherry canopy production and harvest systems. More specifically, through efforts of this project, rotary tine canopy shakers have emerged as a very good candidate for canopy shaking of tart cherry with some additional development needed in bulk handling of the harvested fruit and in development/establishment of plant structures optimally compatible with the size and concept of over-the-row canopy systems. Thus, in synergism and parallel with the harvesting evaluation, horticultural production approaches evaluating cultivars, rootstocks, and plant structure (pruning) variables have been initiated to optimize the plant and machine interface and the overall goal of the unique production system. A commercial equipment manufacturer has become an interested collaborator in support of the project and has provided equipment for evaluation. To date this effort has demonstrated strong potential and interest from several industry leaders. This project is long-term as it involves the growth of annual tree structures which spans beyond the ending date of this project. This aspect of this overall multistate project has demonstrated a synergistic optimization and overall systems approach to a cherry production system which has strong potential to positively impact profitability, environmental sustainability, and product quality in an industry where current production sustainability is relatively strained and uncertain. Additionally, in relation to Objective 3: Chestnut harvest systems have been explored and new approaches/concepts developed. An unique approach utilizing terminal and saltation velocities was studied and prototyped which provides for a single-stage, and relatively simple means, to harvest (pick-up) and at the same time utilize the same airstream to perform separation between desireable and undesirable material. The concept has proven to function well and is such it could be presented for further commercial development and application. The chestnut harvest project has addressed the challenge of chestnut production in the U.S. continuing to increase and while European produced harvest systems exist commercially, only one system appears to currently exist which harvests and separates material and this system may not address U.S. needs and conditions. In relation to Objective 1 and somewhat to Objective 2: Efforts continued on preliminary and exploratory studies of Computed Tomography (CT) for detection and potential quantification of defects internal to multiple specialty crops, including cherry insect detection and pit detection and chestnut insect and pathological internal disorders. Parameters and other understanding has resulted that are important toward guiding future application of CT into the food and raw product domains, including information needed to develop new dedicated hardware technology. A new potential application of carrot fibrous tissue identification has additionally been identified and will be pursued under the new phase of this NIFA project. The CT sensing aspect of this multistate project contribution addresses detection of internal defect and quality, which is not possible via other approaches, which further assists specialty crop industries to direct product to markets which will optimize returns.

Publications

  • Type: Journal Articles Status: Published Year Published: 2012 Citation: Wen, C., Guyer, D.E., 2012. Image-based orchard insect automated identification and classification method. Computers and Electronics in Agriculture. 89:110-115.
  • Type: Journal Articles Status: Published Year Published: 2012 Citation: Donis-Gonz�lez, I.R., Guyer, D.E., and Pease, A. 2012. Application of Response Surface Methodology to systematically optimize image quality in computer tomography: A case study using fresh chestnuts (Castanea spp.). Computers and Electronics in Agriculture. 87: 94-107.
  • Type: Journal Articles Status: Published Year Published: 2012 Citation: Donis-Gonzalez, I.R., Guyer, D.E., Pease A., and Fulbright, D.W. 2012. Relation of computerized tomography Hounsfield unit measurements and internal components of fresh chestnuts (Castanea spp.). Postharvest Biology and Technology 64: 74-82.
  • Type: Journal Articles Status: Published Year Published: 2012 Citation: Guyer, D.E., DeKleine, M.E., Perry, R.L. 2012. New approaches in cherry and chestnut harvest systems. International Symposium on Mechanical Harvesting and Handling Systems of Fruits and Nuts. Editor: J.P. Syvertsen. Lake Alfred, FL. April 2012. Acta Horticulturae (ISHS) 965:189-194.
  • Type: Journal Articles Status: Published Year Published: 2012 Citation: Donis-Gonzalez, I.R., Guyer, D.E., Pease, A., Fulbright, D. 2012. Relation of computerized tomography Hounsfield-unit measurements and internal characteristics of fresh chestnuts (Castanea spp.). Postharvest Biology and Technology. Vop. 64. p 74-82.
  • Type: Journal Articles Status: Published Year Published: 2013 Citation: Donis-Gonz�lez, I.R., Guyer, D.E., Leiva-Valenzuela, G. A., and Burns, J. 2013. Assessment of chestnut (Castanea spp.) slice quality using color images. J. of Food Eng. 115: 407-414.
  • Type: Theses/Dissertations Status: Published Year Published: 2013 Citation: Donis-Gonzalez, I.R. 2013. Nondestructive evaluation of fresh chestnut internal quality using x-ray computed tomography (CT). PhD. Dissertation. Michigan State University, East Lansing, MI 48824.


Progress 01/01/12 to 12/31/12

Outputs
OUTPUTS: This multi-state project encompasses a combination of mechanical and/or electronic based automation sub-projects. The primary mechanical automation study relates to a quite significant revolution of the tart cherry production system to increase profitability and sustainability. The concept involves a combination of changing plant structure and new harvest approaches. The proposed plant structure brings the orchard into production sooner and more uniformly in addition to the plant structure supporting the new approach of canopy shaking. The canopy harvest approach has the potential for over-the-row systems and improved fruit quality. The harvest concept has been trialed with blueberry canopy harvest systems on existing tart cherry plant systems with good success. This Michigan State University station under the W-1009 multi-state project has collaborated with the Washington State University member to develop proposals for interchangeable over-the-row automation for this and apple harvest assist systems. Commercialization partners have been identified. Funding to support the next step of development has not met with success. Work with a progressive grower has helped the project move forward. Evaluation of, and development of parameters for, Computed Tomography (CT) as a tool for internal quality assessment of fruits, vegetables, and chestnuts represents efforts under this project in the domain of electronic sensor automation. The goal of the CT-based defect detection is to support the technology development and application for on-line sorting. The project is positioned to move forward and continue collaboration with identified entities which are in the field of development of new rapid CT instrumentation hardware. Work is additionally continuing with the USDA-ARS-E. Lansing project member station to evaluate the potential of NIR spectroscopy and hyperspectral imaging to rapidly measure reducing sugars in potatoes. The newest and a unique project has been collaboration with material scientists to develop a set of cherry phantoms with very similar CT measurable density properties to those of real tart cherries. This has been successful, thus allowing the same set of samples, which are of course nonperishable, to be evaluated and directly compared under different systems and variables. These phantoms also allow the opportunity for study/measurements to be collected year round as well as around the world. PARTICIPANTS: Daniel Guyer, Lead Project Investigator, Directed and participated with all activity and personnel associated with the project. Ron Perry, Professor, Horticulture, collaborator on cherry orchard systems and automation project and proposal. Irwin Donis-Gonzalez, Research Assistant, Postharvest technologies for quality determination in chestnuts and other commodities. Washington State University, Center for Precision Agriculture. Partnering on proposed work on over-the-row technology/automation. TARGET AUDIENCES: The Michigan and US Cherry Industry; The Michigan and US Apple Industry; The Michigan and US Chestnut Industry; The US Specialty Crop Industries in general PROJECT MODIFICATIONS: Nothing significant to report during this reporting period.

Impacts
A revolutionized cherry production system will have a positive impact on industry profitability as canopy shaking and appropriate matched plant structures increase the productivity of an orchard while improving final fruit quality. Increased fruit uniformity is also expected. Postharvest electronic quality evaluation systems can impact commodity profitability through prevention of poor or defective material from entering the marketing chain and by measuring commodity physiological status and quality and directing it to the most profitable utilization options. The development of a cherry phantom with real cherry properties has a very positive impact by providing a set of samples that can act as a standard and be measured year-round and evaluated by systems and shared with collaborators in other regions of the world. To date the outcomes of the projects have been collaborative proposals to enhance/support the advancement of these projects and publication of scientific and technological advances associated with the studies. Equally impacting is the collaboration, involvement, and shared enthusiasm for success with the associated commodity industries.

Publications

  • Wen, C., Guyer, D.E. 2012. Image-based orchard insect automated identification and classification method. Computers and Electronics in Agriculture. 89: 110-115.
  • Donis-Gonzalez, I.R., Guyer, D.E., and Pease. 2012. A. Application of Response Surface Methodology to systematically optimize image quality in computer tomography: A case study using fresh chestnuts (Castanea spp.). Computers and Electronics in Agriculture. 87: 94-107.
  • Donis-Gonzalez, I. R, Guyer, D.E., Pease A., and Fulbright, D.W. 2012. Relation of computerized tomography Hounsfield unit measurements and internal components of fresh chestnuts (Castanea spp.). Postharvest Biology and Technology 64: 74-82.
  • Donis-Gonzalez, I.R., Guyer, D.E., Pease, A., Fulbright, D.W., and Barthel, F. Internal characteristics visualization of fresh chestnuts (Castanea spp.) using traditional and ultrafast limited-angle-type x-ray Computed Tomorgaphy (CT) imaging. Shepherdstown, WV, USA, September 4-8, 2012. Fifth International Chestnut Symposium.
  • Donis-Gonzalez, I.R., Guyer, D.E., Leiva-Valenzuela, G.A., and Burns, J. Quality assessment of sliced chestnut (Castanea spp.) using color images. Shepherdstown, WV, USA, September 4-8, 2012. Fifth International Chestnut Symposium.


Progress 01/01/11 to 12/31/11

Outputs
OUTPUTS: Multiple mechanical and electronic based automation projects with varying degree of partnering with other stations exist under this multi-state project (W-1009). Under an innovative cherry production systems project, evaluating commercially available mechanical shaking/removal systems and concepts for their potential to remove fruit (cherries) successfully and damage free are being tested on different tree structures and fruit systems. Test orchards are being developed. This project is integrating with proposed efforts to research and develop over-the-row (OTR) systems for specialty crops in collaboration with the Washington State Univ. multi-state member. An OTR primary mover with interchangeable modules for pruning, thinning, and harvest are to parallel and integrate with orchard system design for tree fruit. Additionally, this station (MSU) is proposing coordination in linking a harvest assist system project at W-1009 member institution Penn St. with the OTR project in the specific area of an OTR apple harvest assist module. Physical automation under another sub-project involves evaluation of, and also development of, chestnut harvesting systems. Two sub-projects relating to electronic sensing fall under the domain of this overall project. Computed tomography (CT) measurements and instrumentation optimization for chestnut quality are being conducted on a medical grade CT system under varying energies and resolutions. Preliminary measurements of selected additional specialty crops for potential application are ongoing. Under another project to determine physiological status of potatoes, visible and near infrared measurements of whole tubers and slices under modes of interactance, reflectance, and hyperspectral imaging scattering measurement are being correlated/validated against wet chemistry analysis of sucrose and glucose concentrations. This latter work is partnering with the USDA-ARS-E. Lansing project member station. PARTICIPANTS: Daniel Guyer, Lead Project Investigator, Directed and participated with all activity and personnel associated with the project. Ron Perry, Professor, Horticulture, collaborator on cherry orchard systems and automation project and proposal. Washington State University, Center for Precision Agriculture. Partnering on proposed work on over-the-row technology/automation. TARGET AUDIENCES: The Michigan and US Cherry Industry; The Michigan and US Apple Industry; The Michigan and US Chestnut Industry; The US Specialty Crop Industries in general. PROJECT MODIFICATIONS: Nothing significant to report during this reporting period.

Impacts
Very successful results continue to be demonstrated with spindle/tine shakers on tart cherries without any modifications yet to optimize such systems. New innovative cherry production systems/concepts integrating and optimizing plant and automated systems will contribute to environmental and economic sustainability for the cherry industry. While only in the proposal development stage, over-the-row (OTR) systems have the potential to increase production efficiency (with consideration of manufacturing efficiencies), productivity, and profitability for special crops. With cost, regulation, and availability concerns relating to labor, harvest automation (full or assist) is becoming ever more critical. With chestnut harvesting systems not currently available in the U.S., and with an emerging need for such, evaluation and demonstration of commercial chestnut harvest automation in general and also addressing potential technology voids in the industry with concept development is important to this emerging industry. A new/unique single-stage concept has been developed, tested, and is promising. Dissemination of information on orchard floor management for optimal mechanical chestnut harvest has been shared with the industry through meetings and on-farm demonstration. Computed tomography (CT) results have been very positive toward detecting internal characteristics of chestnuts and also a select few additional specialty crops that possess characteristics that are not easily or possible to detect with conventional methods of projective imaging or sensing. Optimal CT system scanning parameters for potential dedicated instrumentation development have resulted from this study. Progress, but no outcomes to date, has resulted on the project for a rapid assessment tool to measure the physiological status of potato for near real-time decisions on marketing/storage/harvest.

Publications

  • No publications reported this period


Progress 01/01/10 to 12/31/10

Outputs
OUTPUTS: This project is associated with the multi-state project W-1009 relating to automation and sensors for sustainability of specialty crops. Michigan State University is one of many institutions affiliated with this project. This multi-state project did not formally gather or collaborate collectively during this reporting period. However, one very relevant collaborative activity involving some members of the W-1009 project, and falling under the "automation for sustainability of specialty crops" domain of W-1009 and this report, is ongoing in the form of a proposal. This proposal is in development for an USDA-SCRI submission related to development of high-efficiency orchard systems which includes coupling/integrating this development synergistically with over-the-row (OTR) automation. The crops directly targeted at this point are apples, tart cherries, and sweet cherries. This automation is proposed to focus on a common platform/power unit which will act as the host to universally interchangeable task-specific implement modules for spraying, harvesting, pruning, etc. and be flexible to adapt to various horticultural production systems. At MSU specifically, we have already uniquely conducted preliminary tests with commercially available berry harvesting systems/concepts on common and semi-adapted tart cherry production systems with good success. This has provided the impetus to continue development of automation systems similar in concept specifically for tart cherries in concert with effectively matched horticultural production systems with the hypothesis a more economically and environmentally sustainable high-efficiency overall system can be developed. This tart cherry concept integrates very well with, and into, the broader SCRI over-the-row general automation project. PARTICIPANTS: Daniel Guyer, Lead Project Investigator, Directed and participated with all activity and personnel associated with the project. Ron Perry, Professor, Horticulture, collaborator on cherry orchard systems and automation project and proposal. TARGET AUDIENCES: The Michigan and US Cherry Industry; The Michigan and US Apple Industry; The US Specialty Crops Industries PROJECT MODIFICATIONS: Nothing significant to report during this reporting period.

Impacts
The specific project noted in the output section is only in the proposal stage, and thus has not produced any reportable impacts to date. The expected impacts are increased specialty crop economic and environmental sustainability through more efficient production systems and automation which is more attractive and affordable overall for both specialty crop producers and equipment manufacturers.

Publications

  • No publications reported this period


Progress 01/01/09 to 12/31/09

Outputs
OUTPUTS: This project is associated with the multi-state project W-1009 relating to automation and sensors for sustainability of specialty crops. Michigan State University is one of many institutions affiliated with this project. Multiple individual projects at MSU are reportable under this specific CRIS project. Studies related to automation of insect monitoring in the orchard have been conducted. Insect pest species common to orchards have been captured and digitally imaged in varying poses to obtain training and testing data sets for image processing, pattern recognition, and classification routine development. Classification rates are exceeding 90% with errors due to intra- and inter-species similarities and variability respectively. This is the first step toward a long-term goal of automated monitoring systems. The next step, which is currently part of the study, and which is seen as an intermediate step to full automation, is to develop an insect monitoring "assist" tool. The objective of this intermediate step is to develop a system to automatically "read" or evaluate "sticky traps", and thus insects captured on "sticky traps". These sticky traps are commonly utilized during integrated pest management efforts to monitor for presence and emergence of undesirable insects. An expert trained in insect identification is required in the monitoring process. Insect classification routines developed in the first phase of the research have demonstrated the capability of classifying insects, which are within the domain of this study, randomly captured on sticky traps. This demonstrates advancement from single insect identification under structured conditions to classification within a random and semi-unstructured setting of sticky traps that are part of an actual practice in orchards. The long-range goal is to have complete orchard automation in which the insects can be monitored continuously or semi-continuously without labor requirements. A second project involved participation on efforts of evaluation of alternative canopy-based, rather than trunk-based, fruit removal methods for cherries. Over-the-row systems used in other commodity systems, with a 2009 focus on spindle shakers for blueberries, were tested on various cherry varieties. Good fruit removal and low damage levels demonstrated the potential for the concept in cherries, especially with machine and orchard design modifications. Biosensor development is also tangentially associated under this project and this includes development of biologically modified electrically-active magnetic nanoparticles (nano-BEAMs) for direct capture and concentration of Bacillus anthracis spores and cells in various foods. The capture efficiency of the nano-BEAMs was compared with commercially available immunomagnetic beads (IMB) in pure cultures of E. coli O157:H7 and also in selected food samples, such as lettuce artificially contaminated with the microorganism. PARTICIPANTS: Dr. Daniel Guyer: Primary project PI. Coordinates efforts under this project and is lead researcher on all projects other than the biosensors work. Is official representative to the W-1009 multi-state project. Dr. Alocilja: Project participant in the area of biosensors. Ms. Chenglu Wen: Graduate student working on automated insect monitoring systems. TARGET AUDIENCES: Specialty crop industries involved in precision pest management strategies. The Michigan Cherry Industry PROJECT MODIFICATIONS: Nothing significant to report during this reporting period.

Impacts
The automation related projects reported here are in their early stages and as such are not able to report quantifiable or demonstrated outcomes. These efforts represent a combination of rather basic and/or long-term applied research. The expectation is that the automated insect monitoring will provide the industry with an ability to conduct integrated pest management efforts with a diminished need for expertise involvement and ultimately more strategic and precise pest control at lower input costs. This will ultimately result in greater profitability and lower environmental footprint for the specialty crop production system. The automated sticky trap evaluation has its own practical application as an integrated pest management assistance tool while the longer-term fully automated approaches are addressed. Revolutionary approaches to cherry harvest and, more generally to production systems, address challenges the industry faces with economic profitability and associated with this, product quality. New production systems could result in more economic return to growers over the life cycle of an orchard by bringing plant material into fruit production sooner; increasing chemical application efficiency; and improving processed fruit quality through gentler harvesting systems. Biosensors applied in the orchard during production, during processing, and/or to monitor food products have the potential to increase food safety and production efficiency by providing rapid, near real time, feedback of conditions. More specifically, results related to this project showed that the nano-BEAMs had higher capture efficiencies in pure cultures and in lettuce samples than the commercial IMBs.

Publications

  • Wen, C., Guyer, D.E., and Li, W. 2009. Local feature-based identification and classification for orchard insects. Biosystems Engineering. 104: p 299-307.
  • Wen, C., Guyer, D.E., and Li, W. 2009. Automated insect classification with combined global and local features for orchared management. ASABE Meeting. Reno, NV. Paper No. 095865. St. Joseph, MI ASABE.