Source: UNIVERSITY OF NORTH TEXAS submitted to NRP
3D MICROSCOPY FOR HIGH-THROUGHPUT PHENOTYPING OF COTTON FIBERS
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1031879
Grant No.
2024-67013-41942
Cumulative Award Amt.
$294,000.00
Proposal No.
2023-07670
Multistate No.
(N/A)
Project Start Date
Mar 1, 2024
Project End Date
Feb 28, 2027
Grant Year
2024
Program Code
[A1811]- AFRI Commodity Board Co-funding Topics
Recipient Organization
UNIVERSITY OF NORTH TEXAS
1155 UNION CIR #305250
DENTON,TX 76203-5017
Performing Department
(N/A)
Non Technical Summary
Phenotypic traits of cotton fibers, including biological fineness and ribbon shape (maturity level), provide measures of fiber quality which are needed for cotton improvement efforts. The current fiber testing methods are unable to provide both rapid and accurate measurements of individual fibers. In this project, we will develop a microscope-based imaging system to produce high-fidelity images and 3D surface maps of fibers in the longitudinal view, permitting quick sample preparations and high-throughput fiber phenotyping. The system will be equipped with a newly modified pneumatic cutter that can cut and spread fiber snippets onto a slide in seconds, and a light microscope with a 3-axis motorized stage and high-resolution digital camera to automate positioning the slide and focusing the images. The software will be customized by adopting deep learning and image fusion algorithms to automatically classify ribbon shapes, scan ribbon profiles, and calculate phenotypic features in the 3D space. Two diversity panels of cotton (Gossypium species and Upland) will be grown to validate the fiber phenotypic measurements of the proposed system by comparing them with those from traditional testing systems. A successful 3D phenotyping tool will enable cotton geneticists to measure the traits of fiber fineness and ribbon shape with a speed consistent with the short timeframe available for making decisions in a cotton breeding program. The proposal is submitted in response to the commodity board topic #2 "Develop advanced, high-throughput, visual fiber phenotyping microscopy tools that ultimately lead to superior cotton fiber quality."
Animal Health Component
100%
Research Effort Categories
Basic
(N/A)
Applied
100%
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
20417192020100%
Knowledge Area
204 - Plant Product Quality and Utility (Preharvest);

Subject Of Investigation
1719 - Cotton, other;

Field Of Science
2020 - Engineering;
Goals / Objectives
Cotton fiber phenotyping refers to the measurement of the geometric features of the fiber, e.g., biological fineness and ribbon shape. Fiber biological fineness is calculated by the perimeter of the fiber cross-section or the diameter of an equivalent circle having the same perimeter as that of the cross-section. Fiber ribbon shape is a measure of the deformation of the cylindrical structure of the fiber due to flattening and twisting. These phenotypic measurements are characteristics associated with a cotton variety or species [1] and as such are important data for cotton breeders in their efforts to find genetic linkages to improve fiber quality of U.S. cotton. this proposed project is aimed to create a high throughput fiber phenotyping tool to accurately measure cotton biological fineness and ribbon shape in the longitudinal view for cotton breeding, parent germplasm selection and fiber development research. To achieve this goal, we will develop a microscope-based imaging system and an operational protocol with the following objectives and tasks:To construct a fiber cutter and spreader driven by a pneumatic force to automatically prepare a sample slide that can carry over 10,000 well-spread fiber snippets.To equip a light microscope with a 3-axis motorized stage, high-resolution digital camera, and specialized software to automate the motion of the stage and camera functions to generate sequential fiber images in the z direction at each stage stop.To create image-processing software with machine learning, image fusion, and other advanced algorithms to detect in-focus pixels from sequential images to form high-fidelity images and z-maps (i.e., 3D) of fiber ribbons.To develop image-analysis software to classify ribbon shapes, scan ribbon profiles, and calculate phenotypic features (e.g., perimeter, twists/mm) based on ribbon shape models.To establish two fiber diversity panels of cotton (Gossypium species and Upland) to validate fiber phenotypic measurements of the proposed system, and to compare them with those from traditional testing systems (e.g., AFIS and HVI).
Project Methods
The proposed project will be conducted by creating a high throughput fiber phenotyping system and establishing two panels of diverse cotton samples to validate phenotypic measurements. The development of the new phenotyping system will be based on a light microscope equipped with a 3-axis motorized stage and high-resolution digital camera to acquire z-series image sequence of fibers in the longitudinal view (i.e., side view), and image fusion and deep learning algorithms to produce high-fidelity images and 3D surface maps of fibers. This longitudinal fiber imaging approach eliminates the need for the laborious fiber cross-sectioning procedure currently employed, allowing for swift sample preparations and facilitating high-throughput image analysis. Another distinctive feature of this approach is its capability to generate 3D fiber images in the longitudinal view, facilitating precise measurements of fiber biological perimeter, maturity, and ribbon twists, which are invaluable for cotton breeding, parent germplasm selection, and developmental research.Efforts:Our efforts will encompass the identification, tailoring, and application of computational methods to process cotton fiber images with needed efficacy and efficiency. This includes the incorporation of image fusion and classification algorithms. For image fusion, we will introduce a crucial deep learning model (U-net) designed for extracting in-focus pixels, a pivotal step in 3D image generation. In the realm of image classification, we will utilize another deep learning model, the few-shot learning prototypical network, for accurately categorizing cotton ribbon shapes, directly linked to the maturity levels of fibers. These AI-driven algorithms will greatly enhance the .Another pivotal initiative is to establish two cotton diversity panels, focusing on Gossypium species and Upland cotton--the cultivated species globally and in the U.S. Each accession within these panels will be characterized by a restricted set of molecular markers and unique fiber traits. Establishing the fundamental connections between molecular markers and phenotypic features will enhance geneticists' comprehension of the associations between genotype and phenotype, particularly in relation to fiber fineness within the diversity panels.Evaluations:The fiber phenotyping system will be evaluated by comparing the phenotypic traits, such as biological fineness and maturity, in two diverse cotton sample panels measured by the proposed system against those assessed using traditional fiber testing methods--the High-Value Instrument (HVI) and the Advanced Fiber Information System (AFIS). Correlation analyses will be conducted using analytical software such as Excel, SPSS, and others to examine the relationships between the phenotypic traits obtained from the proposed system and the AFIS fineness and maturity ratios, as well as the HVI micronaire. A strong correlation between these systems will serve as validation for the proposed system. Following validation, we will delve into the associations of phenotypic traits with SSR allele frequencies from prior research, specifically distinguishing between categories of high and low-value accessions. This analysis aims to deepen our understanding of the connections between genotype and phenotype within the diversity panels.

Progress 03/01/24 to 02/28/25

Outputs
Target Audience: Nothing Reported Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?It provided opportunities for training one PhD student and two MS students in the applications of machine learning, image processing, and image labeling. How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?In Year 2, we plan to: Implement the Segment Anything Model (SAM) for fiber segmentation, building on the groundwork laid in Year 1. SAM, a new model developed by Meta AI, can rapidly detect objects in an image based on a given prompt. Our focus is on developing automated prompt generation to achieve accurate fiber segmentation. Perform transverse scanning of individual fibers along their axes to identify the optimal position for measuring true fiber width. These measurements will be used to estimate the biological perimeter of the fibers. Develop 3D visualization tools to reconstruct fiber surfaces using focused pixels from z-series image stacks, enabling detailed examination of fiber phenotypic features. Create and train a deep learning model to classify the maturity levels of segmented fibers. Integrate all modules into a unified system that automates fiber image capture, processing, and measurement directly through the microscope platform. Perform traditional testing methods, such as AFIS and HVI, on the cotton fiber samples harvested in the 1st year. Validate the system using 64 cotton samples (16 entries with 4 replicates each) provided by the co-PI. We will compare the phenotypic measurements generated by our system with those obtained from traditional testing methods.

Impacts
What was accomplished under these goals? During the 1st year, the PI's team at UNT accomplished the following tasks: Refined a fiber cutting-spreading device for preparing fiber slides. The device employs pneumatic forces to cut a small bundle of cotton fibers into 0.5 mm snippets and blow the snippets with a jet of air into a chamber where they are randomly dispersed onto a slide with minimal contact and overlap. Installed a new light microscope equipped with a 3-axis motorized stage and a high-resolution digital camera. In addition, we developed C++ software using the manufacturer's SDK and libraries to control the microscope stage's x-, y-, and z-axis movements. This setup enables precise positioning of cotton fiber slides and supports the automated capture of z-series images at one x-y position. The z-series images consist of a stack of fiber images captured at different focal planes (or depths) along the z-axis, while the x and y positions remain fixed. Implemented an advanced image fusion algorithm--Complex Wavelets for Extended Depth-of-Field--to extract in-focus pixels from each image in the stack and merge them into a single composite image containing only sharply focused regions. This process produces a fused image with well-defined fiber edges and clear fiber surfaces, enabling accurate measurement and visualization of fiber phenotypic features. Explored an object separation method known as the Segment Anything Model (SAM) and are implementing it to achieve precise isolation and annotation of individual fibers in the fused images. This segmentation enables accurate measurement of fiber width and classification of fiber maturity, both of which are critical for estimating the biological perimeter of fibers. In the 1st year, the Co-PI's team at Southern Plains Agricultural Research Center of USDA-ARS accomplished the following tasks: Delinted seed samples were obtained from the U.S. National Cotton Germplasm Collection. Sixteen entries were identified with potential to obtain very diverse fiber quality samples. These entries represent four accessions from each of four cotton species (Gossypium arboreum, G. barbadense, G. herbaceum, and G. hirsutum). The College Station trial was planted on May 10, 2024. The trial was a randomized complete block design including four replications. Entries were grown in one-row plots (12.2-m long × 0.5-m between rows). Plant stands were evaluated on 6/14/2024. One G. herbaceum entry (A01-0076, "var. africanum (Mutema)") did not germinate. Several attempts were made to replant; however, all were unsuccessful. Insecticidal sprays for thrips and flea hoppers were applied in May and June. The first and only furrow irrigation occurred 7/2/2024. Herbicides, insecticides, and growth regulators were applied throughout the growing season when needed. Manual weed control was also performed as needed. 50-boll samples were collected in September. Several accessions had very small bolls, thus very low amounts of fiber. For these entries, multiple harvests were needed to obtain to required fiber sample weight for analysis. One G. barbadense entry (GB-0660, "Tanguis ICA 757-60") had a very late flowering time and bolls were not open at harvest. Therefore, no boll samples were obtained from this entry. The boll samples were ginned on a 20-saw Dennis Manufacturing table-top gin. A 30-gram lint sample from each plot was sent to Cotton Incorporated for HVI and AFIS testing. A 3-gram lint sample from each plot was sent to the PI's lab at UNT for microscopic phenotypic measurements.

Publications