Detection of surface defects caused by mechanical damages on Mangos of Kelk-e Sorkh variety with the use of color image processing

مجله پژوهشهای علوم و صنایع غذایی ایران

Article 35, Volume 12, Issue 5 - Serial Number 41, November and December 2016, Pages 652-662   

Document Type: Research Article

DOI: 10.22067/ifstrj.v12i5.51714

Authors

Mahmood Reza Golzarian^* ; Mansoureh Shamili¹; Omid Doosti Irani²; Peyman Azarkish²

¹Hormozgan University

²Ferdowsi University of Mashhad

Abstract

Introduction: Machine vision, which uses image processing techniques, is a branch of artificial intelligence that simulates human vision. These systems can be used for quality control, sorting and grading of agricultural products. Unlike engineering materials, agricultural fruits are living tissues that continue living even after they are harvested from trees or bushes. Therefore, the post-harvest process such as handling and packaging need to be done such that they make the least damage to these products (Barchi et al., 2002). Combination of suitable techniques and post-harvest management is required to bring down the waste loss in this supply chain. Fruits are susceptible to receive mechanical damages during harvesting (either manually or mechanized), or in transport or at the time of initial packaging. These damages may cause damage to the internal tissue of the fruit that subsequently causes the internal substances of the damaged cell leave spread out. While eradicating the fruit, the surrounding fruits are also affected negatively.Mangos are sensitive to mechanical and thermal sudden change (Xing & Baerdemaker, 2005). Today, surface defect detection and grading of many fruits including mangos are still performed in many cases with the help of trained workers which is time consuming and cost effective.. Image processing has been successfully used for measurement and calibration of products; it shows also a good potential to be used for assessing the quality of products (Mata et al, 2012). There has been no or very little research on the quality assessment of mangos based on the dark spots on the skin surface of mango fruits.The aim of this study was to detect and identify surface damage in mangoes of Kelk-e Sorkh cultivar using digital image processing as it has higher accuracy and processing speed as opposed to manual detection.

Materials and methods:Mango fruits were picked from a garden in Minab in Hormozgan province, in Iran. Sixty samples were selected for imaging. These samples had black spots on the skin surface due to mechanical damages received during harvesting and handling. The imaging was performed in a homogenously controlled lighting condition(in an imaging box)against a blue sheet as background and at 24°C and 22% RH. The images were taken in visible range with a Nikon Coolpix P510 digital camera (Nikon Inc, Japan) of 4928 x 3264 dimensions (16.1 MP resolution). Considering the camera lens’s focal length, the samples were placed 20 cm under the camera’s lens to be in camera’s field of view. The taken images were read and analyzed in Matlab (Ver 2011a, Mathworks Inc, US). The quality of segmentation process, which is an important step in image processing project, affects the quality of information extracted from the objects or regions of interest (ROIs) in the next steps. The images of mangos were segmented from the background using thresholding of the high contrast images of red and blue difference. The optimum threshold value was obtained to be 0.3. Then, the affected and healthy regions of mangos were specified manually in each image. Then, the color features in two L*a*b* and RGB and HSI color models were extracted from each region on the sample surface.

Results and discussion: The statistical analysis of these features showed that the accuracies for detecting the surface defects on mangos were 90% and 91.6% using the color factor of G and 0.16*G/0.5R in RGB color space, respectively. However, from the a* data, only 56 samples were correctly classified as damaged. This showed the classification accuracy of 93.33% using this color parameter. The accuracy reached to 100% when the two color parameters of a* and L* was used as an integrated color parameter of 0.16*L-a*. In L*a*b* color space, the influence of ambient light on the color of samples is trivial and much less than that on RGB. This can be the reason for higher classification error when R, G and B color components, which might be due to non-uniform lighting and the existence of highly bright or highly dark points on the surface of samples. According to USDA standard, the ratio of the size of defect region to the size of whole fruit can be used as an indicator for grading mangos (USDA, 2006). In this research, the k-means clustering was used to group the mangos based on their defect region size. The results showed that the mangos could be classified into three categories of grade 1, with the defect size of less than 5% of the total area, grade 2: when the defect region size was between 5 and 15% and grade 3: when the defect area size was more than 15% and less than 25%. By K-means clustering, the samples were grouped in two clusters. The cut-off point between two clusters was found from the ROC curve to be 3.11. The parameter of ROC area was equal to unity, which indicated the high discrimination capability of the clustering model.

Conclusion: In this research, after assessing several color factors and their combinations, four color components of a*, green (G), 2G/R and L*-0.16a* were selected and used for classifying mechanically defected mangos and the results were promising. The results of this research and similar ones can provide helpful recommendations in grading mangos considering the higher capability of Hormozgan province in Iran for producing mangos for fresh consumption, being used in high-quality domestic market, being exported to global markets.

Keywords

Image processing; surface defects; mechanical damages; color images; Mango

References

Agricultural statistics for the years 2010-2012 (Persian Calendar: 1379-1380). Department of Budget and Planning, Statistics and Information Office, Ministry of Agriculture Jihad. Tehran (in Persian).

Barchi, G.L., Berardinelli, A., Guarnieri, A., Ragni, L. & Totaro Fila, C., 2002, Damage to loquasts by vibration-simulating intra-state transport. Biosyst Eng, 82, 305-312.

Bazhan, M., & Kabir, E. (2007). Detection of Surface Defects on Apples for Quality Grading. Iranian Journal of Electrical and Computer Engineering, 6, 25-34. (in Persian).

Bose, T.K. & Mitra. S.K., 1990. Fruits: Tropical and subtropical. Naya Prokash Pub., Calcutta, India.

FAO, 2012, FAO Statistics database, accessed on 22nd december (2014), from http://faostat.fao.org/site/567/default.aspx#ancor.Accessed August 2012.

Golzarian, M. R. , Sadeghi F., Ghanei-Ghooshkhaneh N. , Kazemi F. , 2016, A qualitative and quantitative approach to assessing the performance of contrast enhancing colour indices used in automatic computer vision plant identification system. The 8th National Congress on Agricultural Machinery (Biosystems) Engineering and Mechanization, Mashhad, Iran. (in Persian).

Haff, R.P., Saranwong, S., Thanapase, W., Janhiran, A., Kasemsumran, S. & Kawano. S., 2013. Automatic image analysis and spot classification for detection of fruit fly infestation in hyperspectral images of mangoes. Postharvest Biol Tec, 86, 23-28.

Heidari,M ., Dastjerdi,A ., & Moradi,N . (2011). Effects of Potassium Permangenate and Storage Time on Quality of Mango Fruits (Mangifera indica L.). Journal of Horticulture Science, 25(2): 130-136. (in Persian).

Kang, S.P., East, A.R. & Trujillo, F.J., 2008. Colour vision system evaluation of bicolour fruit A case study with ‘B74’ mango. Postharvest Biol Tec, 49, 77-85.

Leon, K., Mery, D., Pedreschi F. & Leon, J., 2006. Color measurement in L∗a∗b∗ units from RGB digital images. Food Res Int, 39, 1084-1091.

Mata, C., Duarte, M.E.M., Borges, F.F. & Barbacena, I.L., 2012, An adaptive threshold level for segmentation of grayscale images using image processing to sort mangoes by weight estimation. Postharvest Technology in the Global Market.

Omid, M., Khojastehnazhand, M. & Tabatabaeefar, A., 2010, Estimating volume and mass of citrus fruits by image processing technique. J Food Eng, 100, 315–321.

Payne, A.B., Walsh, K.B., Subedi, P.P. & Jarvis, D., 2013, Estimation of mango crop yield using image analysis – Segmentation method. Comput Electron Agric, 91, 57-64.

Pordarbani, R., Gasemzadeh, H., Golzadeh, A., & Behfar, a. H. (2009). Feasibility Study of Apple Quality Grading Using Image Processing. Journal of Food Research, 19, 75-85. (in Persian).

Prasanna, V., Prabha, T.N. & Tharanthan, R.N., 2007. Fruit ripening phenomena—an overview, Crc Cr Rev Food Sci. 47, 1–19.

Shamili, M., Fatahi, R. & Hormaza, J.I., 2012, Characterization and evaluation of genetic diversity of Iranian mango (Mangifera indica L, Anacardiaceae) genotypes using microsatellites. Sci. Horticult, 148, 230-234.

Srajaldin, A., Moalem, P., & Pourghasem, H. (2012). Apple Classification using statistical characteristics and tissue using SVM classifier. First National Conference on New Ideas in Electrical Engineering. Islamic Azad University Isfahan (Khorasgan) Branch, Esfahan, Iran (in Persian).

USDA. 2006. Mangos. Shipping Point and Market. Inspection Instructions, accessed on 2/12/2014 from http://www.ams.usda.gov/AMSv1.0/

Victor, S., 1993. The situation of mango culture in the word. Acta Hort, 341, 31-41.

Wilson, L.G., Boyette, M.D. & Estes, E.A., 1999, Postharvest Handling and Cooling of Fresh Fruits, Vegetables, and Flowers for Small Farms. NCCES. 804.

Xing, J. & Baerdemaker, J.D., 2005, Fresh bruise detection on selected cultivars apples using visible and NIR spectroscopy. Postharvest Biol Tec, 45, 176–183