Carrot Sorting Based on Shape using Image Processing, Artificial Neural Network, and Support Vector Machine

ماشین های کشاورزی

Article 4, Volume 9, Issue 2 - Serial Number 18, 2019, Pages 295-307   

Document Type: Research Article

DOI: 10.22067/jam.v9i2.70579

Authors

A. Jahanbakhshi¹; K. Kheiralipour^{* 2}

¹Department of Biosystems Engineering, Faculty of Agriculture and Natural Resources, University of Mohaghegh Ardabili, Ardabil, Iran

²Mechanical Engineering of Biosystems Department, Faculty of Agriculture, Ilam University, Ilam, Iran

Abstract

Introduction
Carrot is one of the most important agricultural products used by millions of people all over the world. Quality assessment of agricultural products is one of the most important factors in improving the marketability of agricultural products. In the market, carrots with irregular shapes are not commonly picked by customers due to their appearance. This causes to remain those carrots in the market for a long time and then decay. Therefore, adopting an appropriate method for sorting and packaging this product can increase its desirability in the market. Packaging and sorting of carrots by workers bring about many problems such as high cost, product waste, etc. Image processing systems are modern methods which have different applications in agriculture including sorting of different products. The aim of this study was to implement a machine vision system to classify carrot based on their shape using image processing.
 Materials and Methods
In this study, 135 carrot samples with different shapes (56 regulars and 79 irregulars) were selected and their images were obtained through an imaging system. First, an expert divided the carrots into, two categories according to their shapes. The carrots which had irregular shape were those with double or triple roots, cracked carrots, curved carrots, damaged carrots, and broken ones and those with upright shapes were considered as regular shape carrot. After imaging, image processing was started by an algorithm programmed in Matlab R2012a medium. Then some shape features such as length, width, breadth, perimeter, elongation, compactness, roundness, area, eccentricity, centroid, centroid non-homogeneity, and width non-homogeneity were extracted. After the selection of efficient features, artificial neural networks and support vector machine were used to classify the efficient features.
 Results and Discussion
The number of neurons in the hidden layers of artificial neural network models were varied to find the optimal model. The highest percentage of the correct classification rate (98.50%) belonged to the structure of 2-10-16, which in fact has 16 neurons in the input layer, 10 neurons in the hidden layer and 2 neurons in the output layer. This model has also the lowest mean squared error and the highest correlation coefficient of the test data, 0.90 and 2.52, respectively. This network was a feed forward back propagation error type and the activation functions in hidden and output layers were Tansig and Perlin, respectively. The correct classification rate of the support vector machine method was 89.62%. The confusion matrix of support vector machine method showed that out of 56 usual samples, 42 specimens were correctly identified but 14 samples were mistakenly classified as unusual carrots. All 79 carrots with unusual shapes were correctly classified. The results obtained from the comparison of the performance of the two methods, the neural network method has a good superiority than the support vector machine for classification.
 Conclusion
In this research, the classification of carrots was based on its appearance. At first the physical characteristics and appearance attributes of the carrot samples were extracted and processed using image processing. Image analysis was included the classification of samples into two usual and unusual shapes, which to classify the extracted properties two methods were used: the artificial neural network (ANN) and support vector machine (SVM). The classification accuracy of the ANN method was higher than SVM. It can be said that the image processing method can be used to improve the traditional method for grading the carrot product in new ways. So, the marketability of the product will be increased, and thus its losses will be reduced. Also, the image processing technique can be used as a simple, fast and non-destructive alternative to other methods of extracting geometric properties of agricultural products. Finally, it can be stated that image processing method and machine vision are effective ways for improving the traditional sorting techniques for carrots.

Keywords

Artificial intelligent; Carrot; Grading; Machine vision; Shape

References

1. Abbas, E. D. 2017. Effect of GA3 on growth and some physiological characterizes in carrot plant (Daucus carota L.). Ibn AL-Haitham Journal for Pure and Applied Science 24: 1-7.

2. Abdollahnejad Barough, A. R., M. Adelinia, and M. Mohamadi. 2016. Sorting of pistachio nuts using image processing techniques and an adaptive neural-fuzzy inference system. Journal of Agricultural Machinery 6: 60-68. (In Farsi).

3. Ali, A. S. M. Y., A. H. M. Solaiman, and K. C. Saha. 2016. Influence of Organic Manures and Neem Products on Growth and Yield of Carrot. International Journal of Crop Science and Technology 2: 19-25.

4. Al-Mallahi, A., T. Kataoka, H. Okamoto, and Y. Shibata. 2010. Detection of potato tubers using an ultraviolet imaging-based machine vision system. Biosystems Engineering 105: 257-265.

5. Batchelor, M. M., and S. W. Searcy. 1989. Computer vision determination of the stem/root joint on processing carrots. Journal of Agricultural Engineering Research 43: 259-269.

6. Blasco, J., N. Aleixos, and E. Molto. 2003. Machine vision system for automatic quality grading of fruit. Biosystems Engineering 85: 415-423.

7. Clement, J., N. Novas, J. A. Gazquez, and F. Manzano-Agugliaro. 2012. High speed intelligent classifier of tomatoes by colour, size and weight. Spanish Journal of Agricultural Research 10: 314-325.

8. Deng, L., H. Du, and Z. Han, 2017. A Carrot Sorting System Using Machine Vision Technique. Applied Engineering in Agriculture 33 (2): 149-156.

9. Du, C. J., and D. W. Sun. 2004. Recent developments in the applications of image processing techniques for food quality evaluation. Trends in Food Science and Technology 15: 230-249.

10. Dubey, S. R., and A. S. Jalal. 2015. Application of image processing in fruit and vegetable analysis: A review. Journal of Intelligent Systems 24: 405-424.

11. Elmasry, G., S. Cubero, E. Molto, and J. Blasco. 2012. In-line sorting of irregular potatoes by using automated computer-based machine vision system. Journal of Food Engineering 112: 60-68.

12. Fu, L., S. Sun, R. Li, and S. Wang. 2016. Classification of kiwifruit grades based on fruit shape using a single camera. Sensors 16: 1012.

13. Golzarian, M. R., M. Shamili, O. Doosti Irani, and P. Azarkish. 2017. Diagnosis of surface defects caused by mechanical damages on mango of kelk-e sorkh variety with the use of color image processing. Iranian Food Science and Technology Research Journal 12: 652-662. (In Farsi).

14. Howarth, M. S., J. R. Brandon, S. W. Searcy, and N. Kehtarnavaz. 1992. Estimation of tip shape for carrot classification by machine vision. Journal of Agricultural Engineering Research 53: 123-139.

15. Izadi, H., S. Kamgar, and M. H. Raoufat. 2016. Tomato grading system using machine vision technology and neuro-fuzzy network (ANFIS). Journal of Agricultural Machinery 6: 49-59. (In Farsi).

16. Jahanbakhshi, A., Y. Abbaspour‐Gilandeh, and T. M. Gundoshmian. 2018. Determination of physical and mechanical properties of carrot in order to reduce waste during harvesting and post‐harvesting. Food Science and Nutrition 6: 1898-1903.

17. Javadikia, H., S. Sabzi, and H. Rabbani. 2017. Machine vision based expert system to estimate orange mass of three varieties. International Journal of Agricultural and Biological Engineering 10: 132-139.

18. Khalifa, S., and M. H. Komarizadeh. 2012. An intelligent approach based on adaptive neuro-fuzzy inference systems (ANFIS) for walnut sorting. Australian Journal of Crop Science 6: 183-187.

19. Kheiralipour, K., and A. Pormah. 2017. Introducing new shape features for classification of cucumber fruit based on image processing technique and artificial neural networks. Journal of Food Process Engineering 40: 1-4.

20. Khojastehnazh, M., M. Omid, and A. Tabatabaeefar. 2010. Development of a lemon sorting system based on color and size. African Journal of Plant Science 4: 122-127.

21. Koc, A. B. 2007. Determination of watermelon volume using ellipsoid approximation and image processing. Postharvest Biology and Technology 45: 366-371.

22. Liming, X., and Z. Yanchao. 2010. Automated strawberry grading system based on image processing. Computers and Electronics in Agriculture 71: S32-S39.

23. McRae, D. C. 1985. A review of developments in potato handling and grading. Journal of Agricultural Engineering Research 31: 115-138.

24. Mohammadi, V., K. Kheiralipour, and M. Ghasemi-Varnamkhasti. 2015. Detecting maturity of persimmon fruit based on image processing technique. Scientia Horticulture 184: 123-128.

25. Mollazade, K., M. Omid, and A. Arefi. 2012. Comparing data mining classifiers for grading raisins based on visual features. Computers and Electronics in Agriculture 84: 124-131.

26. Momin, M. A., K. Yamamoto, M. Miyamoto, N. Kondo, and T. Grift. 2017. Machine vision based soybean quality evaluation. Computers and Electronics in Agriculture 140: 452-460.

27. Moreda, G. P., J. Ortiz-Cañavate, F. J. Garcia-Ramos, and M. Ruiz-Altisent. 2009. Non-destructive technologies for fruit and vegetable size determination–a review. Journal of Food Engineering 92: 119-136.

28. Omid, M., M. Khojastehnazhand, and A. Tabatabaeefar. 2010. Estimating volume and mass of citrus fruits by image processing technique. Journal of Food Engineering 100: 315-321.

29. Omidi Arjenaki, O., P. Ahmadi Moghaddam, and A. Moddares Motlagh. 2013. Online tomato sorting based on shape, maturity, size, and surface defects using machine vision. Turkish Journal of Agriculture and Forestry 37: 62-68.

30. Park, B., and R. (Eds.). Lu. 2015. Hyper spectral imaging technology in food and agriculture. Springer New York.

31. Qiaohua, W., T. Yihua, and X. Zhuang. 2017. Grape size detection and online gradation based on machine vision. International Journal of Agricultural and Biological Engineering 10: 226.

32. Rashidi, M., and K. Seyfi. 2007. Classification of fruit shape in kiwifruit applying the analysis of outer dimensions. International Journal of Agriculture and Biology 9: 759-762.

33. Sabliov, C. M., D. Boldor, K. M. Keener, and B. E. Farkas. 2002. Image processing method to determine surface area and volume of axi-symmetric agricultural products. International Journal of Food Properties 5: 641-653.

34. Semary, N. A., A. Tharwat, E. Elhariri, and A. E. Hassanien. 2015. Fruit-based tomato grading system using features fusion and support vector machine. In Intelligent Systems' 2014: 401-410.

35. Vivek Venkatesh, G., S. M. Iqbal, A. Gopal, and D. Ganesan. 2015. Estimation of Volume and Mass of Axi-Symmetric Fruits Using Image Processing Technique. International Journal of Food Properties 18: 608-626.

36. Wang, N. N., D. W. Sun, Y. C. Yang, H. Pu, and Z. Zhu. 2016. Recent Advances in the Application of Hyper spectral Imaging for Evaluating Fruit Quality. Food Analytical Methods 9: 178-191.

37. Wang, T. Y., and S. K. Nguang. 2007. Low cost sensor for volume and surface area computation of axi-symmetric agricultural products. Journal of Food Engineering 79: 870-877.

38. Zhang, Y., and L. Wu. 2012. Classification of fruits using computer vision and a multiclass support vector machine. Sensors 12: 12489-12505.