Development of a Grapevine Pruning Algorithm for Using in Pruning

ماشین های کشاورزی

Article 1, Volume 7, Issue 2 - Serial Number 14, 2017, Pages 323-335   

Document Type: Research Article

DOI: 10.22067/jam.v7i2.52617

Authors

S. M. Hosseini¹; A. A. Jafari^{* 2}

¹Biosystems Engineering Department, Shahrekord University, Shahrekord, Iran

²Biosystems Engineering Department, Shiraz University, Shiraz, Iran

Abstract

Introduction
Great areas of the orchards in the world are dedicated to cultivation of the grapevine. Normally grape vineyards are pruned twice a year. Among the operations of grape production, winter pruning of the bushes is the only operation that still has not been fully mechanized while it is known as the most laborious jobs in the farm. Some of the grape producing countries use various mechanical machines to prune the grapevines, but in most cases, these machines do not have a good performance. Therefore intelligent pruning machine seems to be necessary in this regard and this intelligent pruning machines can reduce the labor required to prune the vineyards. It this study in was attempted to develop an algorithm that uses image processing techniques to identify which parts of the grapevine should be cut. Stereo vision technique was used to obtain three dimensional images from the bare bushes whose leaves were fallen in autumn. Stereo vision systems are used to determine the depth from two images taken at the same time but from slightly different viewpoints using two cameras. Each pair of images of a common scene is related by a popular geometry, and corresponding points in the images pairs are constrained to lie on pairs of conjugate popular lines.
Materials and Methods
Photos were taken from gardens of the Research Center for Agriculture and Natural Resources of Fars province, Iran. At first, the distance between the plants and the cameras should be determined. The distance between the plants and cameras can be obtained by using the stereo vision techniques. Therefore, this method was used in this paper by two pictures taken from each plant with the left and right cameras. The algorithm was written in MATLAB. To facilitate the segmentation of the branches from the rows at the back, a blue plate with dimensions of 2×2 m² were used at the background. After invoking the images, branches were segmented from the background to produce the binary image. Then, the plant distance from the cameras was calculated by using the stereo vision.
In next stage, the main trunk and one year old branches were identified and branches with thicknesses less than 7 mm were removed from the image. To omit these branches consecutive dilation and erosion operations were applied with circular structures having radii of 2 and 4 pixels. Then, based on the branch diameter, one-year-old branches were detected and pruned through considering the pruning parameters. The branches were pruned so that only three buds were left on them. For this aim, the branches should be pruned to have a length of 15 cm. To truncate the branches to 15 cm, the length of the main stem was measured for each of the branches, and branches with length less than 15 cm were omitted from the images. Then the main skeleton of grapevine was determined. Using this skeleton, the attaching points of the branches as well as attachment points to the trunk were identified. Distance between the branches was maintained. At the last step, the cutting points on the branches were determined by labeling the removed branches at each step.
Results and Discussion
The results indicated that the color components in the texture of the branches could not be used to identify one year old branches and evaluation results of algorithm showed that the proposed algorithm had acceptable performance and in all photos, one year old branches were correctly identified and pruning point of the grapevines were correctly marked. Also among 254 cut off-points extracted from 20 images, just 7 pruning points were misdiagnosed. These results revealed that the accuracy of the algorithm was about 96.8 percent.
Conclusion
Based on the reasonable achievement of the algorithm it can be concluded that it is possible to use machine vision routines to determine the most suitable cut off points for pruning robots. By an intelligent pruning robot, the one year old branches are diagnosed properly and the cut off points of the plants are determined. This can reduce the required labor to perform winter pruning in vineyards which subsequently reduces the time required and the costs needed for pruning the vineyards.

Keywords

Grape; Image processing; Pruning; Stereo vision

References

1. Ashraf, A. F. 2013. Stereo vision depth estimation algorithm in uncalibrated rectification. International Journal of video & image processing and network security 13: 1-7.

2. Bian, X., X. Su, and W. Chen. 2011. Analysis on 3D object measurement based on fringe projection. International Journal for Light and Electron Optics 122: 471-474.

3. Bouguet, J. Y. 2015. Camera Calibration Toolbox for Matlab. Computational Vision at the California Institute of Technology. Available at: http://www.vision .caltech.edu/bouguetj/calib_doc/. Accessed 10 March 2015.

4. Burie, J. C., J. L. Bruyelle., and J. G. Postaire. 1995. Detecting and localising obstacles in front of a moving vehicle using linear stereovision. Mathematical and Computer Modelling 22: 235-246.

5. Dogi, B. 2005. Stereo Vision: A way of metering and metering systems overcome the problems in the current. Journal of Mechanical Engineering.

6. Faugeras, O. 1995. Stratification of three-dimensional vision: projective, affine, and metric representations. Journal of the Optical Society of America A 12: 465-484.

7. Guang-Hua, F., L. Xue-Mei, Ch. Yan-Fu, and Y. Jin. 2015. Fast-growing forest pruning robot structure design and climbing control. Advances in Manufacturing 3: 166-172.

8. Heydari, A. R. 2010. Image Processing in MATLAB. BehAvaran Publisher. 288pages. (In Farsi).

9. Khajehei, M. 2003. New method of planting vine. Alhora publications. Tehran. )In Farsi(.

10. Kitamura, S., K. Oka, and F. Takeda. 2005. Development of picking robot in greenhouse horticulture. Nippon Kikai Gakkai Robotikusu. Mekatoronikusu Koenkai Koen Ronbunshu 1: 3176-3179.

11. Kohan, A., A. M. Borghaee, M. Yazdi, S. Minaei, and M. J. Sheykhdavudi. 2011. Robotic Harvesting of Rosa Damascena Using Stereoscopic Machine Vision. World Applied Sciences Journal 12 (2): 231-237.

12. Kriegman, D. J., E. Triendl, and T. O. Binford. 1989. Stereo vision and navigation in buildings for mobile robots. IEEE Transactions Robotics Automation 5: 792-803.

13. Maghsodi, Sh. 2008. Grape technology and processing. Elme keshavarzie Iran publications. Tehran. (In Farsi).

14. Mao, W., J. Baoping, X. Zhang, J. Zhan, and H. Xiaoan. 2009. Apple location method for the apple harvesting robot. Image and Signal Processing 1-5.

15. Mudenagudi, U., and S. Chaudhuri. 1999. Depth estimation using defocused stereo image pairs. Computer Vision 1: 483-488.

16. Nalpantidis, L., and A. Gasteratos. 2010. Stereo vision for robotic applications in the presence of non-ideal lighting conditions. Image and Vision Computing 28: 940-951.

17. Porika, H., M. Jagadeesha, and M. Suchithra. 2015. Effect of pruning severity on quality of grapes Cv. red globe for summer season. Advances in crop science and technology S1-400.

18. Poyton, C. A. 1996. Probability, Random Variables, and Random Signal Principles. 3rd ed., McGraw-Hill, New York.

19. Soni, D. P., M. Ranjana, N. A. Gokul, S. Swaminathan, and B. B. Nair. 2010. Autonomous arecanut tree climbing and pruning robot. International Conference on Emerging Trends in Robotics and Communication Technologies. Chennai, India.

20. Stereo Calibration App. 2015. Available at: http:// www.mathworks.com/ help/ vision/ug/stereo-camera-calibrator-app.html. Accessed 19 January 2015.

21. Su, X., Q. Zhang, and L. Xiang. 2008. Optical 3D shape measurement for dynamic process. Optoelectronics Letters 4: 55-58.

22. Vannucci, D., E. Cini, A. Cioni, and M. Vmmi. 1990. A prototype for the fully mechanized Journal of Agricultural Engineering Research 46: 1-11.