Identification of fruit and branch in natural scenes for citrus harvesting robot using machine vision and support vector machine

Lü Qiang, Cai Jianrong, Liu Bin, Deng Lie, Zhang Yajing

Abstract


Abstract: With the decrease of agricultural labor and the increase of production cost, the researches on citrus harvesting robot (CHR) have received more and more attention in recent years. For the success of robotic harvesting and the safety of robot, the identification of mature citrus fruit and obstacle is the priority of robotic harvesting. In this work, a machine vision system, which consisted of a color CCD camera and a computer, was developed to achieve these tasks. Images of citrus trees were captured under sunny and cloudy conditions. Due to varying degrees of lightness and position randomness of fruits and branches, red, green, and blue values of objects in these images are changed dramatically. The traditional threshold segmentation is not efficient to solve these problems. Multi-class support vector machine (SVM), which succeeds by morphological operation, was used to simultaneously segment the fruits and branches in this study. The recognition rate of citrus fruit was 92.4%, and the branch of which diameter was more than 5 pixels, could be recognized. The results showed that the algorithm could be used to detect the fruits and branches for CHR.
Keywords: citrus, machine vision, citrus harvesting robot (CHR), branch, identification, multi-class support vector machine (SVM)
DOI: 10.3965/j.ijabe.20140702.014
Citation: Lü Q, Cai J R, Liu B, Deng L, Zhang Y J. Identification of fruit and branch in natural scenes for citrus harvesting robot using machine vision and support vector machine. Int J Agric & Biol Eng, 2014; 7(2): 115－121.

Keywords


citrus, branch, identification, machine vision, multi-class support vector machine (SVM), citrus harvesting robot (CHR)

Full Text:

PDF

References


Sanders K F. Orange harvesting systems review. Biosystems Engineering, 2005; 90(2): 115-125.

Brown G K. Mechanical harvesting systems for the Florida citrus juice industry. ASAE Annual Meeting, 2002; Paper No.021108, Chicago, Illinois, USA.

Torregrosa A, Orti E, Martin B, Gil J, Ortiz C. Mechanical harvesting of oranges and mandarins in Spain. Biosystems Engineering, 2009; 104(1): 18-24.

Van Henten E J, Hemming J, Van Tuijl B A J, Kornet J G, Bontsema J. Collision-free motion planning for a cucumber picking robot. Biosystems Engineering, 2003; 86(2): 135- 144.

Van Willigenburg L J, Hol C W J, Van Henten E J. On-line near minimum-time path planning and control of an industrial robot for picking fruits. Computers and Electronics in Agriculture, 2004; 44(3): 223-237.

Cai J R, Zhao J W, Thomas R, Macco K. Path planning of fruits harvesting robot. Transactions of the Chinese Society of Agricultural Machinery, 2007; 38(3): 102-105, 135. (in Chinese with English abstract)

Cai J R, Wang F, Lü Q, Wang J H. Real-time path planning for citrus picking robot based on SBL-PRM. Transactions of the Chinese Society of Agricultural Engineering, 2009; 25(6): 158-162. (in Chinese with English abstract)

Schertz C E, Brown G K. Basic considerations in mechanizing citrus harvest. Transactions of the American Society of Agricultural Engineering, 1968; 11(3): 343-346.

Parrish E, Goksel A K. Pictorial pattern recognition applied to fruit harvesting. Transactions of the American Society of Agricultural Engineering, 1977; 20: 822-827.

Sites P W, Delwiche M J. Computer vision to locate fruit on a tree. Transactions of the American Society of Agricultural and Biological Engineering, 1988; 31(1): 257- 265.

Tabb A L, Peterson D L, Park J. Segmentation of apple fruit from video via background modeling. ASABE Paper No.063060. ASABE, Portland, Oregon, USA.

Tanigaki K, Fujiura T, Akase A, Imagawa J. Cherry-harvesting robot. Computers and Electronics in Agriculture, 2008; 63(1): 65-72.

Van Henten E J, Hemming J, Van Tuijl B A J, Kornet J G, Meuleman J, Bontsema J, et al. An autonomous robot for harvesting cucumbers in greenhouses. Autonomous Robots, 2002; 13(3): 241-258.

Zhang L B, Yang Q H, Xun Y, Chen X, Ren Y X, Yuan T, et al. Recognition of greenhouse cucumber fruit using computer vision. New Zealand Journal of Agricultural Research, 2007; 50(5): 1293-1298.

Cai J R, Zhou X J, Wang F, Lu Q. Obstacle identification of citrus harvesting robot. Transactions of the Chinese Society of Agricultural Machinery, 2009; 40(11): 171-175. (in Chinese with English abstract)

Bulanon D M, Burks T F, Alchanatis V. Study on fruit visibility for robotic harvesting. ASABE Aunnal Meeting, 2007; Paper No. 073124. Minneapolis, Minnesota, USA.

Hannan M W, Burks T F. Current development in automated citrus harvesting. ASAE/CSAE Annual Meeting, 2004; Paper No.043087. Ottawa, Ontario, Canada.

Jiménez A R, Ceres R, Pons J L. A survey of computer vision methods for locating fruit on trees. Transactions of the American Society of Agricultural Engineering, 2000; 43(6): 1911-1920.

Lü Q, Cai J R, Zhao J W, Wang F, Tang M J. Real-time recognition of citrus on trees in natural scene. Transactions of the Chinese Society of Agricultural Machinery, 2010, 41(2): 185-188, 170. (in Chinese with English abstract)

Lü Q, Lu H Z, Cai J R, Zhao J W, Li Y P, Zhou F. Feature extraction of near-spherical fruit with partial occlusion for robotic harvesting. Maejo International Journal of Science and Technology, 2010; 4(3): 435-445.

Illingworth J, Kittlen J. A survey of the hough transform. Computer Vision, Graph & Image Processing, 1988; 44(1): 87-116.

Monta M, Kondo N, Ting T C. End-effectors for tomato harvesting robot. Artificial Intelligence Review, 1998; 12: 11-25.

Shiigi T, Kondo N, Kurita M, Nimomiya K, Rajendra P, Kamata J, et al. Strawberry harvesting robot for fruits grown on table top culture. ASABE Annual Meeting, 2008; Paper No.084046. Providence, Rhode Island, USA.

Slaughter D C, Harrell R C. Color vision in robotic fruit harvesting. Transactions of the American Society of Agricultural Engineering, 1987; 30(4): 1144-1148.

Grasso G, Recce M. Scene analysis for an orange harvesting robot. Artificial Intelligence Applications, 1997; 11: 9-15.

Cai J R, Zhou X J, Li Y L, Fan J. Recognition of mature oranges in natural scene based on machine vision. Transactions of the Chinese Society of Agricultural Engineering, 2008; 24(1): 175-178. (in Chinese with English abstract)

Tian L, Slaughter D. Environmentally adaptive segmentation algorithm for outdoor image segmentation. Computers and Electronics in Agriculture, 1998; 21(3): 153-168.

Mehta S S, Burks T T. Vision-based control of robotic manipulator for citrus harvesting. Computers and Electronics in Agriculture, 2014; 102: 146-158.

Qian H, Mao Y, Xiang W, Wang Z. Recognition of human activities using SVM multi-class classifier. Pattern Recognition Letters, 2010; 31(2): 100-111.

Wang X Y, Wang T, Bu J. Color images segmentation using the Support Vector Machines. Pattern Recognition, 2011; 44(4): 777-787.




Copyright (c)



2023-2026 Copyright IJABE Editing and Publishing Office