Eye in hand robot arm based automated object grasping system

Asnor Juraiza Ishak, Sarmad Nozad Mahmood

Abstract


The modern robotic systems state that the tracking methodology and the visual servoing are imperative to discover the existence of an object and excite the robot in order to manipulate the target. This paper shows a new object tracking and grasping technique in real time based on Eye in Hand visual servoing structure via a camera mounted at the end of the robot arm. The working principle of the robotic system depends mainly on the prediction based on Kalman filter method that estimates the next location of a moving object in order to specify the path of the target under the scope of the camera. Hereby, the proposed system observes the object and studies its behavior based on the pervious state in order to grasp the target at the exact position. Furthermore, the vision system implements feedback control approach to keep the extracted information of the object updated to solve the stability and the reliability issues that might be encountered. It has to be mentioned that the proposed robotic system was tested by grasping moving objects in different speeds and directions. In addition, the grasping of a stationary object was tested to confirm the practical and the theoretical results. As a final result, it can be stated that the speed of the object is directly proportional with the grasping time and vice versa.

Keywords


Eye in Hand Robot Arm, Eye to Hand Robot Arm, Visual Servoing System, Object Tracking, Kalman Filter Method

Full Text:

PDF

References


Ito, M. and M. Shibata. Non-delayed visual tracking of hand-eye robot for a moving target object. in ICCAS-SICE, 2009. 2009. IEEE.

Bae, S., Kim, E., Yang, S., Park, J., Kuc, T., A dynamic visual servoing of robot manipulator with eye-in-hand camera, in International Conference on Electronics, Information, and Communication (ICEIC). 2018, IEEE: Honolulu, HI, USA. p. 1 - 4.

Turkmen, Anil Can. "Autonomous Car Parking System with Various Trajectories." Periodicals of Engineering and Natural Sciences (PEN) 5, no. 3 (2017).

Fujita, T. and W. Segawa. Object gripping and lifting based on plane detection by tracked mobile robot with two manipulators. in Advanced Robotics (ICAR), 2017 18th International Conference on. 2017. IEEE.

Kumar, Sathish P. "Study and analysis of intrusion detection system using random forest and linear regression." Periodicals of Engineering and Natural Sciences (PEN) 6, no. 1 (2018): 197-200.

GopalaKrishna, V. S., and Prakash Marimuthu. "Optimization of parameters effecting the heat recovery from a sand casting process." Periodicals of Engineering and Natural Sciences (PEN) 6, no. 2 (2018): 100-108.

Yang, S. and M. Baum. Extended Kalman filter for extended object tracking. in Acoustics, Speech and Signal Processing (ICASSP), 2017 IEEE International Conference on. 2017. IEEE.

Swalaganata, G., Muniri, & Affriyenni, Y., Moving object tracking using hybrid method, in International Conference on Information and Communications Technology (ICOIACT). 2018, IEEE: Yogyakarta Indonesia. p. 607 - 611.

Tatashev, Alexander, and Marina Yashina. " A model of particles movement on a discrete contour." Periodicals of Engineering and Natural Sciences 7, no. 1 (2019): 67-75.

Lippiello, V., B. Siciliano, and L. Villani. Eye-in-hand/eye-to-hand multi-camera visual servoing. in Decision and Control, 2005 and 2005 European Control Conference. CDC-ECC'05. 44th IEEE Conference on. 2005. IEEE.

Hwang, K.-S., J.-L. Lee, and W.-C. Jiang. Intelligent image base visual servoing controller for robot arm. in Advanced Robotics and Intelligent Systems (ARIS), 2017 International Conference on. 2017. IEEE.

Li, Q., Li, R., Ji, K., Dai, D., Kalman Filter and Its Application, in 8th International Conference on Intelligent Networks and Intelligent Systems (ICINIS). 2015, IEEE: Tianjin, China. p. 74 - 77.

Chen, S., Kalman filter for robot vision: a survey. IEEE Transactions on Industrial Electronics, 2012. 59(11): p. 4409-4420.

Bishop, G. and G. Welch, An introduction to the Kalman filter. Proc of SIGGRAPH, Course, 2001. 8(27599-3175): p. 59.

Saeed, S.Z., M.A. Abdilatef, and Z.M. Yosif, Visual tracking enhancement of object on circular path based on tuned kalman filter by particle swarm optimization. International Journal of Computer Applications, 2016. 146(4): p. 43-50.

Doğan-Sağlamtimur, Neslihan, Ersen Turaç, Ruhsar Arabacıoğlu, and Tuğba Çivioğlu. "Production of Dye from Green and Brown Walnut Shells for Leather Coloration." Periodicals of Engineering and Natural Sciences (PEN) 5, no. 2 (2017).

Patil, A., M. Kulkarni, and A. Aswale. Analysis of the inverse kinematics for 5 DOF robot arm using DH parameters. in Real-time Computing and Robotics (RCAR), 2017 IEEE International Conference on. 2017. IEEE.

Huang, G.-S. and P.-H. Tseng. Development and analysis of 5-DOF manipulator kinematics. in System Science and Engineering (ICSSE), 2016 International Conference on. 2016. IEEE.

Srisuk, P., A. Sento, and Y. Kitjaidure. Inverse kinematics solution using neural networks from forward kinematics equations. in Knowledge and Smart Technology (KST), 2017 9th International Conference on. 2017. IEEE.




DOI: http://dx.doi.org/10.21533/pen.v7i2.528

Refbacks

  • There are currently no refbacks.


Copyright (c) 2019 Sarmad Nozad Mahmood

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

ISSN: 2303-4521

Digital Object Identifier DOI: 10.21533/pen

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License