Open Access Open Access  Restricted Access Subscription or Fee Access

Hand Tracking by using Python and Machine Learning

Ritika *, Md Mudassir

Abstract


Hand tracking is an important component in most practical gesture interaction. In this work, we present a real-time method for hand gesture recognition. We present another constant hand global positioning framework dependent on a solitary profundity camera. In our Project, the hand region is extracted from the background with the background removing method. Then, the palm and fingers are segmented so as to detect and recognize the fingers. In this paper, an automatic hand tracking and segmentation method based on depth information is proposed. Hand depth is determined and then exact hand region is obtained. In this manner, exact hand tracking is realized with very less time and regardless of the complex background. From the tracking process we extract several hand features that are fed to a finite state classifier which identifies the hand configuration. Experiments show the effectiveness of the hand tracking and dynamic gesture recognition. A research was based on a number of algorithms that could best explained a hand gesture. In the pre-processing state, a selfdeveloped algorithm eliminate the background of each training gesture. After that the image is transform into a binary image and the sums of all diagonal segments of the pictures are taken. A completely powerful hand gesture recognition system is still under development.


Full Text:

PDF

References


Joseph J. LaViola Jr. A Survey of Hand Posture and Gesture Recognition Techniques and Technology. Master Thesis, Science and Technology Center for Computer Graphics and Scientific Visualization, USA. 1999.

Rafiqul Z. Khan, Noor A. Ibraheem. Survey on Gesture Recognition for Hand Image Postures. International Journal of Computer And Information Science. 2012; 5(3).

Thomas B. Moeslund and Erik Granum, (2001). A Survey of Computer Vision-Based Human Motion Capture. Computer Vision and Image Understanding. 2001; 81(3):231–268.

Mahmoud E., Ayoub A., J¨org A., and Bernd M. Hidden Markov Model-Based Isolated and Meaningful Hand Gesture Recognition. World Academy of Science, Engineering and Technology 41. 2008.

E. Stergiopoulou, N. Papamarkos. Hand gesture recognition using a neural network shape fitting technique. Engineering Applications of Artificial Intelligence. 2009; 22(8):1141–1158.

M.M. Hasan, P.K. Mishra. HSV Brightness Factor Matching for Gesture Recognition System. International Journal of Image Processing (IJIP). 2011; 4(5):456-467.

Malima, A., Özgür, E., et al. A Fast Algorithm for Vision-Based Hand Gesture Recognition For Robot Control. 2006 IEEE 14th Signal Processing and Communications Applications. 17-19 April 2006 ; Antalya, Turkey, New York: IEEE; 2006.

Mokhar M. Hasan, Pramod K. Mishra. Features Fitting using Multivariate Gaussian Distribution for Hand Gesture Recognition. International Journal of Computer Science & Emerging Technologies IJCSET. 2012; 3(2):74-80.

Mokhar M. Hasan, Pramod K. Mishra. Robust Gesture Recognition Using Gaussian Distribution for Features Fitting. International Journal of Machine Learning and Computing. 2012; 2(3):266-273.

W.T. Freeman and Michal R. Orientation Histograms for Hand Gesture Recognition. IEEE International Workshop on Automatic Face and Gesture Recognition. 1995.

Min B., Yoon, H., Soh, J., et al. Hand Gesture Recognition Using Hidden Markov Models. IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation. 12-15 Oct. 1997; Orlando, FL, USA, New York: IEEE; 2002.

Verma, R., Dev A. Vision based hand gesture recognition using finite state machines and fuzzy logic. IEEE International Conference on Ultra-Modern Telecommunications & Workshops (ICUMT '09). 12-14 Oct. 2009; St. Petersburg, Russia, New York: IEEE; 2009.

Luigi Lamberti, Francesco Camastra. Real-Time Hand Gesture Recognition Using a Color Glove. Springer Proceedings of the 16th international conference on Image analysis and processing: Part I ICIAP. 2011.

Minghai Y., Xinyu Q., Qinlong G., et al. Online PCA with Adaptive Subspace Method for Real-Time Hand Gesture Learning and Recognition. WSEAS Transactions on Computers. 2010; 9(6):583-592.

N.A. Ibraheem., R.Z. Khan. Vision Based Gesture Recognition Using Neural Networks Approaches: A Review. International Journal of Human Computer Interaction (IJHCI), Malaysia. 2012; 3(1):1-14.

MediaPipe. MediaPipe Hands [Online]. Available from https://google.github.io/mediapipe/ solutions/hands.html

Siddharth S. Rautaray, Anupam Agrawal. Real Time Multiple Hand Gesture Recognition System for Human Computer Interaction. International Journal of Intelligent Systems and Applications. 2012; 4(5):56-64.

S. Mitra, and T. Acharya. Gesture Recognition: A survey IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). 2007; 37(3):311-324.

E.S. Nielsen, L.A. Canalis and M. H. Tejera. Hand Gesture Recognition for Human-Machine Interaction. Journal of WSCG., 2004;12:1-3.

Y. Wang, K.F. Loe and J.K. Wu. A Dynamic Conditional Random Field Model for Foreground and Shadow Segmentation‖. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2006;28(2):279-289.

G.R. Bradski, S. Clara. Computer Vison Face Tracking For Use in a Perceptual User Interface‖, Intel Technology JournalQ’98. 1998.

Dharani Mazumdar, Anjan Kumar Talukdar, et al. Gloved and Free Hand Tracking based Hand Gesture Recognition. 1st International Conference on Emerging Trends and Applications in Computer Science. 13-14 Sept. 2013; Shillong, India, New York: IEEE; 2013.

R. Lienhart and J. Maydt. An extended set of Haar-like features for rapid object detection. Proceedings. International Conference on Image Processing. 22-25 Sept. 2002; Rochester, NY, USA, New York: IEEE; 2002.

Yoo-Joo Choi, Je-Sung Lee, et al. A Robust Hand Recognition In Varying Illumination. Advances in Human Computer Interaction. Shane Pinder (Ed.). 2008.

Ming-Hsuan Yang, N. Ahuja, et al. Extraction of 2D Motion Trajectories and its Application to Hand Gesture Recognition‖. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2002;24(8):1061-1074.

CV Zone. Please Sign-In to view this section [Online]. Available from https://www.computer vision.zone/courses/advance-computer-%20vision-with-python/lesson/hand trackingmodule-py-7/

Nexocode. The challenges and opportunities of gesture recognition [Online]. Available from https://nexocode.com/blog/posts/gestures-recognition-challenges-and-opportunities/.

MediaPipe. MediaPipe Hands [Online]. Available from https://google.github.io/mediapipe/ solutions/hands.html

Tutorialspoint. You are browsing the best resource for Online Education [Online]. Available from https://www.tutorialspoint.com

Massey University. Virtual Open Days 2021, Rā Tuwhera Mariko 2021 [Online]. Available from https://www.massey.ac.nz

P. S. Neethu, R. Suguna, et al. An efficient method for human hand gesture detection and recognition using deep learning convolutional neural networks. Soft Computing. 2020;24:15239-15248.

Research Gate. Discover scientific knowledge and stay connected to the world of science [Online]. Available from https://www.researchgate.net




DOI: https://doi.org/10.37628/ijods.v7i1.683

Refbacks

  • There are currently no refbacks.