[Home ] [Archive]   [ فارسی ]  
:: Main :: About :: Current Issue :: Archive :: Search :: Submit :: Contact ::
:: Volume 7, Issue 1 (9-2020) ::
JNSEE 2020, 7(1): 4-32 Back to browse issues page
Sign Language Recognition by Combining Leap Motion Controller and Hand Image Information
Khadijeh Mahdikhanlou, Hossein Ebrahimnezhad
Sahand University of Technology , ebrahimnezhad@sut.ac.ir
Abstract:   (1445 Views)
Sign language recognition systems help deaf people to access various media. In this paper, the Leap Motion Controller (LMC) and the image of the hand are exploited for sign language recognition. The LMC provides 3D position of the hand joints. The first set of features are extracted from the data provided by the LMC. When the hand is not located in vertical view of the LMC or when the hand posed like a fist, the precise position of the hand joints is not recognizable. The second feature extracted from hand image helps most hand gestures be recognized precisely. The second feature includes histogram of oriented gradients and the distance of the hand contour form the center of the hand. Also, a dataset composed of variant American sign language gestures is created which includes 64000 samples. In recognition stage, random forest is applied which is a good option for large datasets. The experimental results show that the proposed method performs better than similar methods.
 
Keywords: hand gesture recognition, Leap Motion Controller, histogram of oriented gradients, random forest
Full-Text [PDF 2348 kb]   (137 Downloads)    
Type of Study: Research | Subject: Machine Vision
Received: 2019/08/26 | Accepted: 2020/03/1 | Published: 2021/04/19
Send email to the article author

Add your comments about this article
Your username or Email:

CAPTCHA


XML   Persian Abstract   Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

mahdikhanlou K, Ebrahimnezhad H. Sign Language Recognition by Combining Leap Motion Controller and Hand Image Information. JNSEE. 2020; 7 (1) :4-32
URL: http://jnsee.sut.ac.ir/jnsee/article-1-285-en.html


Volume 7, Issue 1 (9-2020) Back to browse issues page
سامانه های غیرخطی در مهندسی برق Journal of Nonlinear Systems in Electrical Engineering
نشریه سامانه‌های غیرخطی در مهندسی برق در خصوص اصول اخلاقی انتشار مقاله، از توصیه‌های «کمیته بین‌المللی اخلاق نشر» موسوم به COPE و «منشور و موازین اخلاق پژوهش» مصوب معاونت پژوهش و فناوری وزارت علوم، تحقیقات و فناوری تبعیت می‌کند.
Persian site map - English site map - Created in 0.11 seconds with 29 queries by YEKTAWEB 4331