Design and Implementation of Sign Language Translation Program Using Motion Recognition
AUTHORS
Jongwon Lee,Dept of Multimedia Engineering, Andong National University, Andong, Korea
SeongKyeong Heo,Dept of Multimedia Engineering, Andong National University, Andong, Korea
Dongchae Baek,Dept of Multimedia Engineering, Andong National University, Andong, Korea
Eunju Park,Dept of Multimedia Engineering, Andong National University, Andong, Korea
Hankyu Lim,Dept of Multimedia Engineering, Andong National University, Andong, Korea
Hyunji Ahn,Dept of Multimedia Engineering, Andong National University, Andong, Korea
ABSTRACT
About 5% of world population, 466million people in figure (432million adults and 34 million children), have the hearing impairment. Most people with hearing impairment use sign language as a means to communicate not only with people without disability but also with people with disability. However, there are hundreds of different sign languages and most people without disability do not know how to use sign language at all. Thus, it is difficult for people without disability to communicate with people with hearing impairment in daily living. This study aims to help those with hearing impairment for easier communication. To do this, this study designed a sign language translation program and implemented some of the design to recognize the user's motion by using motion recognition sensors and translating the recognized motions after finding the right words for the motions followed by displaying the words on the screen.
KEYWORDS
Hearing impairment communication, Motion recognition, Sign language translation, Smart gloves, Voice recognition
REFERENCES
[1] Korea Employment Agency for Persons with Disabilities, “2017 Disabled Persons Statistics at a Glance”, Korea Employment Agency for Persons with Disabilities, Employment Development Institute, (2017)
[2] Ministry of Health & Welfare, “Survey on Disabled Persons in 2017”, Ministry of Health & Welfare, (2018)
[3] Ministry of Health & Welfare, “A Study on the Strengthening of Communication Accessibility for the Deaf”, Ministry of Health & Welfare, (2013)
[4] Junseok Choi, “An Investigation into Improving UX Design for Enhancement of Hearing Impairment Accessibility in an IoT Environment: Focusing on the Smart Home”, Graduate School of Design Hanyang Cyber University, (2019)
[5] Junwoo Lee and Jongmi Park, “The Needs on Knowledge Information Service Use of People with Hearing Impairment and Tasks of Social Work Practice”, Journal of Rehabilitation Research, (2009), Vol. 13, No. 2, pp. 257-285.
[6] Hyunsuk Lee, Seungpil Kim and Wanyoung Chung, “Development of Sign Language Translation System using Motion Recognition of Kinect”, The Journal of Korea Institute of Signal Processing and Systems, (2013), Vol. 14, No. 4, pp. 235-242.
[7] Jaehyoek Jo, Youri Kim, Hyeji Kim, Seokki Kim and Gwanghyeon No, “A Study on Hand-held Sign Language Translation Using Smart Devices and Lip Motion”, Preceeding of Korea Intelligent Information Systems Society, (2016), pp. 2-9.
[8] Dong-Hwan Lee, Hyun-Sug Cho, Hong-Kyu Lee, “Implementation of Agriculture Guide Technology with IoT Open Platform and Augmented Reality Service”, The Journal of Korean Institute of Information Technology, (2018), Vol. 16, No. 8, pp. 97-106.
[9] SungMin Koo, Ingook Jang, Youngsung Son, “An Open Source Hardware based Sign Language Interpreter Glove & Situation Awareness Auxiliary IoT Device for the Hearing Impaired”, KIISE Transactions on Computing Practices, (2018), Vol. 24, No. 4, pp. 204-209.
[10] https://www.bbc.com/korean/international-44952310, July 26, (2018)
[11] https://m.post.naver.com/viewer/postView.nhn?volumeNo=4817925&memberNo=2950908&v Type=VERTICAL, August 11, (2016)
CITATION
COPYRIGHT
© 2019 Hankyu Lim et al. Published by Global Vision Press. This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CCBY4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.