verifiedOpen Access Peer-Reviewed Scientific Journal (CC BY 4.0)
Submit Manuscript|OJS Login|Register
Peer-Reviewed Academic JournalInternational Journal of Applied Methods in Electronics and Computers
ISSN: 3023-4409DOI Prefix: 10.58190/ijamec
search
person
Research ArticlesverifiedPeer-ReviewedOpen Access
Pages: 27-33

A Mobile Application That Allows People Who Do Not Know Sign Language to Teach Hearing-Impaired People by Using Speech-to-Text Procedures

Emre BIÇEK fingerprint•
M. Nuri ALMALI fingerprint
Publication DateMarch 31, 2020
Volume / IssueVol. 8, No. 1 (pp. 27-33)
subject

Abstract

Hearing-impaired people use sign language to communicate with each other. People who do not know sign language it is difficult to communicate with hearing-impaired people. In this study, this problem is tried to solve with speech-to-text infrastructure. A software project has been developed to enable people who do not know sign language to communicate with the hearing impaired people. The scope of the system which named "Subtitles Course Tracking System (SCTS)" is that with an application running on the Android operating system, user’s speeches are converted into text (Speech-to-Text) and instantly transferred to remote a server. Speech texts which are recorded on the database of the remote server could be followed up in real-time on mobile phones and web pages by the software that has capable of asynchronous data exchange over the Internet (AJAX). Within the scope of this study, a web-based course management system has been developed and all courses in the system made accessible at any time.
Keywords:Hearing impairedMobile applicationSpeech-to-textCourse management system

Author Affiliations

format_list_numbered

References (18)

Cited Literature
  1. 1

    A. Ataş, A. Genç and E. Belgin, Odyoloji’de Kullanılan Temel Kavramlar, Pediatrik Kulak Burun Boğaz Hastalıkları, U. Akyol, Ed. Ankara, Güneş Kitapevi, 2003, pp. 35-50.

  2. 2

    World Health Organization, Deafness and Hearin Loss. http://www.who.int/ mediacentre/factsheets /fs300/en/, Accessed on: Oct. 10, 2016

  3. 3

    Ç. Gürboğa and T. Kargın, “İşitme engelli yetişkinlerin farklı ortamlarda kullandıkları iletişim yöntemlerinin/becerilerinin incelenmesi,” JFES., vol. 36, no. 1, pp. 51-64, May. 2003. https://doi.org/10.1501/Egifak_0000000074

    open_in_newCrossref / DOI: 10.1501/Egifak_0000000074
  4. 4

    The Liberated Learning Consortium, Increasing Access to Speech Recognition. http://www. transcribeyourclass.ca/projectdescription. html/, Accessed on: Dec.07, 2015

  5. 5

    Ava, Group Conversations Made Accessible. https://www.indiegogo.com/projects/ava-group-conversations-made-accessible/, Accessed on: Oct. 12, 2014

  6. 6

    Nuance Communications, Inc. Speech recognation. http://research.nuance.com/category/ speech-recognition/,Accessed on: Nov. 21, 2015

  7. 7

    K. Ryba, T. McIvor, M. Shakir and D. Paez, “Liberated Learning: Analysis of University Students Perceptions and Experiences with Continuous Automated Speech Recognition,” E-Journal of Instructional Science and Technology., vol. 9, no. 1, Mar. 2006.

  8. 8

    M. Wald, “Synote: Accessible and Assistive Technology Enhancing Learning for All Students,” in International Conference on Computers for Handicapped Persons, Berlin, Heidelberg, 2010, pp. 177-184. https://doi.org/10.1007/978-3-642-14100-3_27

    open_in_newCrossref / DOI: 10.1007/978-3-642-14100-3_27
  9. 9

    S. Kafle and M. Huenerfauth, “Evaluating the Usability of Automatically Generated Captions for People who are Deaf or Hard of Hearing,” in Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, Baltimore, Maryland, USA, 2017, pp. 165-174. https://doi.org/10.1145/3132525.3132542

    open_in_newCrossref / DOI: 10.1145/3132525.3132542
  10. 10

    A. A. Mirza, C. Mirza and D. Rhodes, “Conference And Call Center Speech To Text Machine Translation Engine,” Patent US20190121860A1, Apr. 25, 2019. https://patents.google.com/patent/US20190121860A1/en

  11. 11

    S. U. UPase, “Speech recognition based robotic system of wheelchair for disable people,” in International Conference on Communication and Electronics Systems (ICCES), Coimbatore, 2016, pp. 1-5. https://doi.org/10.1109/CESYS.2016.7889851

    open_in_newCrossref / DOI: 10.1109/CESYS.2016.7889851
  12. 12

    K. Lunuwilage, S. Abeysekara, L. Witharama, S. Mendis and S. Thelijjagoda, "Web based programming tool with speech recognition for visually impaired users," in 11th International Conference on Software, Knowledge, Information Management and Applications (SKIMA), Malabe, 2017, pp. 1-6. https://doi.org/10.1109/SKIMA.2017.8294132

    open_in_newCrossref / DOI: 10.1109/SKIMA.2017.8294132
  13. 13

    M. A. Noakes, A. J. Schmitt, E. McCallum and K. Schutte, “Speech-to-text assistive technology for the written expression of students with traumatic brain injuries: A single case experimental study,” School Psychology., vol. 34, no. 6, pp. 656-664, Nov. 2019. https://doi.org/10.1037/spq0000316

    open_in_newCrossref / DOI: 10.1037/spq0000316
  14. 14

    E. Biçek, “Real-time inscriptive follow up system of audible lecture with an Android based and web based application,” M.S. thesis, Dept. Electrical and Electronics Engineering., Van Yüzüncü Yıl Univ., Van, Turkey, 2016.

  15. 15

    J. Tebelskis, “Speech recognition using neural networks,” Ph.D. dissertation, School of Computer Science., Carnegie Mellon University., Pittsburgh, Pennsylvania, 1995. https://www.examinations-hub.com/download-file/104644743220180811135756.pdf

  16. 16

    A. Mesbah, A. van Deursen, “Component- and push-based architectural style for ajax applications,” The Journal of Systems & Software., vol. 81, no. 12, pp. 2194-2209, Apr. 2008. https://doi.org/10.1016/j.jss.2008.04.005

    open_in_newCrossref / DOI: 10.1016/j.jss.2008.04.005
  17. 17

    J. Garrett, “Ajax: a new approach to web applications, Adaptive path,” http://adaptivepath.org/ideas/ajax-new-approach-web-applications/, Accessed on: Oct. 14, 2015

  18. 18

    Yang J., Liao Z., Liu F., “The impact of ajax on network performance,” The Journal of China Universities of Posts and Telecommunications, vol 14, no. 1, pp. 32-34, 2008. https://doi.org/10.1016/S1005-8885(08)60007-2

    open_in_newCrossref / DOI: 10.1016/S1005-8885(08)60007-2
format_quote

How to Cite This Article

E. B., M. N. A. (2020). A Mobile Application That Allows People Who Do Not Know Sign Language to Teach Hearing-Impaired People by Using Speech-to-Text Procedures. International Journal of Applied Methods in Electronics and Computers, 27-33. https://doi.org/10.18100/ijamec.682806