The Integation Of Speech Recognition Technique In Role-Playing Computer Game For Down Syndrome Children Mandrin Learning

Lim, Chin Chuan (2017) The Integation Of Speech Recognition Technique In Role-Playing Computer Game For Down Syndrome Children Mandrin Learning. Masters thesis, Universiti Teknikal Malaysia Melaka.

[img] Text (24 Pages)
The Integation Of Speech Recognition Technique In Role-Playing Computer Game For Down Syndrome Children Mandrin Learning - Lim Chin Chuan - 24 Pages.pdf - Submitted Version

Download (408kB)
[img] Text (Full Text)
The Integation Of Speech Recognition Technique In Role-Playing Computer Game For Down Syndrome Children Mandrin Learning.pdf - Submitted Version

Download (1MB)

Abstract

Down syndrome individuals are known to have difficulties in speech, both pronunciation of words and making sentences. Such problem is caused by the innate physical impairment of their mouth muscles, as well as the cognitive and intelligence impairment. The myths about bilingualism in down syndrome children causing adverse effects on their language development have been debunked, showing that learning more than one language is possible for them without negative consequences. Many applications and courseware have been designed for down syndrome individuals to enhance their language learning experience. Such applications and courseware usually targeting words recognition and reading therapy, but the syntax and expressive language training are rarely focused. In this research, a 2-Dimensional role-playing game is integrated with state-of-the-art speech recognition technology to provide assistive training on Mandarin syntax and short sentences uttering for down syndrome children. The cognitive capabilities of down syndrome children are considered, and the multimedia application design standards for special education are followed. The research outcome is a game designed according to the Waterfall system development life cycle, while the educational contents are planned with hybrid ASSURE and Gerlach-Ely Instructional design model. The resultant game prototype is tested by five typically developing children age between five years old to six years old, and five adults. The results show that majority of the participant shown positive emotion playing the game, which implies that using RPG for speech practices is feasible. Since only the mildly impaired down syndrome children are able to read and speak, this research is intended to cater for the children under this category. Similar emotion trends are expected from the down syndrome children, which means that they would be motivated to speak with better grammar and remember to use the grammar correctly in their daily lives, as the RPG provides visual context for the sentences they speak.

Item Type: Thesis (Masters)
Uncontrolled Keywords: Speech synthesis, Automatic speech recognition, Speech processing systems
Subjects: T Technology > T Technology (General)
T Technology > TK Electrical engineering. Electronics Nuclear engineering
Divisions: Library > Tesis > FTMK
Depositing User: Nor Aini Md. Jali
Date Deposited: 25 Apr 2018 09:23
Last Modified: 30 Mar 2022 08:33
URI: http://eprints.utem.edu.my/id/eprint/20756
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item