A development of multi-language interactive device using artificial intelligence technology for visual impairment person

Harum, Norharyati and Md Sallehuddin Khan, Nur'aliah Izzati and Emran, Nurul Akmar and Abdullah, Noraswaliza and Zakaria, Nurul Azma and Hamid, Erman and Anawar, Syarulnaziah (2021) A development of multi-language interactive device using artificial intelligence technology for visual impairment person. International Journal of Interactive Mobile Technologies, 15 (19). pp. 79-92. ISSN 1865-7923

Text MLDR IJIM.PDF Download (2MB)

Abstract

The issue of lacking reference books in braille in most public building is crucial, especially public places like libraries, museum and others. The visual impairment or blind people is not getting the information like we normal vision do. Therefore, a multi languages reading device for visually impaired is built and designed to overcome the limitation of reference books in public places. Some research regarding current product available is done to develop a better reading device. This reading device is an improvement from previous project which only focuses on single language which is not suitable for public places. This reading device will take a picture of the book using 5MP Pi camera, Google Vision API will extract the text, and Google Translation API will detect the language and translated to desired language based on push buttons input by user. Google Text-to-Speech will convert the text to speech and the device will read out aloud in through audio output like speaker or headphones. A few testings have been made to test the functionality and accuracy of the reading device. The testings are functionality, performance test and usability test. The reading device passed most of the testing and get a score of 91.7/100 which is an excellent (A) rating.

Item Type:	Article
Uncontrolled Keywords:	Artificial intelligence, Book reader, Google cloud, Image-text conversion, Text-to-speech, Visual impairment people
Divisions:	Faculty of Electronics and Computer Engineering
Depositing User:	Sabariah Ismail
Date Deposited:	14 Mar 2022 16:31
Last Modified:	18 Jul 2023 11:35
URI:	http://eprints.utem.edu.my/id/eprint/25702
Statistic Details:	View Download Statistic

Actions (login required)

View Item