Click here to Skip to main content
Click here to Skip to main content

Tagged as

Third eye

, 3 Sep 2013
Rate this:
Please Sign up or sign in to vote.
Braille keyboard and speech recognition app for the blind to use a tablet.

Please note

This article is an entry in our AppInnovation Contest. Articles in this sub-section are not required to be full articles so care should be taken when voting.

Category: Healthcare

Target: Tablet

Overview

This application enables the blind to use basic capabilities of a tablet, allowing the user to type into the tablet, and comes with a reader which reads the braille and normal text out for them to understand.

Background  

The braille typewriter consists of 6 keys which make up letters. Each letter is represented with dots arranged in 2 columns.

Description

This app meant for the blind to be able to use tablet devices to send emails or type out documents or read regular text, which can be books, newspapers or any document in any format. The following are its attributes:-

  • Braille keyboard: This app is meant to open up while writing just like the normal keyboard.  The user will then will touch the screen with his/her 8 fingers. The app will then position the keys accordingly using the multitouch functionality. On being positioned, the app will confirm by a faint beeping tone. Now the keys will work ad the normal braille typewriter, and will pronounce out letters and words after each entry. This will be converted to normal ascii text by the app. 
  • Speech recognition and notification: This app will also have inbuilt email, document reader and editor (all formats .docx, .pdf etc) functionality. So, this app will have voice commands enabled. The user has to speak pre-fed commands (example: 'write an email') which will launch the inbuilt email app, notifying user using sounds and speech throughout the process (example: "input receiver address", "input message" etc).
  • Reader: The inbuilt document editor will enable writing documents and and saving them with a name along with a voice tag, this will enable the user to open up the document with voice commands and edit it using the keyboard. Apart from this, the reader will read the written text out loud to the user.
  • Dialer: This inbuild function will dial a number either received through voice command or typed in braille, and save contacts with a sound tag. Again this will have voice notifications on all the steps.

Further scope of the app maybe the development of a inbuilt browser which can intelligently read out relevant text from a webpage. 

 

Approach

Study of braille, and touch sensitive technology for the app, speech recognition technology and step by step input required for each tasks with appropriate notifications. Finding out the most effective and the easiest steps for doing a particular function, as it has to be performed by a blind. And making the app more intuitive one the way.

The app will use orientation gyroscope and accelerometer features and multitouch features as input to compliment user's incapability to read (like tilting the tab to the left with a slight jerk will work as backspace). In all, the app will make the use of basic tablet features come naturally to the blind.

 

Language to be used

C++ using microsoft windows 8 libraries on visual studio.

Bio

http://www.codeproject.com/Members/Abhinav-Mukherjee

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Share

About the Author

Abhinav Mukherjee
Student BITS Pilani
India India
I am a 3rd year engineering student form BITS Pilani, India. I am interested in app development(mainly games) and have developed for various platforms including windows 8 Store, Windows phone 8 and iOS. I have developed quite a few games (some of them are hosted on my website www.naughtynewtons.com/gamebase ). I generally use physics engines like Unity to build games.
My branch of study is Electronics and Communications. I know few programming languages including C,C++,C#,Java,Python and web development languages like php,javascript etc.

Comments and Discussions

 
AdminThanks! PinstaffKevin Priddle19-Aug-13 2:59 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Mobile
Web03 | 2.8.140827.1 | Last Updated 3 Sep 2013
Article Copyright 2013 by Abhinav Mukherjee
Everything else Copyright © CodeProject, 1999-2014
Terms of Service
Layout: fixed | fluid