Home/Ain Shams Engineering Journal (ASEJ)/Article Record
Peer-Reviewed Article February 23, 2017

Selfie video based continuous Indian sign language recognition system

Are you an author of this work?Link to your sovereign AfriScholar profile
Published in: Ain Shams Engineering Journal (ASEJ)
Publisher: Elsevier BV • Egypt • 2090-4479
DOI: https://doi.org/10.1016/j.asej.2016.10.013

Abstract

This paper introduces a novel method to bring sign language closer to real time application on mobile platforms. Selfie captured sign language video is processed by constraining its computing power to that of a smart phone. Pre-filtering, segmentation and feature extraction on video frames creates a sign language feature space. Minimum Distance and Artificial Neural Network classifiers on the sign feature space is trained and tested iteratively. Sobel edge operator's power is enhanced with morphology and adaptive thresholding giving a near perfect segmentation of hand and head portions compensating for the small vibrations of the selfie stick. Word matching score (WMS) gives the performance of the proposed method with an average WMS of around 85.58% for MDC and 90% for ANN with a small variation of 0.3 s in classification times. Neural network classifiers with fast training algorithms will certainly make this novel selfie sign language recognizer application into app stores.

Download Full Text PDFView at PublisherCrossref RecordCrossref XML

Verified Citation Velocity

Recorded scholarly citations in African and international peer-reviewed literature

125
Total Citations

Citations are continuously tracked and harvested across continental OJS endpoints and OpenAlex feeds.