Please use this identifier to cite or link to this item: http://hdl.handle.net/10263/7184
Title: Neural Machine Translation for Indian Sign Language
Authors: Moon, Sushant Sharad
Keywords: Gated Recurrent Unit (GRU
BLEU
Issue Date: Jul-2020
Publisher: Indian Statistical Institute, Kolkata
Citation: 40p.
Series/Report no.: Dissertation;;2020-30
Abstract: Sign languages being the primary language of the deaf community, researchers from many elds have been working in this domain from the past two decades. Until now, the majority of the work was in Sign Language Recognition. And only recently, few methods on Sign Language Translation have been developed, but even today, there does not exist any work on Indian Sign Language Translation. This work aims to translate Indian sign language videos to their corresponding spoken Indian English sentences. In this work, we are publicly releasing the rst of its kind Indian Sign Language Translation dataset, namely, the ISI-ISL-DDNEWS-2020T that we collected and annotated. Our dataset has >3 Million sign language frames, which translate to >93 Thousand words made out of >6 Thousand vocabulary words in spoken Indian English language. We also formalize a neural machine translation system trainable end-to-end for Indian Sign Language and benchmark on the said dataset. The model jointly learns the spatial & temporal relationship, underlying language model, and the sign & spoken language alignment. This baseline model gives the translation a BLEU-4 score of 4.02.
Description: Dissertation under the supervision Utpal Garain, Professor, CVPR
URI: http://hdl.handle.net/10263/7184
Appears in Collections:Dissertations - M Tech (CS)

Files in This Item:
File Description SizeFormat 
SushantMoon_CS1807_MTCSthesis2020.pdf2.39 MBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.