Please use this identifier to cite or link to this item:
https://hdl.handle.net/20.500.11779/1302
Title: | Recognizing non-manual signs in Turkish sign language | Authors: | Aktaş, Müjde Gökberk, Berk Akarun, Lale |
Keywords: | Sign Language Recognition Non-Manual Sign Analysis Facial Expression Recognition |
Publisher: | IEEE | Source: | Aktaş, M., Gökberk, B. & Akarun, L., (6-9 November, 2019). Recognizing non-manual signs in Turkish sign language, 2019 Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA 2019), pp 1-6, DOI: https://doi.org/10.1109/IPTA.2019.8936081 | Abstract: | Recognition of non-manual components in sign language has been a neglected topic, partly due to the absence of annotated non-manual sign datasets. We have collected a dataset of videos with non-manual signs, displaying facial expressions and head movements and prepared frame-level annotations. In this paper, we present the Turkish Sign Language (TSL) non-manual signs dataset and provide a baseline system for non-manual sign recognition. A deep learning based recognition system is proposed, in which the pre-trained ResNet Convolutional Neural Network (CNN) is employed to recognize question, negation side to side and negation up-down, affirmation and pain movements and expressions. Our subject independent method achieves 78.49% overall frame-level accuracy on 483 TSL videos performed by six subjects, who are native TSL signers. Prediction results of consecutive frames are filtered for analyzing the qualitative results. | URI: | https://hdl.handle.net/20.500.11779/1302 https://doi.org/10.1109/IPTA.2019.8936081 |
ISBN: | 9781728139753 |
Appears in Collections: | Bilgisayar Mühendisliği Bölümü koleksiyonu Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection WoS İndeksli Yayınlar Koleksiyonu / WoS Indexed Publications Collection |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
BerkGökberk.pdf Until 2040-01-30 | Yayıncı Sürümü - Konferans Dosyası | 1.58 MB | Adobe PDF | View/Open Request a copy |
CORE Recommender
SCOPUSTM
Citations
2
checked on Aug 1, 2024
WEB OF SCIENCETM
Citations
6
checked on Jun 23, 2024
Page view(s)
2
checked on Jun 26, 2024
Google ScholarTM
Check
Altmetric
Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.