Sign language interpreting on TV: a reception study of visual screen exploration in deaf signing users

Contenido principal del artículo

Marta Bosch-Baliarda
Olga Soler-Vilageliu
https://orcid.org/0000-0001-9219-1913
Pilar Orero
https://orcid.org/0000-0003-0269-1936

Resumen

We studied how sign language users responded to a screen composition including a larger screen for the content and a smaller screen for the sign language interpreter. 32 deaf users participated in this experiment, watching four similar clips with four different screen compositions. We registered the pattern of screen exploration with Eye Tracker, and we assessed content recall with two questionnaires. Our results show that sign language users mainly look at the sign language interpreter screen. Participants tend to look more often and for longer time at the SLI side closer to the main screen. Results are interpreted in terms of perceptual strategies developed by Sign Language users.

Descargas

Los datos de descargas todavía no están disponibles.

Detalles del artículo

Cómo citar
Bosch-Baliarda, M., Soler-Vilageliu, O., & Orero, P. (2020). Sign language interpreting on TV: a reception study of visual screen exploration in deaf signing users. MonTI. Monografías De Traducción E Interpretación, (12), 108–143. https://doi.org/10.6035/MonTI.2020.12.04
Sección
Artículos
Biografía del autor/a

Marta Bosch-Baliarda, Universitat Autònoma de Barcelona

Marta Bosch Baliarda is a sign language linguist and interpreter specialised in Deaf studies who has worked as a trainer for sign language interpreters, sign language teachers and communication support workers. She is currently a PhD research assistant in the research group TransMedia Catalonia from the Autonomous University of Barcelona and working on sign language accessibility services.

Olga Soler-Vilageliu, Universitat Autònoma de Barcelona

Olga Soler Vilageliu is an associate professor at UAB, where she teaches psycholinguistics and cognitive processing to undergraduates in Psychology and Speech Therapy. With a background in language processing, her research has focused on on-line measuring of handwriting in preschool and school
children. Within the TransMedia projects she is currently setting up experiments on different accessibility services: quality of perception of Sign Language on TV and emotional involvement of users of Audio description and Audio Subtitling.

Pilar Orero, Universitat Autònoma de Barcelona

Pilar Orero is an associated professor at the Faculty of Translation at Universitat Autònoma de Barcelona. She works in the field of Media Accessibility She has edited 12 books and wrote 86 papers in international journals, and more than 40 book chapters. Leader of numerous research projects funded by the Spanish and Catalan Gov. She leads TransMedia Catalonia Group (2005-2017) and the Audio Description and Audio Subtitling group at UN agency ITU 2011-2013 focus group on Media Accessibility. She is now working for WSIS+10. Co-editor of ISO/IEC JTC 1/SC 35 N on Audio Description.

Citas

Agrafiotis, Dimitris; Nishan Canagarajah; David R. Bull & Matthew Dye. (2003) “Perceptually optimised sign language video coding based on eye tracking analysis.” Electronics Letters 39:24, pp. 1703-1705. Electronic version: http://doi.org/10.1049/el:20031140

Allsop, Lorna & Jim Kyle. (2008) “Translating the news. A deaf translator’s experience.” In: Kellett, Cynthia & Eleana Ochse (eds.) 2008. English in international deaf communication. Bern: Peter Lang, pp. 383-400.

Bavelier, Daphne; Craig Brozinsky; Andrea Tomann; Teresa Mitchell, Helen Neville & Guoying Liu. (2001) “Impact of Early Deafness and Early Exposure to Sign Language on the Cerebral Organization for Motion Processing.” The Journal of Neuroscience 21:22, pp. 8931-8942.

Bosch-Baliarda, Marta; Olga Soler-Vilageliu & Pilar Orero. (2019) “Toward a Sign Language-Friendly Questionnaire Design.” Journal of Deaf Studies and Deaf Education (accepted for publication). Electronic version: http://doi.org/deafed/enz021

Bosch-Baliarda, Marta; Olga Soler-Vilageliu & Pilar Orero. (in prep.) “Toward recommendations for TV sign language interpretation formal parameters.” Journal of Audiovisual Translation (accepted for publication).

De Meulder, Maartje & Isabelle Heyerick. (2013) “(Deaf) Interpreters on Television: Challenging Power and Responsibility.” In: Meurant, Laurence; Aurélie Sinte; Mieke Van Herreweghe & Myriam Vermeerbergen (eds.) 2013. Sign Language Research, Uses and Practices. Crossing Views on theoretical and applied sign language linguistics. Berlin: De Gruyter Mouton, pp. 111-136.

Duncan, Bob. (1997) “Deaf people interpreting on television.” Deaf Worlds, International Journal of Deaf Studies 13:3, pp. 35–39.

Dye, Matthew W. G.; Peter C. Hauser & Daphne Bavelier. (2009) “Is Visual Selective Attention in Deaf Individuals Enhanced or Deficient? The Case of the Useful Field of View.” PLoS ONE 4:5, e5640. Online version: http://doi.org/10.1371/journal.pone.0005640

Dye, Matthew W. G., Jenessa L. Seymour & Peter C. Hauser. (2016) “Response bias reveals enhanced attention to inferior visual field in signers of American Sign Language.” Experimental Brain Research 234, pp. 1067-1076. Electronic version: http://doi.org/10.1007/s00221-015-4530-3

Geerts, David; Pablo Cesar & Dick Bulterman. (2008) “The implications of program genres for the design of social television systems.” In: UXTV ‘08 Proceedings of the 1st international conference on Designing interactive user experiences for TV and video, pp. 71-80.

Gil-Sabroso, Esther & Francisco Utray. (2016) “Sign language in Spanish television. Study on reception.” Área Abierta 16, pp. 17-37. Electronic version: http://dx.doi.org/10.5209/rev_ARAB.2016.v16.n1.47508

Grbić, Nadja. (2002) “Kein Fall für Notfälle. Gebärdensprachdolmetschen.” In: Kurz, Ingrid & Angela Moisl (eds.) 2002. Berufsbilder für Übersetzer und Dolmetscher. Perspektiven nach dem Studium. Wien: WUV-Universitätsverlag, pp. 181-189.

Krausneker, Verena. (2008) The protection and promotion of sign languages and the rights of their users in Council of Europe member states: needs analysis. Strasbourg: Council of Europe. Electronic version: https://www.ecml.at/Portals/1/documents/CoE-documents/The_protection_and_promotion_sign_language_eng.pdf.pdf

Kurz, Ingrid & Brigitta Mikulasek. (2004) “Television as a Source of Informationfor the Deaf and Hearing Impaired. Captions and Sign Language on Austrian TV.” Meta 49:1, pp. 81-88. doi:10.7202/009023ar

Kyle, Jim. (2007) Sign on Television: Analysis of Data. Bristol: Deaf Studies Trust. Electronic version: http://stakeholers.ofcom. org.uk/binaries/consultations/signing/responses/deafstudies_annex.pdf

Ladd, Paddy. (2003). Understanding deaf culture. Clevedon: Multilingual Matters. Letourneau, Susan M. & Teresa V. Mitchell. (2011) “Gaze patterns during identity and emotion judgments in hearing adults and deaf users of American Sign Language.” Perception 40:5, pp. 563-575. Electronic version: https://doi.org/10.1068/p6858

Looms, Peter Olaf. (2009) “E-inclusiveness and digital television in Europe - a holistic model.” In: Stephanidis, Constantine (ed.) 2009. Universal Access in Human-Computer Interaction. Addressing Diversity. Berlin: Springer Verlag, pp. 550-558.

Mäkipää, A. & A. Hämesalo. (1993) Towards Full Participation and Equal Rights. Helsinki: World Federation of the Deaf.

Martín Edo, Carlos Alberto; Pilar Orero; José Manuel Menéndez García & Guillermo Cisneros Pérez. (2015) “Signing provision in connected TV: HBB4ALL project.” IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1-5. Electronic version: https://doi.org/10.1109/BMSB.2015.7177264

Mas, Lluís & Pilar Orero. (2018) “New Subtitling Possibilities: Testing Subtitle Usability in HbbTV.” Translation Spaces 7:2, pp. 263-284.

Nebel, Katarina; Holger Weise; Phillip Stude; Armin De Greiff; Hans-Christoph Diener & Matthias Keidel. (2005) “On the neural basis of focused and divided attention.” Cognitive Brain Research 25, pp. 760-776.

Orero, Pilar; Javier Serrano; Olga Soler; Anna Matamala; Judit Castellà; Maria Teresa Soto Sanfiel; Anna Vilaró; Carme Mangiron. (2014) “Accessibillity to Digital Society: Interaction for All.” Think Mind,

pp. 188-191. Electronic version: http://www.thinkmind.org/index.php?view=article&articleid=icds_2014_8_10_10031

Oliver Moreno, Andreu. (2017) Attention and Dual Coding Theory: an Interaction Model Using Subtitles as a Paradigm. Bellaterra: Universtitat Autònoma de Barcelona. Tesis doctoral.

Parasnis, Ila & Vincent J. Samar. (1985) “Parafoveal attention in congenitally deaf and hearing young adults.” Brain Cogn 4:3, pp. 13–327.

Redón Sala, Núria. (2014) Qualitat en la interpretació de llengua de signes a la televisió: accessibilitat a la cultura. Barcelona: Universitat Autònoma de Barcelona. Trabajo Final de Grado en Logopedia.

Sandler, Wendy. (2013) “The phonological organization of sign languages.” Language and Linguistics Compass 6:3, pp. 162-182.

Seleskovitch, Danica. (1997) “Interview de Mme Arlette Morel, présidente de la Féderation nationale des sourds de France.” META 42:3, pp. 560-563.

Siple, Patricia. (1978) “Visual constraints for sign language communication.” Sign Language Studies 19, pp. 95-110.

Soler Vilageliu, Olga; Marta Bosch-Baliarda & Pilar Orero. (2015) “Hbb4All: Diseño de experimentos con usuarios para evaluar la recepción de LSE en TV.” Congreso CNLSE de la Lengua de Signos Española 2015. Electronic version:

https://www.youtube.com/watch?v=WMVEAauAAPk

Steiner, Ben. (1998) “Signs from the Void: The Comprehension and Production of Sign Language on Television.” Interpreting 3:2, pp. 99-146.

Stone, Christopher. (2007) “Deaf access for deaf people: the translation of the television news from English into British sign language.” In: Díaz Cintas, Jorge; Pilar Orero & Aline Remael (eds.) 2007. Media for all: subtitling for the deaf, audio description and sign language. Amsterdam: Rodopi, pp.71-88. Electronic version: http://discovery.ucl.ac.uk/123190/1/123190_Transmedia07.pdf

Stone, Christopher & Donna West. (2012) “Translation, representation and the Deaf ‘voice’.” Qualitative Research 12, pp. 645-665.

Utray, Francisco & Esther Gil Sabroso. (2014) “Diversidad cultural, lengua de signos y televisión en España.” Fonseca Journal of Communication 9, pp. 118-143. Electronic version: http://revistas.usal.es/index.php/2172-9077/article/view/12244/12597

Wehrmeyer, Jennifer. (2014) “Eye-tracking Deaf and hearing viewing of sign language interpreted news broadcasts.” Journal of Eye Movement Research 7(1):3, pp. 1-16.

Xiao, Xiaoyan & Freyan Li. (2013) “Sign language interpreting on Chinese TV: a survey on user perspectives.” Perspectives 21:1, pp. 100-116. Electronic version: https://doi.org/10.1080/0907676X.2011.632690

Several Authors (Centro de Normalización Lingüística de la Lengua de Signos Española, CNLSE). (2015) Informe. Presencia de la lengua de signos española en la televisión. Madrid: Real Patronato sobre Discapacidad.

Several Authors (Centro de Normalización Lingüística de la Lengua de Signos Española, CNLSE). (2017) Guía de buenas prácticas para la incorporación de la lengua de signos española en televisión. Madrid: Real Patronato sobre Discapacidad.

Several Authors (DTV4ALL). (2008) Digital Television for All. Electronic version: http://www.psp-dtv4all.org

Several Authors (European Broadcasting Union, EBU). (2016) “Access Services Pan European Survey.” Electronic version: https://www.ebu.ch/files/live/sites/ebu/files/Publications/Presentations/EBU%20Access%20Services%20Survey%202016.pdf

Several Authors (European Comission). (2010) European Disability Strategy 2010-2020: A Renewed Commitment to a Barrier-Free Europe. Brussels: European Comission. Electronic version: https://eurlex.europa.eu/LexUriServ/LexUriServ.do?uri=COM:2010:0636:FIN:en:PDF

Several Authors (European Parliament). (2010) Directive 2010/13/EU of the European Parliament and of the Council of 10 March 2010 on the coordination of certain provisions laid down by law, regulation or administrative action in Member States concerning the provision of audiovisual media services (Audiovisual Media Services Directive). Strasbourg: European Parliament and Council of the European Union. Electronic version: https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX:32010L0013

Several Authors (European Parliament). (2015) Proposal for a DIRECTIVE OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL on the approximation of the laws, regulations and administrative provisions of the Member States as regards the accessibility requirements for products and services. Brussels: European Commission. Electronic version: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=COM:2015:0615:FIN

Several Authors (European Regulators Group for Audiovisual Media Services, ERGA). (2016) Special task report on the provision of greater accessibility to audiovisual media services for persons with disabilities. Electronic version: ec.europa.eu/newsroom/document.cfm?doc_id=40610

Several Authors (European Union of the Deaf, EUD). (2019) “European Disability Strategy Survey.” Electronic version: https://www.eud.eu/test-survey/

Several Authors (HBB4ALL). (2017) “HBB4ALL Deliverables.” Electronic version: http://pagines.uab.cat/hbb4all/content/deliverables

Several Authors (Independent Television Commission). (2010) Guidelines on Standards for Sign Language on Digital Terrestrial Television. In Codes & Guidance Notes (Subtitling, Signing & Audio Description). Electronic version:

http://webarchive.nationalarchives.gov.uk/20100109083629 http://www.ofcom.org.uk/static/archive/itc/itc_publications/codes_guidance/sign_language_dtt/index.asp.html

Several Authors (National Deaf Children’s Society, NDCS). (2005) In their own words: Young deaf people’s access to television. London: The National Deaf Children’s Society.

Several Authors (National Disability Authority, NDA). (2014) “Guidelines for Digital TV equipment and services.” In: Irish National IT Accessibility Guidelines (Sign Language Interpreting). Electronic version: http://universaldesign.ie/Technology-ICT/Irish-National-IT-Accessibility-Guidelines/Digital-TVequipment-and-services/guidelines-for-digital-tv-equipment-and-services/Sign-Language-Interpreting/

Several Authors (Office of Communications, Ofcom). (2007) Signing on television. New arrangements for low audience channels. Electronic version: https://www.ofcom.org.uk/__data/assets/pdf_file/0015/41433/statement.pdf

Several Authors (Spanish Parliament). (2010) Ley General de la Comunicación Audiovisual. Electronic version: https://www.boe.es/buscar/pdf/2010/BOEA-2010-5292-consolidado.pdf