The Enjoyment of the Audiovisual Experience by Deaf and Hearing-Impaired People: Visual Representation of Sound Effects

DOI:  https://doi.org/10.12804/revistas.urosario.edu.co/disertaciones/a.4982

Article Sidebar

PDF (Español (España)) HTML (Español (España)) Lector Inteligente (Español (España)) ePub (Español (España))

Published: Dec 8, 2017
Issue: Vol. 11 No. 1 (2018): (Jan-Jun) Audience and Reception Studies: Minority Audiences and New Mediations
Section Estudios (Studies)


Keywords: Subtitling for the deaf , sound labeling , narrative experience , enjoyment , narrative engagement subtitulado para sordos , etiquetaje de sonido , experiencia narrativa , disfrute , compromiso narrativo subtítulos para surdos , etiquetagem de sonido , experiência narrativa , disfrute , compromisso narrativo

Main Article Content

Authors

Aikaterini Tsaousi Departament de Traducció i Intepretació Universitat Autónoma de Barcelona
Abstract
The goal of this study is to observe the narrative experience of viewers with hearing difficulties and those who use subtitles for the deaf in the consumption of audiovisual products. Specifically, the study seeks to determine if there is an effect on enjoyment and some of its main components, depending on the use of either verbal or nonverbal representations of sound effects that accompany an audiovisual narrative. A total of 46 viewers were randomly assigned to one of two experimental conditions: viewing films with subtitles or with icons. Afer viewing, participants assessed their enjoyment and narrative engagement using Likert scales. Statistical analyses show that there is no significant effect of the mode of presentation on enjoyment, inclination to repeat the experience, or engagement. Based on models developed by communication studies and media psychology to measure concepts related to user experience, this manuscript explores the possibilities of applying these measures from audiovisual translation studies and media accessibility to the field of audience reception.
How to Cite
Tsaousi, A. (2017). The Enjoyment of the Audiovisual Experience by Deaf and Hearing-Impaired People: Visual Representation of Sound Effects. Anuario Electrónico De Estudios En Comunicación Social "Disertaciones", 11(1), 110–126. https://doi.org/10.12804/revistas.urosario.edu.co/disertaciones/a.4982
References

Asociación Española de Normalización y Certificación. (2012). Norma une 153010: subtitulado para personas sordas y personas con discapacidad auditiva. subtitulado a través del teletexto. Madrid: aeNor.

Arnáiz-Uzquiza, V. (2012). Los parámetros que identifican el subtitulado para sordos. Análisis y clasificación. En R. Agost, P. Orero & E. di Giovanni (Eds.), Multidisciplinarity in Audiovisual Translation (pp. 103-

. Alacant: Universitat d’Alacant.

Arnáiz-Uzquiza, V. (2015). Long questionnaire in Spain. En P. Romero-Fresco (Ed.). The Reception of sDh in

Europe (pp. 95-116). Bern: Peter Lang.

Balsebre, A. (1994). El lenguaje radiofónico. Madrid: Ediciones Cátedra.

Bavelier, D., Dye, M., & Hauser, P. (2006). Do deaf individuals see better? Trends in Cognitive Science, 10,

-518.

Bureau International d’Audio Phonologie. (1997). Classification audiométrique des déficiences auditives.

Lisboa. Recuperado de https://www.biap.org/es/archivo/65-ct-2-classification-des-surdites

Biocca, F. (2002). The evolution of narrative towards “being there” in non-linear narrative worlds. En M.

Green, J. Strange & T. Brock (Eds.). Narrative impact: Social and cognitive foundations (pp. 2-47). Hillsdale:

Lawrence Erlbaum.

Busselle, R., & Bilandzic, H. (2009). Measuring narrative engagement. Media Psychology, 12(4), 321-347.

Cambra, C., Leal, A., & Silvestre, N. (2008). Función de la subtitulación y la interpretación de la imagen en

la comprensión de los mensajes televisivos: la comprensión de una serie por parte de los adolescentes

sordos. Cultura y Educación, 20(1), 81-93.

Cambra, C., Leal, A., & Silvestre, N. (2009). Comprehension of television messages by deaf students at

various stages of education. American Annals of the Deaf, 153(5), 425-434.

Cambra, C., Leal, A., & Silvestre, N. (2010). How deaf and hearing adolescents comprehend a televised

story. Deafness and Education International, 12(1), 34-51.

Chion, M. (1992). Como se escribe un guión. Madrid: Cátedra.

Chion, M. (1994). Audio-Vision: Sound on screen. Nueva York: Columbia University Press.

Civera, C., & Orero, P. (2010). Introducing icons in subtitling for the deaf and hard of hearing: Optimising

reception?. En A. Matamala y P. Orero (Eds.), Listening to subtitles: Subtitles for the deaf and hard of hearing

(pp. 149-161). Berna: Peter Lang.

Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of

Applied Psychology, 78, 98-104.

Fontaine, G. (1992). The experience of a sense of presences in intercultural and international encounters.

Presence: Teleoperators and virtual environments, 1(4), 482-490.

Fryer, L., & Freeman, J. (2012). Presence in those with and without sight: implications for virtual reality

and audio description. Journal of Cybertherapy and rehabilitation, 5(1), 15-23.

Gambier, Y. (2006). Multimodality and audiovisual translation. En Audiovisual translation scenarios: conference proceedings. EU-High-Level Scientific Conference Series. Recuperado de http://www.euroconferences.info/proceedings/2006_Proceedings/2006_Gambier_Yves.pdf

Gottlieb, H. (2005). Multidimensional translation: Semantics turned semiotics. MuTra 2005, Challenges of

Multidimensional Translation: Conference Proceedings.

Green, M. (2004). Transportation into narrative worlds: The role of prior knowledge and perceived realism.

Discourse Processes, 38(2), 247-266.

Green, M., & Brock, T. (2000). The role of transportation in the persuasiveness of públic narratives. Journal

of Personality and Social Psychology, 79, 701-721.

Green, M., Strange, J., & Brock, T. (Eds.). (2002). Narrative impact: social and cognitive foundations. Hillsdale: Lawrence Erlbaum.

Green, M., Brock, T., & Kaufman, G. (2004). Understanding media enjoyment: The role of transportation

into narrative worlds. Communication Theory, 14, 311-327.

Gutiérrez García, M., & Perona Páez, J.J. (2005). Teoría y técnica del lenguaje radiofónico. Barcelona: Bosch.

Henerson, M., Morris , L.L., & Firz-Gibbon, C. (1987). How to measure attitudes. Beverly Hills: Sage Publishing.

Jackson, D., Gillaspy A., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6-23.

Jennet, C., Cox, A., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., & Walton, A. (2008). Measuring and defining

the experience of immersion in games. International Journal of Human-Computer Studies, 66(9), 641-661.

Jensema, C., Sharkawy, S., Danturthi, R.S., Burch, R., & Hsu, D. (2000). Eye movements patterns of captioned television viewers. American Annals of the Deaf, 145(3), 275-285.

Jöreskog, K. G., & Sörbom, D. (1979). Advances in factor analysis and structural equation models. Nueva

York: University Press of America.

Kirkland, E. (1999). Evaluating of captioning features to inform development of digital television captioning facilities. American Annals of the Deaf, 144 (3), 250-260.

Kruger, J. L., & Steyn, F. (2014). Subtitles and eye tracking: Reading and performance. Reading Research

Quarterly, 49(1), 105-120.

Kruger, J. L., Szarkowska, A., & I. Krejtz. (2015). Subtitles on the moving image: An overview if eye tracking

studies. Journal of Entertainment Media. Recuperado de http://refractory.unimelb.edu.au/2015/02/07/

kruger-szarkowska-krejtz/v

Kruger, J.L., Doherty, S., & Soto-Sanfiel, M.T. (2017). Original language subtitles: Their effects on the native

and foreign viewer. Comunicar, 50, 23-32.

Kusters, A., & De Meulder, M. (2013). Understanding deafhood: In search of its meanings. American Annals

of the Deaf, 158(5), 428-438.

Ladd, P. (2003). Understanding Deaf Culture: In Search of Deafhood. Clevedon: Cromwell Press.

Lombard, M., & Ditton, T. (1997). At the heart of it all: The concept of presence. The Journal of Computer

Mediated Communication, 3(2). Recuperado de http://jcmc.indiana.edu/vol3/issue2/lombard.html

Lorenzo, L. (2010). Subtitling for deaf and hard of hearing children in Spain. A case study. En A. Matamal, & P.

Orero (Eds.), Listening to subtitles: Subtitles for the deaf and hard of hearing (pp. 115-138). Berna: Peter Lang.

Matamala, A., & Orero, P. (Eds.). (2010). Listening to subtitles: Subtitles for the deaf and hard of hearing.

Berna: Peter Lang.

Martínez Sierra, J. J. (2012). On the relevance of script writing basics in audiovisual translation practice

and training. Cadernos de Tradução, 29(1), 154-163.

Miquel-Iriarte, M. (2014). The reception of subtitling by the deaf and hard of hearing. Preliminary findings.

En E. Torres-Simon, & D. Orrego-Carmona (Eds.), Translation research projects 5 (pp. 63-76). Tarragona:

Intercultural Studies Group.

Neves, J. (2005). Audiovisual translation: Subtitling for the deaf and hard-of-hearing (Tesis doctoral, Londres: University of Surrey-Roehampton). Recuperado de http://roehampton.openrepository.com/roehampton/bitstream/10142/12580/1/neves%2520audiovisual.pdf

Neves, J. (2008). 10 fallacies about Subtitling for the d/Deaf and the hard of hearing. The Journal of Specialised Translation 10.Recuperado de http://www.jostrans.org/issue10/art_neves.php

Orero, P., & Vilaró, A. (2012). Eye tracking analysis of minor details in films for audio description. En R.

Agost, P. Orero, & E. di Giovanni (Eds.), Multidisciplinarity in audiovisual translation (pp. 295-319). Alacant:

Universitat d’Alacant.

Perego, E. (2012). Eye-tracking in audiovisual translation. Roma: Aracne Editrice.

Pérez-González, L. (2014). Audiovisual translation. Londres: Routledge.

Rajendran , D., Duchowski, A., Orero, P., Martínez, J., & Romero Fresco, P. (2013). Effects of text chunking on

subtitling: A quantitative and qualitative examination. Perspectives: Studies in Translatology, 21(1), 5-21.

Ramos, M. (2015). The emotional experience of films: Does audio description make a difference? Translator, 21(1), 68-94.

Redmond, S. (2015). Eye tracking the sublime in spectacular moments of science fiction film. En S. Redmond, & E. Marvell (Eds.). afI film reader: Endangering science fiction film (pp. 32-50). Nueva York: Routledge.

Remael, A. (2012). For the use of Sound. Film sound analysis for audio-description: Some key issues.” En

R. Agost, P. Orero, & E. di Giovanni (Eds.), Multidisciplinarity in Audiovisual Translation. Monografías de Traducción e Interpretación MonTI 4 (pp. 103-132). Alicante: Universidad de Alicante.

Rodero, E. (2012). See it on a radio story. Sound effects and shots to evoked imagery and attention on

audio fiction. Communication Research, 39(4), 458-479.

Romañach, J., & Lobato, M. (2005). Functional diversity, a new term in the struggle for dignity in the diversity of the human being. Independent Living Forum. Recuperado de http://disability-studies.leeds.ac.uk/

files/library/zavier-Functional-Diversity-Romanach.pdf

Romero-Fresco, P. (ed.). (2015). The reception of subtitles for the deaf and hard of hearing in Europe. Bern:

Peter Lang.

Pizzuto, E., Pietandrea, P., & Raffeele, S. (2007). Verbal and signed languages. Comparing structures, constructs and methodologies. Berlin: Mouton de Gruyter.

Pietrandrea, P., & Russo, T. (2007). Diagrammatic and imagic hypoicons in signed and verbal languages.

En E. Pizzuto, P. Pietrandrea, & R. Simone (Eds.), Verbal and signed languages. Comparing structures, constructs and methodologies (pp. 35-56). Berlín: Mouton de Gruyter.

Serrat-Manén, J. (2011). La percepció que tenen les persones sordes signants de l’actualitat periodística.

exploració comparativa entre els estudiants de la gallaudet university (eua) i la comunitat sorda catalana.

Tesis doctoral. Barcelona: Universitat Autònoma de Barcelona.

Soto-Sanfiel, M. T., L. Aymerich-Franch, & Ribes- Guàrdia, X. (2009). Interactividad y contenido como factores de disfrute en las ficciones interactivas. Revista Latina de Comunicación Social, 64, 668-681.

Soto-Sanfiel, M. T. (2015). Engagement and mobile listening. International Journal of Mobile Communications, 13(1), 29-50.

Szarkowska, A., Krejtz, I., Klyszejko, Z., & Wieczorek, A. (2011). Verbatim, standard, or edited? Reading

patterns of different captioning styles among deaf, hard of hearing, and hearing viewers. American Annals

of the Deaf, 156(4), 363-378.

Tal-Or, N., & Cohen, J. (2010). Understanding audience involvement: Conceptualizing and manipulating

identification and transportation. Poetics, 38(4), 401-418.

Taub, S. F. (2000). Iconicity in American sign language: Concrete and metaphorical applications. Spatial

Cognition and Computation, 2(1), 31-50.

Tsaousi, A. (2015). Making sound accessible: The labelling of sound effects in subtitling for the deaf and

hard-of-hearing. Hermeneus, 17, 233-252.

Vorderer, P., Klimmt, C. y Ritterfeld, U. (2004). Enjoyment: At the heart of media entertainment. Communication Theory, 14(4), 388-408.

Witmer, B. & Singer, M. (1998). Measuring presence in virtual environments: A presence questionnaire.

Presence: Teleoperators and Virtual Environments, 7(3), 225-240.

Query Statistics

Downloads

Download data is not yet available.
Publcation metrics

1168 577




 

Similar Articles

1 2 3 4 5 6 7 > >> 

You may also start an advanced similarity search for this article.