What Do You Mean When You Say You Like This Painting? Oculomotor Indices of Processes Involved in Aesthetical Appreciation

Piotr Francuz; Tomasz Jankowski; Paweł Augustynowicz

doi:10.18290/rpsych21242-7s

Piotr Francuz https://orcid.org/0000-0002-1235-9876
Tomasz Jankowski Institute of Psychology, John Paul II Catholic University of Lublin https://orcid.org/0000-0002-0636-3051
Paweł Augustynowicz Institute of Psychology, John Paul II Catholic University of Lublin https://orcid.org/0000-0002-4039-4580

DOI: https://doi.org/10.18290/rpsych21242-7s

Keywords: aesthetic evaluation, expertise in visual arts, figurative paintings, top-down control of eye movements, multilevel modeling

Abstract

This study aims to verify the hypotheses concerning emotional and cognitive predictors of aesthetic judgments, operationalized by instructions for viewing paintings from different perspectives (emotions and feelings, empathy, the captured moment, important elements, title, and mystery). Two eye movement parameters: fixation duration average and scan path length, estimated based on data recorded during viewing paintings, were analyzed. The extent to which the parameters of eye movement while performing different instructions predict the same parameters during the aesthetic assessment task was investigated. It was assumed that similar parameters of eye movements are indicators of similar mental processes, activated under different instructions. The viewing time window and expertise of participants were independent variables. Data were analyzed by multilevel modeling. The results showed that at the early stage of viewing a painting, instructions that activate emotional processing (regardless of expertise), better predict the aesthetic evaluation of a painting than instructions activating cognitive processes. At this stage, it was also found that the eye movement parameters, during the performance of instructions that activate cognitive processing, better predict the aesthetic evaluation of paintings only in the group trained in visual arts. At the later stage of viewing paintings, instructions activating cognitive processes turned out to be more reliable predictors of eye movement parameters during the aesthetic evaluation task than instructions activating emotional processes in both groups of participants. The results of the experiment were confronted with the existing models of perception of art and aesthetic experience.

References

Altman, R. (2008). A theory of narrative. Columbia University Press.

Berlyne, D. E. (1974). Studies in the new experimental aesthetics: Steps toward an objective psychology of aesthetic appreciation. Hemisphere.

Betz, T., Kietzmann, T. C., Wilming, N., & König, P. (2010). Investigating task-dependent top-down effects on overt visual attention. Journal of Vision, 10(3), 1–14. https://doi.org/10.1167/10.3.15

Borji, A., & Itti, L. (2014). Defending Yarbus: Eye movements reveal observers’ task. Journal of Vision, 14(3), 1–22. https://doi.org/10.1167/14.3.29

Bromme, R., Rambow, R., & Nückles, M. (2001). Expertise and estimating what other people know: The influence of professional experience and type of knowledge. Journal of Experimental Psychology: Applied, 7(4), 317–330. https://doi.org/10.1037/1076898X.7.4.317

Bubić, A., Sušac, A., & Palmović, M. (2017). Observing individuals viewing art: The effects of titles on viewers eye-movement profiles. Empirical Studies of the Arts, 35(2), 194–213. https://doi.org/10.1177/0276237416683499

Castelhano, M. S., Mack, M. L., & Henderson, J. M. (2009). Viewing task influences eye movement control during active scene perception. Journal of Vision, 9(3), 1–15. https://doi.org/10.1167/9.3.6

Chatterjee, A. (2011). Neuroaesthetics: A coming of age story. Journal of Cognitive Neuroscience, 23(1), 53–62. https://doi.org/10.1162/jocn.2010.21457

Cheung, M.-C., Law, D., Yip, J., & Wong, C. W. Y. (2019). Emotional responses to visual art and commercial stimuli: implications for creativity and aesthetics. Frontiers in Psychology, 10:14, 1–10. http://doi.org/10.3389/fpsyg.2019.00014

Cupchik, G. C. (2011). The digitized self in the internet age. Psychology of Aesthetics, Creativity, and the Arts, 5(4), 318–328. https://doi.org/10.1037/a0024820

Cupchik, G. C. (2016). The aesthetics of emotion. Up the down staircase of the mind-body. Cambridge University Press.

Cupchik, G. C., & Gignac, A. (2007). Layering in art and in aesthetic experience. Visual Arts Research, 33(1), 56–71. https://www.jstor.org/stable/20715434

Francuz, P., Szymańska, A., & Wojtasiński, M. (2019). Linguistic analysis of statements concerning paintings viewed under different instructions by experts and novices in the visual arts. Psychology of Language and Communication, 23(1), 357–379. https://doi.org/10.2478/plc-2019-0016

Freedberg, D., & Gallese, V. (2007). Motion, emotion and empathy in esthetic experience. Trends in Cognitive Sciences, 11(5), 197–203. https://doi.org/10.1016/j.tics.2007.02.003

Garwolińska, K., Oleś, P. K. & Gricman, A. (2018). Construction of narrative identity based on paintings. British Journal of Guidance & Counselling, 46, 340–348. https://doi.org/10.1080/03069885.2017.1370693

Gegenfurtner, A., Lehtinen, E., & Säljö, R. (2011). Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains. Educational Psychology Review, 23(4), 523–552. https://doi.org/10.1007/s10648-011-9174-7

Gerger, G., & Leder, H. (2015). Titles change the esthetic appreciations of paintings. Frontiers in Human Neuroscience, 9(464), 1–10. https://doi.org/10.3389/fnhum.2015.00464

Gombrich, E. H. (1995). The story of art (16th ed.). Phaidon Press.

Greene, M. R., Liu, T., & Wolfe, J. M. (2012). Reconsidering Yarbus: A failure to predict observers’ task from eye movement patterns. Vision Research, 62, 1–8. https://doi.org/10.1016/j.visres.2012.03.019

Haji-Abolhassani, A., & Clark, J. J. (2014). An inverse Yarbus process: Predicting observers’ task from eye movement patterns. Vision Research, 103, 127–142. https://doi.org/10.1016/j.visres.2014.08.014

Hekkert, P. (2015). Aesthetic responses to design: A battle of impulses. In P. P. Tinio & J. K. Smith (Eds.), The Cambridge handbook of the psychology of aesthetics and the arts (pp. 277–299). Cambridge University Press. https://doi.org/10.1017/CBO9781139207058.015

Jahoda, G. (2005). Theodor Lipps and the shift from “sympathy” to “empathy.” Journal of the History of the Behavioral Sciences, 41(2), 151–163. https://doi.org/10.1002/jhbs.20080

Jakesch, M., & Leder, H. (2009). Finding meaning in art: Preferred levels of ambiguity in art appreciation. Quarterly Journal of Experimental Psychology, 62(11), 2105–2112. https://doi.org/10.1080/17470210903038974

Jucker, J.-L., Barrett, J. L., & Wlodarski, R. (2014). “I just don’t get it”: Perceived artists’ intentions affect art evaluations. Empirical Studies of the Arts, 32(2), 149–182. https://doi.org/10.2190/EM.32.2.c

Knobloch-Westerwick, S., & Keplinger, C. (2006). Mystery appeal: Effects of uncertainty and resolution on the enjoyment of mystery. Media Psychology, 8(3), 193–212. https://doi.org/10.1207/s1532785xmep0803_1

Leder, H., Belke, B., Oeberst, A., & Augustin, D. (2004). A model of aesthetic appreciation and aesthetic judgments. British Journal of Psychology, 95(4), 489–508. https://doi.org/10.1348/0007126042369811

Levinson, J. (1985). Titles. The Journal of Aesthetics and Art Criticism, 44(1), 29–39. http:// doi.org/ 10.2307/430537

Lipps, T. (1903). Asthetik: Psychologie des Schonen und der Kunst. Vol. 1. Grundlegung der Asthetik. Voss.

Locher, P. J. (1996). The contribution of eye-movement research to an understanding of the nature of pictorial balance perception: A review of the literature. Empirical Studies of the Arts, 14(2), 143–163. https://doi.org/10.2190/D77M-3NU4-DQ88-H1QG

Locher, P. J. (2006). The usefulness of eye movement recordings to subject an aesthetic episode with visual art to empirical scrutiny. Psychology Science, 48(2), 106–114.

Locher, P. J. (2015). The aesthetic experience with visual art “at first glance.” In P. Bundgaard & F. Stjernfeld (Eds.), Investigations into the phenomenology and the ontology of the work of art: What are artworks and how do we experience them (pp. 75–88). Springer Open.

Locher, P. J., Krupinski, E. A., Mello-Thoms, C., & Nodine, C. F. (2007). Visual interest in pictorial art during an aesthetic experience. Spatial Vision, 21(1–2), 55–77. https://doi.org/10.1163/156856808782713762

Lüdecke, D. (2020). sjPlot: Data visualization for statistics in social science. R package version 2.8.4. https://CRAN.R-project.org/package=sjPlot

Massaro, D., Savazzi, F., Di Dio, C., Freedberg, D., Gallese, V., Gilli, G., & Marchetti, A. (2012). When art moves the eyes: A behavioral and eye-tracking study. PLoS ONE, 7(5), 1–16. https://doi.org/10.1371/journal.pone.0037285

Miura, T. (1990). Active function of eye movement and useful field of view in a realistic setting. In R. Groner, G. D’Ydewalle, & R. Parham (Eds.), From eye to mind: Information acquisition in perception, search, and reading (pp. 119–127). Elsevier Science Publishers.

Mullennix, J. W., & Robinet, J. (2018). Art expertise and the processing of titled abstract art. Perception, 47(4), 359–378. https://doi.org/10.1177/0301006617752314

Nodine, C., & Krupinski, E. (2003). How do viewers look at artworks? Bulletin of Psychology and the Arts, 4, 65–68.

Nodine, C. F., Locher, P. J., & Krupinski, E. A. (1993). The role of formal art training on perception and aesthetic judgment of art compositions. Leonardo, 26(3), 219–227. https://doi.org/10.2307/1575815

Oatley, K., Johnson-Laird, P. N. (2014). Cognitive approaches to emotions. Trends in Cognitive Sciences, 18(3), 134–140. http://doi.org/10.1016/j.tics.2013.12.004

Pelowski, M., Markey, P. S., Forster, M., Gerger, G., & Leder, H. (2017). Move me, astonish me… delight my eyes and brain: The Vienna Integrated Model of top-down and bottom-up processes in Art Perception (VIMAP) and corresponding affective, evaluative, and neurophysiological correlates. Physics of Life Reviews, 21, 80–125. https://doi.org/10.1016/j.plrev.2017.02.003

Pelowski, M., Markey, P. S., Lauring, J. O., & Leder, H. (2016). Visualizing the impact of art: An update and comparison of current psychological models of art experience. Frontiers in Human Neuroscience, 10. https://doi.org/10.3389/fnhum.2016.00160

Russell, P. A. (2003). Effort after meaning and the hedonic value of paintings. British Journal of Psychology, 94(1), 99–110. https://doi.org/10.1348/000712603762842138

Scherer, K. R. (2001). Appraisal considered as a process of multilevel sequential checking. In T. Johnstone (Ed.), Appraisal processes in emotion: Theory, methods, research (pp. 92–120). Oxford University Press.

Sidhu, D. M., McDougall, K. H., Jalava, S. T., & Bodner, G. E. (2018). Prediction of beauty and liking ratings for abstract and representational paintings using subjective and objective measures. PLoS ONE, 13(7): e0200431. https://doi.org/10.1371/journal.pone.0200431

Silvia, P. J. (2006). Exploring the psychology of interest. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195158557.001.0001

Silvia, P. J. (2007). Knowledge-based assessment of expertise in the arts: Exploring aesthetic fluency. Psychology of Aesthetics, Creativity, and the Arts, 1(4), 247–249. http:// doi.org/10.1037/1931-3896.1.4.247

Silvia, P. J. (2009). Looking past pleasure: Anger, confusion, disgust, pride, surprise, and other unusual aesthetic emotions. Psychology of Aesthetics, Creativity, and the Arts, 3(1), 48–51. https://doi.org/10.1037/a0014632

Silvia, P. J. (2012). Human emotions and aesthetic experience: An overview of empirical aesthetics. In S. E. Palmer (Ed.), Aesthetic science: Connecting minds, brains, and experience (pp. 250–271). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199732142.003.0058

Small, J. P. (1999). Time in space: Narrative in classical art. The Art Bulletin, 81(4), 562–575. Retrieved from http://www.jstor.org/stable/3051334

Swami, V. (2013). Context matters: Investigating the impact of contextual information on aesthetic appreciation of paintings by Max Ernst and Pablo Picasso. Psychology of Aesthetics, Creativity, and the Arts, 7(3), 285–295. https://doi.org/10.1037/a0030965

Unema, P., & Rötting, M. (1990). Differences in eye movements and mental workload between experienced and inexperienced motor-vehicle drivers. In D. Brogan (Ed.), Visual search (pp. 193–202). Taylor & Francis.

Van Orden, K. F., Limbert, W., Makeig, S., & Jung, T.-P. (2001). Eye activity correlates of workload during a visuospatial memory task. Human Factors: The Journal of the Human Factors and Ergonomics Society, 43(1), 111–121. https://doi.org/10.1518/001872001775992570

Vogt, S., & Magnussen, S. (2007). Expertise in pictorial perception: Eye-movement patterns and visual memory in artists and laymen. Perception, 36(1), 91–100. https://doi.org/10.1068/p5262

Waligórska, A. (2006). The eye and narration. Relations of artistic expertise and mode of interpretation of narrative and non-narrative paintings. Psychology of Language and Communication, 10(1), 45–64.

Yarbus, A. L. (1967). Eye movements and vision. Plenum.

Ylitalo, A. K., Särkkä, A., & Guttorp, P. (2016). What we look at in paintings: A comparison between experienced and inexperienced art viewers. Annals of Applied Statistics, 10(2), 549–574. https://doi.org/10.1214/16-AOAS921