Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data

Tamás Grósz; Noora Kallioniemi; Harri Kiiskinen; Kimmo Laine; Anssi Moisio; Tommi Römpötti; Anja Virkkunen; Hannu Salmi; Mikko Kurimo; Jorma Laaksonen

Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data

Tamás Grósz, Noora Kallioniemi, Harri Kiiskinen, Kimmo Laine, Anssi Moisio, Tommi Römpötti, Anja Virkkunen, Hannu Salmi, Mikko Kurimo, Jorma Laaksonen

University of Turku

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

1 Citation (Scopus)

110 Downloads (Pure)

Abstract

This paper traces signs of urban culture in Finnish fiction films from the 1950s by drawing on a multimodal analysis of audiovisual content. The Finnish National Filmography includes 208 feature films released between 1950-1959. Our approach to the automatic analysis of media content includes aural and visual object recognition and speech recognition. We concentrate on features that epitomize urbanity, including visual objects, such as forms of transportation (cars, horses) and sounds (rural and urban sounds, speech). Based on the scores and frequencies of these recognitions, we observe quantitative changes that took place during the 1950s. The paper demonstrates that aural and visual object recognition, as well as speech recognition, can successfully be applied in film historical analysis. The overall results support the idea that Finnish filmmakers fueled the imagination of urban life in the 1950s, paving the way for modern technologies and gradually pushing aside the signs of rural life.

Original language	English
Title of host publication	Proceedings of the 6th Digital Humanities in the Nordic and Baltic Countries Conference (DHNB 2022), Long Papers
Publisher	CEUR
Pages	63-78
Number of pages	16
Volume	3232
Publication status	Published - 2022
MoE publication type	A4 Conference publication
Event	Digital Parliamentary Data in Action - Uppsala, Sweden Duration: 15 Mar 2022 → 15 Mar 2022 https://dhnb.eu/conferences/dhnb2022/workshops/dipada/

Publication series

Name	CEUR Workshop Proceedings
Publisher	CEUR
Number	3232
ISSN (Print)	1613-0073

Workshop

Workshop	Digital Parliamentary Data in Action
Abbreviated title	DiPaDa
Country/Territory	Sweden
City	Uppsala
Period	15/03/2022 → 15/03/2022
Internet address	https://dhnb.eu/conferences/dhnb2022/workshops/dipada/

Keywords

automatic speech recognition
computer vision
film history
media analysis
modernization
multimodal analysis
object detection

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

Grosz_et alii_Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950sFinal published version, 3.05 MBLicence: CC BY

http://ceur-ws.org/Vol-3232/paper05.pdfLicence: CC BY

Cite this

Grósz, T., Kallioniemi, N., Kiiskinen, H., Laine, K., Moisio, A., Römpötti, T., Virkkunen, A., Salmi, H., Kurimo, M., & Laaksonen, J. (2022). Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data. In Proceedings of the 6th Digital Humanities in the Nordic and Baltic Countries Conference (DHNB 2022), Long Papers (Vol. 3232, pp. 63-78). (CEUR Workshop Proceedings; No. 3232). CEUR. http://ceur-ws.org/Vol-3232/paper05.pdf

@inproceedings{b6a901240bb64fcba01e01568ece916c,

title = "Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data",

abstract = "This paper traces signs of urban culture in Finnish fiction films from the 1950s by drawing on a multimodal analysis of audiovisual content. The Finnish National Filmography includes 208 feature films released between 1950-1959. Our approach to the automatic analysis of media content includes aural and visual object recognition and speech recognition. We concentrate on features that epitomize urbanity, including visual objects, such as forms of transportation (cars, horses) and sounds (rural and urban sounds, speech). Based on the scores and frequencies of these recognitions, we observe quantitative changes that took place during the 1950s. The paper demonstrates that aural and visual object recognition, as well as speech recognition, can successfully be applied in film historical analysis. The overall results support the idea that Finnish filmmakers fueled the imagination of urban life in the 1950s, paving the way for modern technologies and gradually pushing aside the signs of rural life.",

keywords = "automatic speech recognition, computer vision, film history, media analysis, modernization, multimodal analysis, object detection",

author = "Tam{\'a}s Gr{\'o}sz and Noora Kallioniemi and Harri Kiiskinen and Kimmo Laine and Anssi Moisio and Tommi R{\"o}mp{\"o}tti and Anja Virkkunen and Hannu Salmi and Mikko Kurimo and Jorma Laaksonen",

note = "Funding Information: This work was supported by the research consortium Movie Making Finland: Finnish fiction films as audiovisual big data, 1907-2017 (MoMaF), funded by the Academy of Finland (329266). Film data and metadata were provided by the National Audiovisual Institute in Finland and computational resources by CSC-IT Center for Science, Espoo, Finland. Funding Information: This work was supported by the research consortium Movie Making Finland: Finnish fiction films as audiovisual big data, 1907–2017 (MoMaF), funded by the Academy of Finland (329266). Film data and metadata were provided by the National Audiovisual Institute in Finland and computational resources by CSC—IT Center for Science, Espoo, Finland. Publisher Copyright: {\textcopyright} 2022 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0); Digital Parliamentary Data in Action, DiPaDa ; Conference date: 15-03-2022 Through 15-03-2022",

year = "2022",

language = "English",

volume = "3232",

series = "CEUR Workshop Proceedings",

publisher = "CEUR",

number = "3232",

pages = "63--78",

booktitle = "Proceedings of the 6th Digital Humanities in the Nordic and Baltic Countries Conference (DHNB 2022), Long Papers",

address = "Germany",

url = "https://dhnb.eu/conferences/dhnb2022/workshops/dipada/",

}

Grósz, T, Kallioniemi, N, Kiiskinen, H, Laine, K, Moisio, A, Römpötti, T, Virkkunen, A, Salmi, H, Kurimo, M & Laaksonen, J 2022, Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data. in Proceedings of the 6th Digital Humanities in the Nordic and Baltic Countries Conference (DHNB 2022), Long Papers. vol. 3232, CEUR Workshop Proceedings, no. 3232, CEUR, pp. 63-78, Digital Parliamentary Data in Action, Uppsala, Sweden, 15/03/2022. <http://ceur-ws.org/Vol-3232/paper05.pdf>

Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data. / Grósz, Tamás; Kallioniemi, Noora; Kiiskinen, Harri et al.
Proceedings of the 6th Digital Humanities in the Nordic and Baltic Countries Conference (DHNB 2022), Long Papers. Vol. 3232 CEUR, 2022. p. 63-78 (CEUR Workshop Proceedings; No. 3232).

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

TY - GEN

T1 - Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data

AU - Grósz, Tamás

AU - Kallioniemi, Noora

AU - Kiiskinen, Harri

AU - Laine, Kimmo

AU - Moisio, Anssi

AU - Römpötti, Tommi

AU - Virkkunen, Anja

AU - Salmi, Hannu

AU - Kurimo, Mikko

AU - Laaksonen, Jorma

N1 - Funding Information: This work was supported by the research consortium Movie Making Finland: Finnish fiction films as audiovisual big data, 1907-2017 (MoMaF), funded by the Academy of Finland (329266). Film data and metadata were provided by the National Audiovisual Institute in Finland and computational resources by CSC-IT Center for Science, Espoo, Finland. Funding Information: This work was supported by the research consortium Movie Making Finland: Finnish fiction films as audiovisual big data, 1907–2017 (MoMaF), funded by the Academy of Finland (329266). Film data and metadata were provided by the National Audiovisual Institute in Finland and computational resources by CSC—IT Center for Science, Espoo, Finland. Publisher Copyright: © 2022 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0)

PY - 2022

Y1 - 2022

N2 - This paper traces signs of urban culture in Finnish fiction films from the 1950s by drawing on a multimodal analysis of audiovisual content. The Finnish National Filmography includes 208 feature films released between 1950-1959. Our approach to the automatic analysis of media content includes aural and visual object recognition and speech recognition. We concentrate on features that epitomize urbanity, including visual objects, such as forms of transportation (cars, horses) and sounds (rural and urban sounds, speech). Based on the scores and frequencies of these recognitions, we observe quantitative changes that took place during the 1950s. The paper demonstrates that aural and visual object recognition, as well as speech recognition, can successfully be applied in film historical analysis. The overall results support the idea that Finnish filmmakers fueled the imagination of urban life in the 1950s, paving the way for modern technologies and gradually pushing aside the signs of rural life.

AB - This paper traces signs of urban culture in Finnish fiction films from the 1950s by drawing on a multimodal analysis of audiovisual content. The Finnish National Filmography includes 208 feature films released between 1950-1959. Our approach to the automatic analysis of media content includes aural and visual object recognition and speech recognition. We concentrate on features that epitomize urbanity, including visual objects, such as forms of transportation (cars, horses) and sounds (rural and urban sounds, speech). Based on the scores and frequencies of these recognitions, we observe quantitative changes that took place during the 1950s. The paper demonstrates that aural and visual object recognition, as well as speech recognition, can successfully be applied in film historical analysis. The overall results support the idea that Finnish filmmakers fueled the imagination of urban life in the 1950s, paving the way for modern technologies and gradually pushing aside the signs of rural life.

KW - automatic speech recognition

KW - computer vision

KW - film history

KW - media analysis

KW - modernization

KW - multimodal analysis

KW - object detection

UR - http://www.scopus.com/inward/record.url?scp=85139776410&partnerID=8YFLogxK

M3 - Conference article in proceedings

AN - SCOPUS:85139776410

VL - 3232

T3 - CEUR Workshop Proceedings

SP - 63

EP - 78

BT - Proceedings of the 6th Digital Humanities in the Nordic and Baltic Countries Conference (DHNB 2022), Long Papers

PB - CEUR

T2 - Digital Parliamentary Data in Action

Y2 - 15 March 2022 through 15 March 2022

ER -

Grósz T, Kallioniemi N, Kiiskinen H, Laine K, Moisio A, Römpötti T et al. Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data. In Proceedings of the 6th Digital Humanities in the Nordic and Baltic Countries Conference (DHNB 2022), Long Papers. Vol. 3232. CEUR. 2022. p. 63-78. (CEUR Workshop Proceedings; 3232).

Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data

Abstract

Publication series

Workshop

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

USSEE: Understanding speech and scene with ears and eyes (USSEE)

-: Movie Making Finland: Finnish fiction films as audiovisual big data, 1907-2017

-: Movie Making Finland: Finnish fiction films as audiovisual big data, 1907-2017

Science-IT

Cite this

Tracing Signs of Urbanity in the Finnish Fiction Film of the 1950s: Toward a Multimodal Analysis of Audiovisual Data

Abstract

Publication series

Workshop

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Projects

USSEE: Understanding speech and scene with ears and eyes (USSEE)

-: Movie Making Finland: Finnish fiction films as audiovisual big data, 1907-2017

-: Movie Making Finland: Finnish fiction films as audiovisual big data, 1907-2017

Equipment

Science-IT

Cite this