short-paper

Gender Representation in Cinematic Content: A Multimodal Approach

Authors:

Shrikanth S. NarayananAuthors Info & Claims

ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Pages 31 - 34

https://doi.org/10.1145/2818346.2820778

Published: 09 November 2015 Publication History

Abstract

The goal of this paper is to enable an objective understanding of gender portrayals in popular films and media through multimodal content analysis. An automated system for analyzing gender representation in terms of screen presence and speaking time is developed. First, we perform independent processing of the video and the audio content to estimate gender distribution of screen presence at shot level, and of speech at utterance level. A measure of the movie's excitement or intensity is computed using audiovisual features for every scene. This measure is used as a weighting function to combine the gender-based screen/speaking time information at shot/utterance level to compute gender representation for the entire movie. Detailed results and analyses are presented on seventeen full length Hollywood movies.

References

[1]

Arandjelovic, O., and Zisserman, A. Automatic face recognition for film character retrieval in feature-length films. In CVPR (2005), pp. 860--867.

Digital Library

[2]

Eyben, F., Weninger, F., Gross, F., and Schuller, B. Recent developments in opensmile, the munich open-source multimedia feature extractor. In ACM Mutimedia (2013).

Digital Library

[3]

Eyben, F., Weninger, F., Squartini, S., and Schuller, B. Real-life voice activity detection with lstm recurrent neural networks and an application to hollywood movies. In ICASSP (2013).

[4]

Garofolo, J., Lamel, L., Fisher, W., Fiscus, J., Pallett, D. S., Dahlgren, N. L., and ZueE, V. Timit acoustic-phonetic continuous speech corpus. Linguistic Data Consort. Philadelphia.

[5]

Gary, B. H., Manu, R., Tamara, B., and Erik, L. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Tech. Rep. 07--49, UMass, Amherst, Oct 2007.

[6]

Guha, T., Kumar, N., Narayanan, S., and Smith, S. Computationally deconstructing movie narratives: an informatics approach. In ICASSP (2015).

[7]

Li, S. Z., and Zhang, Z. Floatboost learning and statistical face detection. IEEE Trans. PAMI 26, 9 (2004), 1112--1123.

Digital Library

[8]

Ojala, T., Pietikainen, M., and Maenpaa, T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. PAMI 24, 7 (2002), 971--987.

Digital Library

[9]

Parris, E., and Carey, M. Language independent gender identification. In ICASSP (1996), pp. 685--688.

Digital Library

[10]

Ramakrishna, A., Malandrakis, N., Staruk, E., and Narayanan, S. S. A quantitative analysis of gender differences in movies using psycholinguistic normatives. In EMNLP (2015).

[11]

Smith, S. L., and Choueiti, M. Gender disparity on screen and behind the camera in family films; the executive report.

[12]

Smith, S. L., and Cook, C. A. Gender stereotypes: An analysis of popular films and tv.

[13]

Viola, P., and Jones, M. Rapid object detection using a boosted cascade of simple features. In CVPR (2001), pp. I--511.

[14]

Y. Zeng, Z. Wu, T. F., and Chan, W. Robust gmm based gender clas- sification using pitch and rasta-plp parameters of speech. In Proc. ICMLC (2006), p. 3376--3379.

[15]

Yuan, J., Wang, H., Xiao, L., Zheng, W., Li, J., Lin, F., and Zhang, B. A formal study of shot boundary detection. IEEE Trans. CSVT 17, 2 (2007), 168--186.

Digital Library

Cited By

Tores JSassatelli LWu HBergman CAndolfi LEcrement VPrecioso FDevars TGuaresi MJulliard VLecossais S(2024)Visual Objectification in Films: Towards a New AI Task for Video Interpretation2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01033(10864-10874)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.01033
Ribadeau Dumas H(2023)Strees in the streets. Gendered engagement with the urban space in Hindi films: a quantitative studyGeoJournal10.1007/s10708-023-10832-788:4(3651-3664)Online publication date: 28-Jan-2023
https://doi.org/10.1007/s10708-023-10832-7
Martinez VSomandepalli KNarayanan S(2022)Boys don’t cry (or kiss or dance): A computational linguistic lens into gendered actions in filmPLOS ONE10.1371/journal.pone.027860417:12(e0278604)Online publication date: 21-Dec-2022
https://doi.org/10.1371/journal.pone.0278604
Show More Cited By

Index Terms

Gender Representation in Cinematic Content: A Multimodal Approach
1. Applied computing
  1. Law, social and behavioral sciences

Recommendations

Measuring Female Representation and Impact in Films over Time
Special Issue on Retrieving and Learning from IoT Data and Regular Papers

Women have always been underrepresented in movies and not until recently has the representation of women in movies improved. To investigate the improvement of female representation and its relationship with a movie’s success, we propose a new measure, ...
The Vocal Range of Movies - Sonifying Gender Representation in Film
Entertainment Computing - ICEC 2015
Abstract
Research has shown that in contemporary movies, male characters consistently outnumber female characters. In recent years, the number of speaking roles identified as female has declined or remained stable. Guidelines like the Bechdel and Mako Mori ...
Large-scale multimodal movie dialogue corpus
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

We present an outline of our newly created multimodal dialogue corpus that is constructed from public domain movies. Dialogues in movies are useful sources for analyzing human communication patterns. In addition, they can be used to train machine-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

November 2015

678 pages

ISBN:9781450339124

DOI:10.1145/2818346

General Chairs:
Zhengyou Zhang
Microsoft Research, USA
,
Phil Cohen
VoiceBox Technologies, USA
,
Program Chairs:
Dan Bohus
Microsoft Research, USA
,
Radu Horaud
INRIA Grenoble Rhone-Alpes, France
,
Helen Meng
Chinese University of Hong Kong, China

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ICMI '15

Sponsor:

SIGCHI

ICMI '15: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 9 - 13, 2015

Washington, Seattle, USA

Acceptance Rates

ICMI '15 Paper Acceptance Rate 52 of 127 submissions, 41%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
493
Total Downloads

Downloads (Last 12 months)99
Downloads (Last 6 weeks)7

Reflects downloads up to 25 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tores JSassatelli LWu HBergman CAndolfi LEcrement VPrecioso FDevars TGuaresi MJulliard VLecossais S(2024)Visual Objectification in Films: Towards a New AI Task for Video Interpretation2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01033(10864-10874)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.01033
Ribadeau Dumas H(2023)Strees in the streets. Gendered engagement with the urban space in Hindi films: a quantitative studyGeoJournal10.1007/s10708-023-10832-788:4(3651-3664)Online publication date: 28-Jan-2023
https://doi.org/10.1007/s10708-023-10832-7
Martinez VSomandepalli KNarayanan S(2022)Boys don’t cry (or kiss or dance): A computational linguistic lens into gendered actions in filmPLOS ONE10.1371/journal.pone.027860417:12(e0278604)Online publication date: 21-Dec-2022
https://doi.org/10.1371/journal.pone.0278604
Somandepalli KHebbar RNarayanan S(2022)Robust Character Labeling in Movie Videos: Data Resources and Self-Supervised Feature AdaptationIEEE Transactions on Multimedia10.1109/TMM.2021.309615524(3355-3368)Online publication date: 2022
https://doi.org/10.1109/TMM.2021.3096155
Somandepalli KGuha TMartinez VKumar NAdam HNarayanan S(2021)Computational Media Intelligence: Human-Centered Machine Analysis of MediaProceedings of the IEEE10.1109/JPROC.2020.3047978109:5(891-910)Online publication date: May-2021
https://doi.org/10.1109/JPROC.2020.3047978
Mazières AMenezes TRoth C(2021)Computational appraisal of gender representativeness in popular moviesHumanities and Social Sciences Communications10.1057/s41599-021-00815-98:1Online publication date: 7-Jun-2021
https://doi.org/10.1057/s41599-021-00815-9
Hebbar RSomandepalli KNarayanan S(2019)Robust Speech Activity Detection in Movie Audio: Data Resources and Experimental EvaluationICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP.2019.8682532(4105-4109)Online publication date: May-2019
https://doi.org/10.1109/ICASSP.2019.8682532
Somandepalli KNarayanan S(2019)Reinforcing Self-expressive Representation with Constraint Propagation for Face Clustering in MoviesICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP.2019.8682314(4065-4069)Online publication date: May-2019
https://doi.org/10.1109/ICASSP.2019.8682314
Giannakopoulos TDimopoulos SPantazopoulos GChatziagapi ASgouropoulos DKatsamanis APotamianos ANarayanan S(2019)Using Oliver API for emotion-aware movie content characterization2019 International Conference on Content-Based Multimedia Indexing (CBMI)10.1109/CBMI.2019.8877398(1-4)Online publication date: Sep-2019
https://doi.org/10.1109/CBMI.2019.8877398
Somandepalli KKumar NGuha TNarayanan S(2018)Unsupervised Discovery of Character Dictionaries in Animation MoviesIEEE Transactions on Multimedia10.1109/TMM.2017.274571220:3(539-551)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1109/TMM.2017.2745712

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents