Classification of Natural Conversations by Humans and Machine Learning Based on Facial Actions

DOI

Between May 2021 and March 2022, video data from 84 participants in 28 groups was collected (the exact description of this data can be found in the article cited uder related identifiers). For the present analysis, facial action units were extracted from the videos and used for a machine learning based classification of conversation topic. Additionally, the videos were rated by 19 individuals, between May and June 2023.

This repository contains (1) the maschine learning dataset with individuals' facial action units and code to classify group discussion topics as a Python script with instructions and (2) Human rating data for third-person, video-based classification and analysis code as an R-script.

The present data was collected as part of the Collective Appetite Project in the Cluster for the Advanced Study of Collective Behavior at the University of Konstanz. It belongs to the article cited under related identifiers.

Identifier
DOI https://doi.org/10.48606/nf7gwyrr2pe9nmq6
Metadata Access https://www.radar-service.eu/oai/OAIHandler?verb=GetRecord&metadataPrefix=datacite&identifier=10.48606/nf7gwyrr2pe9nmq6
Provenance
Creator Putra, Prasetia (ORCID: 0000-0002-7632-375X); Köchling, Johanna (ORCID: 0000-0003-1842-797X); Straßheim, Jana ORCID logo; Bousquet, Christophe ORCID logo; Renner, Britta ORCID logo; Schupp, Harald ORCID logo
Publisher University of Konstanz
Contributor RADAR
Publication Year 2026
Funding Reference Deutsche Forschungsgemeinschaft https://ror.org/018mejw64 ROR EXC 2117-422037984 Cluster for the Advanced Study of Collective Behavior
Rights Open Access; Creative Commons Attribution 4.0 International; info:eu-repo/semantics/openAccess; https://creativecommons.org/licenses/by/4.0/legalcode
OpenAccess true
Representation
Language English
Resource Type Dataset
Format application/x-tar
Discipline Computer Science; Computer Science, Electrical and System Engineering; Engineering Sciences; Psychology; Social and Behavioural Sciences
Temporal Coverage 2021-2025