Publications

Authors:

Yazgi, Kheder; Beyan, Cigdem; Mancini, Maurizio; Niewiadomski, Radoslaw

Title:

Automatic Recognition of Commensal Activities in Co-located and Online settings

Year:

2024

Type of item:

Contributo in atti di convegno

Tipologia ANVUR:

Contributo in Atti di convegno

Language:

Inglese

Congresso:

26th ACM International Conference on Multimodal Interaction

Place:

Costa Rica

Period:

4-8 Nov 2024

Page numbers:

1-5

Keyword:

Activity recognition, commensality, datasets, social interactions, co-located, in-person

Short description of contents:

Technological advancement has profoundly impacted how people share meals, fostering research interest in new forms of commensality such as tele-dining and eating with artificial companions. Consequently, there is a need to develop computational methods for recognizing commensal activities, that is, actions related to food consumption and social signals displayed during meal-time. This paper introduces the first dataset that consists of synchronized video data of co-located dining dyads. The dataset is annotated with key social signals such as speaking activity, smiling, and food-related activities like chewing and food intake. Unlike previous studies that use remote settings, this work emphasizes the differences between online and co-located setups. A set of machine learning experiments is conducted on our and existing datasets, reaching the best F-score of 0.82. The cross-dataset analysis between co-located and online datasets also evidences the significant disparity between these two settings. While mixing co-located and online recordings may increase the model’s generalizability, we notice strong differences between the two settings, highlighting the importance of in-person data recordings for accurate recognition.

Product ID:

140744

Handle IRIS:

11562/1133206

Last Modified:

April 20, 2025

Bibliographic citation:

Yazgi, Kheder; Beyan, Cigdem; Mancini, Maurizio; Niewiadomski, Radoslaw, Automatic Recognition of Commensal Activities in Co-located and Online settings  in Proceedings of 26th ACM International Conference on Multimodal Interaction , Proceedings of "26th ACM International Conference on Multimodal Interaction" , Costa Rica , 4-8 Nov 2024 , 2024 , pp. 1-5

Consulta la scheda completa presente nel repository istituzionale della Ricerca di Ateneo