Multimodal Corpora: From Multimodal Behaviour Theories to Usable Models

J.-C. Martin, P. Kühnlein, P. Paggio, R. Stiefelhagen and F. Pianesi

27 May 2006, Genoa, Italy

The workshop Multimodal Corpora: From Multimodal Behaviour Theories to Usable Models was held at the 5th International Conference for Language Resources and Evaluation (LREC-06). See the call for papers.

Download workshop proceedings

Visit workshop homepage

Programme

9:00 Welcome & Introduction (J.-C. Martin, P. K�ehnlein, P. Paggio, R. Stiefelhagen, F. Pianesi)

9:15 MEETING & METADATA

9h15 - 9h45 Working with Very Sparse Data to Detect Speaker and Listener Participation in a Meetings Corpus (Nick Campbell & Noriko Suzuki)

9h45 - 10h15 Multimodal Annotated Corpora of Consensus Decision Making Meetings (Fabio Pianesi, Chiara Leonardi, Massimo Zancanaro)

10h15 - 10h45 Language Resource Archiving supporting Multimodality Research (Peter Wittenburg, Daan Broeder, Peter Berck, Han Sloetjes, Alex Klassmann)

10:45 Discussion

11:00 Coffee Break

11:30 HAND GESTURES

11h30 - 12h Analysis of gesture expressivity modulations (Nicolas Ech Chafai, Catherine Pelachaud, Danielle Pel�)

12h - 12h30 Synthesizing Gesture Expressivity Based on Real Sequences (George Caridakis, Amaryllis Raouzaiou, Kostas Karpouzis, Stefanos Kollias)

12h30 - 13h An Annotation Scheme for Conversational Gestures: How to economically capture timing and form (Michael Kipp, Michael Neff, Irene Albrecht)

13h - 13h30 Using FORM Gesture Data to Predict Phase Labels (Craig Martell, Joshua Kroll)

13:30 Lunch

14:45 MULTIMODALITY DURING CONVERSATION

14h45 - 15h15 Degrees of freedom of facial movements in face-to-face conversational speech (G�rard Bailly, Fr�d�ric Elisei, Pierre Badin & Christophe Savariaux)

15h15 - 15h45 A coding scheme for the annotation of feedback, turn management and sequencing phenomena (Jens Allwood, Loredana Cerrato, Kristiina Jokinen, Costanza Navarretta and Patrizia Paggio)

15h45 - 16h15 A framework for analyzing embodied communicative feedback in multimodal corpora (Jens Allwood, Stefan Kopp, Karl Grammer, Elisabeth Ahls�n)

16:15 Discussion

16:30 Coffee break

17:00 MULTIMODAL HCI

17h - 17h30 A Study into Multimodal Behaviour in Error Correction (Marie-Luce Bourguet)

17h30 - 18h Making a Case for Spatial Prompting in Human-Robot Communication (Anders Green, Helge H�ttenrauch)

18h - 18h30 The MIMUS Corpus (Pilar Manch�n Portillo, Carmen del Solar Vald�s, Gabriel de Amores Carredano, Guillermo P�rez Garc�a)

18:30 Discussion

19:00 End of Workshop

Organization

Organising Committee

Jean-Claude Martin, CNRS-LIMSI Orsay
Peter K�hnlein, Uni Bielefeld
Patrizia Paggio, CST K�benhavn
Rainer Stiefelhagen, U Karlsruhe
Fabio Pianesi, ITC irst

Programme Committee

Jens Allwood, Univ. Goteborg, SE
Elisabeth Ahls�n, Univ. Goteborg, SE
Elisabeth Andr�, Univ. Augsburg, D
G�rard Bailly, CNRS-STIC, FR
Tom Br�ndsted, Univ. of Aalborg
St�phanie Buisine, ENSAM, FR
Susanne Burger, Carnegie Mellon University, Pittsburgh, PA, USA
Genevi�ve Calbris, ENS LSH Lyons & CNRS UMR 8606, Paris, FR
Loredana Cerrato, KTH TMH-CTT, SE
Piero Cosi, ISTC-SPFD CNR, I
John Glauert, University of East Anglia
Dirk Heylen, U Twente, NL
Bart Jongejan, CST, Univ. of Cph, DK
Kostas Karpouzis, ICCS, G
Michael Kipp, DFKI Saarbrucken, D
Stefan Kopp, SFB 360, D, S.
Alfred Kranstedt, SFB 360, D
Peter K�ehnlein, Bielefeld University, D
Daniel Loehr, MITRE, USA
Ian Marshall, University of East Anglia
Jean-Claude Martin, CNRS-LIMSI, F
Costanza Navarretta, CST, Univ. Of Cph, DK
Patrizia Paggio, CST, Univ. Of Cph, DK
Catherine Pelachaud, Univ. Paris, FR
Fabio Pianesi, ITC, I
Isabella Poggi, Univ. Roma Tre, I
Jan-Peter de Ruiter, MPI, NL
Ielka van der Sluis, U Aberdeen, UK
Rainer Stiefelhagen, Universitaet Karlsruhe, D
Janienke Sturm, Univ. Nijmegen, NL
Peter Wittenburg, MPI Nijmegen, NL
Massimo Zancanaro, ITC, I


maintained by kipp