Multimodal Resources and Multimodal Systems Evaluation

M. Maybury and J.-C. Martin

1 June 2002, Las Palmas, Spain

The workshop Multimodal Resources and Multimodal Systems Evaluation was held at the 3rd International Conference for Language Resources and Evaluation (LREC-02).

Download workshop proceedings

Read the workshop report (summaries of all talks)

Programme

8:00 Welcome (Mark Maybury and Jean-Claude Martin)

Resources and Annotation: Multimodal

8:30 Data Resources and Annotation Schemes for Natural Interactivity (Laila Dybkj�r and Niels Ole Bernsen)

8:50 Metadata Set and Tools for Multimedia/Multimodal Language Resources (P. Wittenburg, D. Broeder, Freddy Offenga, and Don Willems)

Resources and Annotation: Gesture and Speech

9:10 FORM: A Kinematic Annotation Scheme and Tool for Gesture Annotation (Craig Martell, Chris Osborn, Jesse Friedman, and Paul Howard)

9:30 Cross-Linguistic Studies of Multimodal Communication (P. Wittenburg, S. Kita, and H. Brugman)

Resources and Annotation: Facial Expressions, Speech, Integration

9:50 Development of User-State Conventions for Multimodal Corpus in SmartKom (Silke Steininger, Susen Rabold, Olga Dioubina, and Florian Schiel)

10:10 Integration of multi-modal data and annotations into a simple extendable form: the extension of the BAS Partitur Format (Florian Schiel, Silke Steininger, Nicole Beringer, Ulrich Tuerk, and Susen Rabold)

10:40 Multimodal Resources Group Discussion (All)

11:00 � 11:20 Morning Break

Annotation Tools

11:20 Multimodal Corpus Authoring System (Anthony Baldry, Univ. of Pavia, Italy, and Christopher Taylor)

11:40 The Observer Video-Pro: Professional System for Collection, Analysis and Presentation of Observational Data (Niels Cad�e, Erik Meyer, Hans Theuws, and Lucas Noldus)

11:20 Data Resources and Annotation Schemes for Natural Interactivity (Laila Dybkj�r and Niels Ole Bernsen)

11:40 Metadata Set and Tools for Multimedia/Multimodal Language Resources (P. Wittenburg, D. Broeder, Freddy Offenga, and Don Willems)

13:00 Lunch

Multimodal Fusion

14:30 Prosody based co-analysis of Deictic Gestures and Speech in Weather Narration Broadcast (Kettebekov Sanshzar,Yeasin Mohammed, Krahnstoever Nils, SharmaRajeev)

14:50 A Generic Formal Description Technique for Fusion Mechanisms of Multimodal Interactive Systems (Philippe Palanque and Am�lie Schyn)

15:10 Eye Bed (Ted Selker, Winslow Burleson, Jessica Scott, and Mike Li)

15:40 MUMIN: A Nordic Network for MUltiModal Interfaces (Patrizia Paggio, Kristiina Jokinen, Arne J�nsson)

System Evaluation

16:00 PROMISE - A Procedure for Multimodal Interactive System Evaluation (Nicole Beringer, Ute Kartal, Katerina Louka, Florian Schiel, Uli T�rk)

16:30 - 17:00 Afternoon Break

17:00 Final Group Discussion (All)

18:00 Close

Organization

Organising Committee

Mark Maybury, MITRE
Jean-Claude Martin, LIMSI-CNRS, LINC-University Paris 8

Programme Committee

Niels Ole Bernsen, University of Southern Denmark
Harry Bunt, Tilburg University
Lisa Harper, MITRE
Michael Kipp, DFKI
Steven Krauwer, ELSNET
Dybkjaer Laila, NISLab, University of Southern Denmark
Catherine Pelachaud, University of Rome "La Sapienza"
Oliviero Stock, IRST
Wolfgang Wahlster, DFKI
Antonio Zampolli, Consiglio Nazionale delle Ricerche


maintained by kipp