Zum Inhalt springen

ICMI 2018 Workshop on Modeling Cognitive Processes from Multimodal Data

Multimodal signals allow us to gain insights about internal cognitive processes of a person, for example: Speech and gesture analysis yield cues about hesitations, knowledgeability, or alertness, eye tracking yields information about a person's focus of attention, task, or cognitive state, EEG yields information about a person's cognitive load or information appraisal. Capturing cognitive processes is an important research tool to understand human behavior as well as a crucial part of a user model to an adaptive interactive system such as a robot or a tutoring system. As cognitive processes are often multifaceted, a comprehensive model requires the combination of multiple complementary signals. In this workshop at the ACM International Conference on Multimodal Interfaces (ICMI) conference in Boulder, Colorado, USA, we will discuss the state-of-the-art in monitoring and modeling cognitive processes from signals. We welcome the presentation of evaluation studies, theoretical considerations, data corpora, and novel modeling approaches. Potential topics include but are not limited to:

  • Multimodal workload and stress estimation
  • Multimodal attention and memory modeling
  • Multimodal engagement/frustration/confusion estimation
  • Eye tracking in the wild
  • Brain-Computer Interfaces and psychophysiological interfaces
  • Cognitive modeling
  • Experiment design for cognitive processes
  • Cognition-adaptive human-computer interfaces

The workshop proceedings are now available in the ACM digital library!

Workshop program:

Every paper will be assigned a 15 minute presentation slot (+ some minutes for discussion).

TimeTitlePresenter / Authors
9:00-9:15Welcome NoteFelix Putze (University of Bremen)
 Session 1: Cognition in InteractionChair: Felix Putze
9:15-9:35Predicting Group Satisfaction in Meeting Discussions

Catherine Lai (University of Edinburgh), Gabriel Murray (University of the Fraser Valley)

9:35-9:55Multimodal Approach to Engagement and Disengagement Detection with Highly Imbalanced In-the-Wild Data

Dmitrii Fedotov (Ulm University); Olga Perepelkina (Neurodata Lab LLC)*; Eva Kazimirova (Neurodata Lab LLC); Maria Konstantinova (Neurodata Lab LLC); Wolfgang Minker (Ulm University)

9:55-10:15Workload-Driven Modulation of Mixed-Reality Robot-Human Communication

Leanne Hirshfield (Syracuse University); Thomas E Williams (Colorado School of Mines); Natalie Sommer (Syracuse University); Trevor Grant (Syracuse University); Senem Velipasalar (Syracuse University)

10:15-10:35Symptoms of Cognitive Load in Interactions with a Dialogue System

José David Lopes (Heriot Watt University); Helen Hastie (Heriot-Watt University); Katrin Lohan (Heriot-Watt University)

10:35-11:00Coffee Break 
 Session 2: AttentionChair: Jutta Hild (Fraunhofer IOSB)
11:00-11:20Histogram of oriented velocities for eye movement detection

Wolfgang Fuhl (University of Tuebingen)*; Nora J Castner (University Tübingen); Enkelejda Kasneci (University of Tuebingen)

11:20-11:40Estimating Cognitive Load in Passive and Active Tasks from Pupil Width and Eye Gaze Changes using Bayesian Surprise 

Elena Wolf (Karlsruhe Institute of Technology); Manel Martinez (KIT)*; Alina Roitberg (KIT); Rainer Stiefelhagen (Karlsruhe Institute of Technology); Barbara Deml (Karlsruhe Institute of Technology)

11:40-12:00Investigating Static and Sequential Models for Intervention-Free Selection Using Multimodal Data of EEG and Eye Tracking

Mazen Salous (University of Bremen)*; Felix Putze (University of Bremen); Tanja Schultz (University of Bremen); Jutta Hild (Fraunhofer IOSB); Jürgen Beyerer (Fraunhofer IOSB)

13:00-13:20Overlooking: The nature of gaze behavior and anomaly detection in expert dentists 

Nora J Castner (University Tübingen)*; Enkelejda Kasneci (University of Tuebingen)

13:20-13:40Rule based learning for eye movement type detection

Wolfgang Fuhl (University of Tuebingen)*; Nora J Castner (University Tübingen); Enkelejda Kasneci (University of Tuebingen)

 Session 3: Neural & Cognitive ModelingChair: Erin Solovey
13:40-14:00Integrating Non-Invasive Neuroimaging and Computer Log Data to Improve Understanding of Cognitive Processes 

Leah Friedman (Drexel University), Ruixue Liu (Worcester Polytechnic Institute), Erin Walker (University of Pittsburgh), Erin T. Solovey (Worcester Polytechnic Institute)

 Multimer: Validating Multimodal, Cognitive Data in the City    

Arlene B Ducao (MIT); Ilias Koen (New York University); Zhiqi Guo (New York University)

14:20-14:45Coffee Break 
14:45-15:05The Role of Emotion in Problem Solving: First Results from Observing Chess

Thomas Guntz (Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP, LIG, 38000 Grenoble, France    )*; James L. Crowley (Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP, LIG, 38000 Grenoble, France    ); Dominique Vaufreydaz (Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP, LIG, 38000 Grenoble, France); Raffaella Balzarini (Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP, LIG, 38000 Grenoble, France); Philippe Dessus (Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP, LIG, 38000 Grenoble, France)    

15:05-15:25Discovering Digital Representations for Remembered Episodes from Lifelog Data

Bernd Dudzik (Delft University of Technology); Joost Broekens (Delft University of Technology); Mark Neerincx (TU Delft); Jeffrey Olenick (Michigan State University); Chu-Hsiang Chang (Michigan State University); Steve W. J. Kozlowski (Michigan State University); Hayley Hung (TU Delft)

15:25-15:45Multimodal Framework for Cognitive Task Performance Prediction from Body Postures, Facial Expressions and EEG Signal

Ashwin Ramesh Babu (University of Texas at Arlington)*; Akilesh Rajavenkatanarayanan (University of Texas at Arlington); James Robert Brady (University of Texas at Arlington); Fillia Makedon (University of Texas at Arlington)

15:45-16:30Closing Discussion 


Important Dates:

  • Submission deadline: August 5th 2018 (extended!) 
  • Notification of acceptance: September 9th, 2018
  • Camera-ready manuscript due: September 16th, 2018 (extended, you will receive further information by email)
  • Workshop date: October 16th, 2018

Find here the Call for Papers

Submit your paper here.

Aktualisiert von: koehne