INFOMMMI (Multimodal Interaction)

3rd quarter, 2024/2025, timeslot D, 7.5 ECTS

Interaction is one of the most important aspects of games and simulations. For example, you can create games without sounds. Or games with no visuals. But a game without interaction? Not really. And apart from faster and better graphics, maybe the most important technological achievements in game development in recent years have been related to advanced and new interaction styles. Think of the Nintendo Wii's motion-based controller, the XBox Kinect's human body tracking, or the tilt- and touch-based input used for handheld gaming. Compared to traditional controllers, these new ways for human-computer interaction often create a more natural and engaging gaming experience by using multiple modalities that are also characteristic for communications between humans.

In this course, we will take a closer look at all kinds of multimodal interaction including the related relevant theoretical background, e.g. about human perception. We will cover the emerging areas of virtual and augmented reality and cover a few other trends (e.g., brain-computer interfaces). The lectures will be accompanied by a practical part where students develop and analyze an interactive multimodal system. For more information about content, procedure, and formal issues please refer to the description page.

news and updates

MAR 13, 2025
Slides for tomorrow's Q&A session are online (see LECTURE).

MAR 5, 2025
Slides from today's lecture and the accompanying paper are online (see LECTURE). Also, note that Metehan organized a "Sticky testing day" on March 28 in the afternoon. Sticky will organize a room and snacks and advertise it, so you can come and run experiments for your project. Metehan will provide more info on this, but you can already consider it in your time planning if you want (participation is voluntary).

FEB 28, 2025
Slides from today's lecture and the accompanying paper are online (see LECTURE).

FEB 21, 2025
Slides from today's lecture are online (see LECTURE).

FEB 7, 2025
Slides from today's lecture are online (see LECTURE).

FEB 5, 2025
Slides from today's lecture are online (see LECTURE).

FEB 3, 2025
The course starts on Wednesday, Feb 5, 2024, 1:15pm with the first lecture, where we will also discuss the projects and how to form groups for them. An email with further information will be sent to all registered students before this day.