INFOMMMI (Multimodal Interaction)

3rd quarter, 2023/2024, timeslot D, 7.5 ECTS

Interaction is one of the most important aspects of games and simulations. For example, you can create games without sounds. Or games with no visuals. But a game without interaction? Not really. And apart from faster and better graphics, maybe the most important technological achievements in game development in recent years have been related to advanced and new interaction styles. Think of the Nintendo Wii's motion-based controller, the XBox Kinect's human body tracking, or the tilt- and touch-based input used for handheld gaming. Compared to traditional controllers, these new ways for human-computer interaction often create a more natural and engaging gaming experience by using multiple modalities that are also characteristic for communications between humans.

In this course, we will take a closer look at all kinds of multimodal interaction including the related relevant theoretical background, e.g. about human perception. We will cover the emerging areas of virtual and augmented reality and cover a few other trends (e.g., brain-computer interfaces). The lectures will be accompanied by a practical part where students develop and analyze an interactive multimodal system. For more information about content, procedure, and formal issues please refer to the description page.

news and updates

MAR 15, 2024
Slides for today's Q&A session can be found under LECTURE.

MAR 13, 2024
In the Excel sheet for the project organization on MS Teams, you can now find which groups to send your initial paper to for the peer review.

MAR 9, 2024
Previous years' exams can now be found under LECTURE (scroll to the bottom of the page).

MAR 6, 2024
The slides for today's lecture and the third AR paper are online and can be found under LECTURE. This is the last paper that will be posted. All papers relevant for the exam are online now.

FEB 29, 2024
The slides for tomorrow's lecture and the second AR paper are online and can be found under LECTURE. Time slots for the final group meetings have been assigned for the groups who signed up before the deadline. Check the Excel spreadsheet in our MS Teams channel. Groups who have not signed up yet should do so asap.

FEB 23, 2024
The slides for today's lectures (both) are online and can be found under LECTURE. Likewise, the first AR paper has been posted (scroll to the bottom of the page). In addition, the schedule for the pitch presentations has been added to the Excel sheet with the groups in MS Teams. Check your timeslot there.

FEB 22, 2024
Be reminded that tomorrow (Fri, Feb 23) there are two lectures. The one in the morning and an additional one at 13:15 to catch up with the one that had to be cancelled at the beginning. Because it is in a different time slot and I was not able to get a room on such a short notice, it will be online and being recorded. If you cannot attend, make sure to watch the recording before the following lecture on Wednesday next week, because the content builds on each other. You find a link to join the online lecture in our MS Teams channel. The morning lecture at 9am takes place on location as usual.

FEB 21, 2024
The slides from today's lecture are online and can be found under LECTURE.

FEB 16, 2024
The slides from today's lecture are online and can be found under LECTURE.

FEB 15, 2024
The slides from yesterday's lecture are online and can be found under LECTURE.

FEB 7, 2024
The slides for today's lecture can be found under LECTURE (the password has been sent in an email to registered students). Also, information about the project has been posted under PROJECT. More on this in today's lecture. Because Peter got sick, he must cancel his first lecture on Friday. The SCHEDULE has been updated accordingly. We will make up for he missed one with another on in the afternoon on Friday, Feb 23. I will give that online and record it, so students who have a time conflict can still follow it afterward. Finally, when looking at our MS Teams group yesterday, I saw 24 members who already joined. This morning however, the number of members is zero. I have no idea what is going on there, but if you have already joined, you may need to re-join. If that does not work, let us discuss in the lecture today.

JAN 7, 2024
There has been a last minute teacher change. Wolfgang Hürst will replace Nina Rosa and co-teach this course together with Peter Werkhoven. The course starts on Wednesday, Feb 7, 2024, 3:15pm with the first lecture, where we will also discuss the projects and how to form groups for them. An email with further information will be sent to all registered students before this day.