INFOMMMI (Multimodal Interaction)

3rd quarter, 2023/2024, timeslot D, 7.5 ECTS

The course takes place in the 3rd quarter of the academic year 2022-2023. It is scheduled in time slot D (Wednesdays 13:00-19:00, Fridays, 9:00-17:00). Lectures usually take place on Wednesdays, 15:15-17:00 or Fridays, 9:00-10:45 (exceptions may apply). Attendance to some events (e.g., project-related presentations) will be mandatory. Details will be announced in the lecture or on this site. Please refer to the schedule for a detailed overview.

grading

Your final grade will be the average of your grades from the exam and the practical assignment. There will be one exam, covering the lectures and related papers. The practical assignment consists of a project, which will be done in a group. For the project, you will get one grade for the group, but individual differences may apply for students doing particularly well or bad.

criteria for passing and 2nd chances (herkansing)

In order to pass this course, you have to:

• participate in the exam and score at least a 5.0 (before rounding)
• hand in all deliverables for the project and score at least a 5.0 (before rounding)
• score a total final grade of at least 5.5 (before rounding; exam and project grades are averaged)

You can participate in the retakes (herkansing) if and only if you fail the course and:

• you participated in the exam and
• handed in all deliverables for the project and
• your final grade was at least 4.0 (before rounding)

If you qualify for the retake and your averaged grade from the exam was below 5.0 or your final grade was below 5.5

• you must participate in the retake exam. Your retake exam result will replace your original exam grade. Depending on the number of students, the retake exam may be oral instead of a written test.

If you qualify for the retake and your averaged grade from the practicals was below 5.0

• you will get a new practical assignment. The concrete topic will be decided individually by the instructors. Your grade from this new assignment will replace your original grade for the project.

You will pass the course if and only if your new grade after the retakes fulfils the criteria for passing specified above.

objectives

• Students know the basics of human visual, auditory and tactile perception.
• Students know the basic techniques of multisensory interfaces with virtual worlds (manipulation, navigation and communication).
• Students are acquainted with the pros and cons of applying multisensory presentation in the design of interfaces for virtual worlds (affective appraisal, training transfer, ...).
• Students are acquainted with psychophysical test methods to evaluate human performance in virtual worlds.
• Students are aware of emerging interface technologies (synaesthetic media and brain machine interfaces).

• Students know the basics of state-of-the-art and emerging trends in technologies for augmented reality.
• Students can apply basic techniques of multisensory interfaces to create a multimodal interaction, e.g., for control of a game (demonstrated by the related project work).
• Students know the advantages and disadvantages of using different media types and modalities depending on different contexts, conditions, and applications (demonstrated by the related project work).