INFOMMOB (Mobile Interaction)

4th quarter, 2023/2024, timeslot A, 7.5 ECTS

The lectures for this course will cover various aspects related to mobile interaction, mostly smart phones and tablets, but some other wearable devices as well. In particular, we will discuss technologies (e.g., sensors) used for interaction with phones and tablets, how they can be used in mobile interaction design, requirements, characteristics, and pitfalls. We will further address alternative approaches, including current and future research. Other mobile devices (esp. wearables) and their potential for interaction may be discussed as well. The content of the lecture and mandatory reading (see below) is relevant for the exam, which contributes 50% to your final grade for this course.

course material

Slides, videos, and mandatory reading (i.e., content that is relevant for the exam) will be listed here around the time the related topics will be discussed in the lectures (see SCHEDULE). For additional references, please refer to the lecture slides. Lectures will be on location, streamed live via MS Teams, and also being recorded. Don't rely on these recordings though, since some of them might fail.

Lecture 1: Introduction

• Slides (PDF)
• Literature:
  • Chapter 9, "Mobile Computing," from the book The Encyclopedia of Human-Computer Interaction, 2nd Ed, [HTML, PDF]
• Videos:
  1. Extreme Gaming with an Epson Projector
  2. OmniTouch wearable multitouch interaction
  3. Woman falls in mall fountain while texting

Lecture 2: Technologies

• Slides (PDF)
• Literature:
  • Yeo et al. (2017), Investigating tilt-based gesture keyboard entry for single-handed text entry on large devices, ACM CHI 2017, [PDF]
    See also the video entitled SWiM: Shape Writing in Motion [CHI17 Paper] Tilt-based Gesture Keyboard.
• Videos:
  1. HoloFlex: A flexible holographic smartphone with bend input
  2. On-face olfactory interfaces
  3. Super Monkey Ball on the iPhone! (iPhone SDK) (watch from 0:28 min till 1:35 min, listen esp. to the interaction-related part starting at 0:49 min)
  4. Exploring Tilt for No-Touch, Wrist-Only Interactions on Smartwatches
  5. Float: one-handed and touch-free target selection on smartwatches

Lecture 3: Touch screens

• Slides (PDF)
• Literature:
  • Corsten et al. (2019), ForceRay: Extending Thumb Reach via Force Input Stabilizes Device Grip for Mobile Touch Input, ACM CHI 2019, [PDF]
    You might also want to watch the related video on YouTube.
• Videos:
  1. iPhone keynote (watch interface part, 4:50 min till ca. 8:20 min)
  2. Adaptive photographic composition guidance (watch for yourself after lecture)
  3. TapBoard: Making a Touch Screen Keyboard More Touchable (watch for yourself after lecture)
  4. Tactile Rendering of 3D Features on Touch Surfaces
  5. BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones
  6. LumiWatch: On-Arm Projected Graphics and Touch Input (watch for yourself after lecture)
  7. EarTouch: Turning the Ear into an Input Surface (watch for yourself after lecture)

Lecture 4: Human aspects & UI design

• Slides (PDF)
• Literature:
  • S. Sheshadri et al. (2020), Learn with Haptics: Improving Vocabulary Recall with Free-form Digital Annotation on Touchscreen Mobiles ACM CHI 2020, [PDF].
• Videos:
  1. Mobile video (image sizes)
  2. Spritz Introduction
  3. Spritz Eye Tracking Demonstration
  4. Tilt Techniques: Investigating the Dexterity of Wrist-based Input

Lecture 5: Touch interaction & gestures

• Slides (PDF)
• Literature:
  • Corsten et al. (2018), Use the Force Picker, Luke: Space-Efficient Value Input on Force-Sensitive Mobile Touchscreens, ACM CHI 2018, [PDF]
    You might also want to watch the related video on YouTube.
• Videos:
  1. Investigating the Effect of Orientation and Visual Style on Touchscreen Slider Performance
  2. The Fat Thumb: Using the Thumb's Contact Size for Single-Handed Mobile Interaction
  3. PalmTouch: Using the Palm as an Additional Input Modality on Commodity Smartphones
  4. MicroRolls: Expanding Touch-Screen Input Vocabulary by Distinguishing Rolls vs. Slides of the Thumb
  5. Effect of Orientation on Unistroke Touch Gestures
  6. HeadReach: Using Head Tracking to Increase Reachability on Mobile Touch Devices
  7. 3D Input Interface for Mobile Devices

Lecture 6: Evaluation

• Slides (PDF)
• Literature:
  • N. Henze et al. (2012), Observational and Experimental Investigation of Typing Behaviour using Virtual Keyboards on Mobile Devices, ACM CHI 2012, [PDF] You might also want to watch the related video on YouTube.

Lecture 7: Mobile gaming

• Slides (PDF)
• Literature:
  • G. McAllister: A Guide To iOS Twin Stick Shooter Usability, [HTML]
• Videos:
  1. Leo's Fortune - Gameplay (starts at 1:35 min)
  2. A comparison of accelerometer and touch-based input for mobile gaming
  3. Position vs. velocity control for tilt-based interaction
  4. A comparison between tilt-input and facial tracking as input methods for mobile games
  5. Tilt-Touch synergy: Input control for "dual-analog" style mobile games

Lecture 8: 3D & Virtual Reality

• Slides (PDF)
• Videos:
  1. Head Tracking for Desktop VR Displays using the WiiRemote (1st minute explaining the problem)
  2. Head Tracking for Desktop VR Displays using the WiiRemote (2:29 min till 3:15 min illustrating the solution)
  3. Head Tracking for iPhone: Glasses-Free 3D Display (Demo)
  4. Amazon Fire Phone: What the Heck Is Dynamic Perspective? (watch later for yourself)
  5. Mobile 3D Graphics and Virtual Reality Interaction (watch 0:12 min till 0:45 min, Shoebox approach)
  6. pCubee: A Perspective-Corrected Handheld Cubic Display (watch whole video with sound)
  7. Diorama Holographic iPhone Game
  8. Nintendo DS 3D puzzle game (the effect is shown around 0:30 till 0:55 min)
  9. Shoebox VR (with motion)
  10. Shoebox VR (depth perception test)
  11. Shoebox VR (runner game)
  12. Shoebox VR (free roaming)
  13. The Chameleon: Spatially-Aware Palmtop Computers (watch 0:00 till 1:50 min describing the concept and interaction)
  14. Mobile 3D Graphics and Virtual Reality Interaction (watch 0:46 min till 1:14 min, Fixed world approach)
  15. Around body interaction.
  16. Way Out: A Multi-Layer Panorama Mobile Game Using Around-Body Interactions.

Lecture 9: Augmented Reality

• Slides (PDF)
• Videos:
  1. VRScout - Changing the future of classroom education
  2. Bring The New York Times Magazine cover to life with Google Lens
  3. AR CUT PASTE Prototype Live Demonstration (not available anymore - if someone finds the video somewhere, email it to me, so I can put the link here)
  4. How to use AR view on Google Maps
  5. Take the guesswork out of furniture buying with IKEA's new AR app
  6. ARDefender: iPhone Augmented Reality game by int13
  7. 3DTouch & HOMER-S:
     • 3DTouch & HOMER-S: Intuitive Manipulation for One-Handed Handheld AR (play till 0:50 min for 3DTouch)
     • 3DTouch & HOMER-S: Intuitive Manipulation for One-Handed Handheld AR (start playback at 0:50 min for HOMER-S)
  8. SlidAR: A 3D Positioning Method for SLAM-Based Handheld Augmented Reality
  9. Mobile AR interaction (boardgames)
  10. Just a Line: The first cross-platform collaborative AR app (for doodling)
  11. ACM MM 2013 (mobile AR drawing)
  12. Mobi3DSketch: 3D Sketching in Mobile AR

 

comments on the exam

• Slides from the Q&A session (PDF)

The exam covers the content from the lectures, videos, and papers listed on this page. Below the exams from the last six years.

This year's will be similar in style. Important: Be aware that the ones from 2020 and 2021 were open book exams (because of COVID). In the other years, the exam was a closed book exam. This year, it will be a closed book exam again. Also, different aspects may have been covered in previous years. Likewise, things may have been discussed at different levels of detail and different papers may have been used.

• 2023, 2023 (with comments)
• 2022, 2022 (with comments)
• 2021, 2021 (with comments)
• 2020
• 2019, 2019 (with comments)
• 2018, 2018 (with comments)