29E719: Mixed Reality Systems

Mixed reality (MR) system supports our daily activities by seamlessly merging physical and cyber spaces. For instance, a camera-equipped phone is widely used as a platform of an MR system which provides a user with various location-aware information such as navigation by overlaying it on the captured image of a street displayed on the phone. This types of MR systems are realized based on computer vision and graphics technologies. Those who take this class will learn these basic technologies as well as state-of-the-art techniques which realize better user experiences. They will also learn MR technique in terms of tactile and auditory modalities.

Through the series of lectures, you will be able to:

• Define MR by explaining the difference of MR from VR
• Explain how geometric consistency is achieved
• Explain how radiometric consistency is achieved
• Explain how real-time constraint is achieved
• Explain how geometric and radiometric corrections are achieved in projection-based MR
• Know new MR research directions (diminished reality/non-visual MR/cross-modal MR/light field MR)
• Plan own MR system
• Criticize MR systems in terms of novelty and the validity of chosen techniques

For the details of the class, please refer to CLE.