Hi,

The course “Virtual and Augmented Reality” (VR/AR) is envisioned as an interdisciplinary learning experience to provide students with both an understanding of the fundamentals of VR/AR and to gain practical experience.  

 

The overall question driving this course is how to create a satisfying, immersive, and interactive experience. This course teaches students about one of the most important aspects of VR/AR, how to design an immersive world, specifically how to build a VR/AR User Experience, and the necessary skills to implement realistic, interactive, and immersive VR/AR applications.

 

This course has been designed for those with no or little previous experience in VR/AR, interested in how to bring their ideas to this new platform. The course calls everyone to create, learn, and explore.

 

Lectures Content

• Introduction to VR/AR: Concepts and History

  • Overview of what VR and AR are, including definitions and historical milestones

  • Discussion of seminal works (e.g., Sutherland’s head-mounted display, early AR prototypes)

  • Contextualization of VR/AR in today’s technological landscape

• Creation, Representation, and Modeling of Virtual Worlds

  • 3D modeling techniques (manual, procedural, and scanning).

  • Introduction to scene graphs and hierarchical organization of virtual scenes.

  • Techniques for model optimization (e.g., polygon reduction, level-of-detail strategies).

  • Discuss file formats and integration into runtime environments.

• Technical Aspects of VR/AR Systems

  • Input devices: tracking methods (optical, inertial, marker-based, etc.) and sensors

  • Output devices: displays (HMDs, multi-screen setups), haptic devices, and audio systems

  • XR System Architecture: Discussion of how these components are integrated into a functioning system

• Perceptual Aspects of VR

  • Fundamentals of human information processing and sensory systems

  • Overview of visual perception, including depth cues, stereo vision

  • Overview of auditory and haptic perception and their roles in immersive experiences

• Interaction Techniques within Virtual Worlds

  • Natural interaction models (gestural, speech, and body movements) versus traditional interfaces

  • Methods for object manipulation, navigation, and user-guided exploration in 3D space

• Focus on Augmented Reality

  • Unique challenges in AR: real-time registration, blending virtual and real content, occlusion handling

  • Comparison between AR and VR in terms of system design and user experience

  • Current applications and future trends in AR

• Case Studies and Practical Applications

  • Examples from diverse domains (e.g., training simulators, architecture, gaming, medical applications)

  • Analysis of how theoretical and technical components are applied in real-world scenarios

  • Discussion on lessons learned and best practices

• Validation of Immersive User Experience: Usability and Cognitive Load

  • Usability Evaluation: Methods and metrics (e.g., task success rates, error frequency, user satisfaction surveys, think-aloud protocols, SSQ, and Presence Questionnaires).

  • Cognitive Load Analysis: measurement approaches like NASA-TLX, and strategies to minimize cognitive effort without sacrificing immersion.

  • Validation Strategies: Case studies, experiments, and iterative refinement approaches based on objective and subjective measures.

​​

Laboratory Hands-On Experience

• Introduction to Unreal Engine

  • Familiarize students with the Unreal Engine interface, basic navigation

  • Start constructing a simple scene within Unreal Engine.

  • Explore asset import, level design, and scene organization.

  • Introduce Blueprint visual scripting to create interactive elements.

• Setting Up a VR Project

  • Familiarize students with the VR hardware setup.

  • Learn how to configure Unreal Engine for VR development.

  • Understand project settings, input configurations, and hardware integration

  • Discuss VR fundamentals and design considerations.

• Blueprints for VR Interactions 

  • Focus on VR interactions like teleportation and object selection.

• Packaging, Deployment & Cross-Platform Considerations

  • Learn how to package a VR application for distribution.

  • Address deployment challenges across different VR hardware.

• Creating VR User Interfaces (UI)

  • Designing and implementing UIs in VR.

  • Understand challenges such as depth, readability, and interaction in 3D space.

• Enhancing Interactions and Physics-Based Objects

  • Integrate physics-based interactions to improve realism.

  • Expand on user interaction beyond simple triggers.

• Advanced VR Interactions and Animation

  • Develop more advanced VR interactions, including multi-object manipulation and animation blending.

  • Enhance user feedback (haptics, visual cues).

• 3D Scanning & 360° VR Capture

  • Introduce techniques for 3D scanning using reality capture tools.

  • Learn to record and integrate 360° video into VR experiences.

• Usability Test

  • We will conduct a usability test in class using the Oculus Quest 2 to evaluate a VR application.

​

Assessment Methods

The course assessments consist of two main components: weekly homework and development assignments.

• Weekly Homework (40% of final grade):

  • Designed to ensure students effectively translate theoretical knowledge from lectures into practical skills. Assignments include quizzes, technological analyses, and usability testing.

• Development Assignments (60% of final grade):

  • Formative Evaluation (Biweekly Assignments): Students will design, develop, and validate a series of four interactive VR projects. Each assignment introduces and reinforces specific interaction patterns, progressively building the skills needed for creating complete immersive experiences. This hands-on, incremental approach allows students to experiment with, refine, and master essential VR/AR development techniques.

  • Summative Evaluation (Term-Long VR Project): A final comprehensive assignment consolidates and integrates all skills acquired through the formative biweekly development assignments. Students will design, develop, and evaluate a fully immersive VR experience, demonstrating clear mastery of all course concepts.

​​

Learning Resources 

The learning resources for this course are diverse and designed to support your exploration of both theoretical and practical aspects of VR/AR. There is no required textbook; instead, we will rely on a combination of lecture and laboratory notes, supplemented by accessible digital assets available through the OSU Valley Library. 

• The VR book: human-centered design for virtual reality, by Jerald, Jason.

• Understanding virtual reality: interface, application, and design, by William R. Sherman and Alan B. Craig.

• Virtual Reality Headsets - A Theoretical and Pragmatic Approach, By Philippe Fuchs

• Virtual Reality TechnologyLinks to an external site., by  Grigore C. Burdea and  Philippe Coiffet 

• Designing Virtual Reality Systems, by Gerard Jounghyun Kim

Here is a suggested book that will help you explore all the features of the Blueprint Editor, along with expert tips, shortcuts, and best practices. 

• Blueprints visual scripting for Unreal Engine 5: unleash the true power of Blueprints to create impressive games and applications in UE5

​​

Related Online Links and Web Resources

• Unreal Engine 5.3 DocumentationLinks to an external site.

• Unreal Online LearningLinks to an external site.

• Steps for installing Unreal EngineLinks to an external site.

• Building with Unreal Engine

  • https://developers.meta.com/horizon/designLinks to an external site.

​​​