Academics
  /  
Courses
  /  
Descriptions
COMP_SCI 396: Advanced Graphics Seminar: VR/AR Systems


VIEW ALL COURSE TIMES AND SESSIONS

Prerequisites

Instructor consent. Please fill the following form to apply the course permission: https://forms.gle/rQuj3QBdADPJhSM6A

Description

Even though there is no prerequisite for this course, completion of one or more courses in the following categories would be helpful:

Graphics & Vision

  • CS 351-1 Introduction to Computer Graphics
  • CS 351-2 Intermediate Computer Graphics
  • CS 331 Introduction to Computational Photography
  • EE 332 Introduction to Computer Vision

Embedded System

  • CE 346 Microprocessor System Design
  • EE 326 Electronic System Design I
  • EE 327 Electronic System Design II

Virtual Reality (VR) and Augmented Reality (AR) are promising technologies that could provide a seamless integration between the physical and virtual world for humans. They offer immersive ways of experiencing and interacting with digital content, enabling users to enter and interact with simulated environments or enhance the real world with digital overlays. Even though the ways of interacting with VR/AR systems are intuitive and natural, understanding the principles behind 3D display and building out high-quality VR/AR devices is never an easy task and it is still under active research.

The best way to understand a system is to build one. The goal of this course is teaching students how to build a VR hardware system from scratch in 10 weeks. Topics covered in this course mainly include VR hardware prototyping and WebGL programming. By forming a group of 2-3 students, each group will be expected to own their self-built VR hardware system displaying their self-designed 3D virtual scene/game by the end of the quarter.

Course Syllabus
Actual syllabus might change depending on the enrollment profile. The planned syllabus is listed below. For detailed and updated syllabus, please refer to course website: https://jipengsun.github.io/2023_NU_Summer_VR/

Week 1: Introduction to VR/AR Systems
Week 2: Design Minimum Viable Product (MVP) of VR Systems
Week 3: Graphics Rendering Pipeline on Embedded System
Week 4: Understanding Human Binocular Vision System
Week 5: Near-Eye Display Optics
Week 6: Orientation/Position Tracking Hardware
Week 7: Correct Vergence Accommodation Conflicts
Week 8: Controller Pose Estimation for Interaction
Week 9: Additional VR Features: Audio, Eye Tracking, and Rendering Engines
Week 10: State of Art VR/AR Research (Guest Lectures) and Demo Day

REFERENCE TEXTBOOKS: None
REQUIRED TEXTBOOK: None

COURSE COORDINATORS: Prof. Jack Tumblin

COURSE INSTRUCTOR : Jipeng Sun