Awesome AR/VR

This repo contains the Systems and Networking related AR/VR research papers and tools.

Tracking and Localization

• Event-based, Direct Camera Tracking from a Photometric 3D Map using Nonlinear Optimization [ICRA'19]
• MilliSonic: Pushing the Limits of Acoustic Motion Tracking [CHI'19]
• Position Tracking for Virtual Reality Using Commodity WiFi [CVPR'17]
• Strata: Fine-Grained Acoustic-based Device-Free Tracking [MobiSys'17]
• CAT: High-Precision Acoustic Motion Tracking [MobiCom'16]
• Accurate positioning via cross-modality training [SenSys'15]
• LOAM: Lidar Odometry and Mapping in Real-time [RSS'14]

Rendering AR/VR Applications on Mobile Devices

• Edge Assisted Real-time Object Detection for Mobile Augmented Reality [MobiCom'19]
• Cutting the Cord: Designing a High-quality Untethered VR System with Low Latency Remote Rendering [MobiSys'18]
• FlashBack: Immersive Virtual Reality on Mobile Devices via Rendering Memoization [MobiSys'16]

Streaming AR/VR Content

• Firefly: Untethered Multi-user VR for Commodity Mobile Devices [ATC'20]
• Enabling High-Quality Untethered Virtual Reality [NSDI'17]

Tools/SDKs for AR/VR

• ARCore: Google's AR developement SDK
• ARKit: Apple's AR development SDK
• ORBSLAM3: SLAM Library
• Intel Realsense: Intel's tracking and localization library for its cameras.
• Kalibr: A tool to calibrate multiple cameras, camera+IMU, multiple IMUs, and IMU intrinsic calibration.
• IMU_UTILS: A tool to get IMU Noise and Bias walk parameters. Some useful blogposts with better documentation: 1, 2, 3.