10 lines (8 loc) · 504 Bytes

struct2depth2unity

Research project exploring using struct2depth tensorflow library to generate depth mapping for usage in Unity.

Workflow for single frame

Run model on desired dataset -> output of rgbd image and numpy array (x,y,d) pixel to depth mapping
Generate point cloud, translate pixel depth mapping to real depth mapping (x,y,z) data (requires camera intrinsics)
Create mesh using MeshLab
Import into Unity

Next steps: visual odometry, combining data from multiple frames