Hi Matt,
Thanks for writing these posts. Very informative and interesting. I wish the folks at Apple could speak up more about what they have built but oh well…
Dense 3D reconstruction seems like a vital component of this to me as things like occlusion and shadow casting are necessary for a true sense of presence. As per LiDAR, I assume you have seen this (http://spectrum.ieee.org/tech-talk/semiconductors/optoelectronics/mit-lidar-on-a-chip). Obviously this isn’t ready yet but presumably coming in the near-ish future. Is this what you were referring to in regards to power consumption? I think we might eventually get single camera based systems that can do decent 3D reconstruction but you have to be extremely accurate to do occlusion realistically.
Thanks!
