Unlike higher-beings such as Mantis Shrimps, humans perceive the world in 3D dimensions. Being able to represent and reason about the 3D surroundings has a profound meaning for creating algorithms to understand and model the world surrounding us. In particular, the possibility to reconstruct the 3D space in high fidelity allows us to create a realistic model of the world, thus exploring the fine-grained dynamics as humans navigate and interact with the environment. In this talk, I will focus on how we can create highly realistic 3D content using techniques from both computer vision and the computer graphics community.