2D to 3D

Reconstructing a 3d model from 2d images would be awesome. For one on our club projects at Envisage, we decided to give it a shot. This post is about different stuffs which was tried.

Computer Vison way,Enter OpenMvg and OpenMvs

OpenMVG,OpenMVS are libraries for solving for multi view geometry/reconstruction problems among other things.You can find my implementation here.It’s undocumented for the time being,sorry!.From 3 imaged it was able to reconstruct this

mvs result

Can’t Solve It, let’s try learning from data!!

I found this paper very interesting and started implementing it to suit our needs. Due to hardware limitation never managed to finish training, and after the club event, the project went stale. The intermediary outputs seems promising though :D. The code can be found here

  • Training step 50 :

training_step_50

  • step 3000 :

training_step_3000

DeepLearning,2d,3d,reconstruction,computerVision