CODEWITHSUNDEEP
c++opencvimage-processing3d-reconstruction
navy_marble
navy_marble

Reputation: 41

3D model reconstruction from a set of 2D image slices using OpenCV?

I have several questions on 3D reconstruction with a set of 2D image slices using OpenCV:

Take note that the camera is not needed because I am given a set of images and I am only limited to OpenCV.

Thank in advance!

Upvotes: 3

Views: 10683

Answers (1)

Dave Durbin
Dave Durbin

Reputation: 3632

One of the most authoritative books on this is Zisserman.

The (very) high level steps are:

  1. For each image, identify a set of features (e.g. SIFT, ORB, SURF or similar)
  2. For a pair of images, find correspondences between the features located in 1
  3. Using these correspondences, calculate the Fundamental matrix F which described the relationship between the two images
  4. From F (and ideally some internal camera parameters) , calculate the relative camera pose in the second image with respect to the first
  5. Using F, rectify image pairs such that corresponding points lie on the same scan lines
  6. Calculate a dense disparity map using the two images and then convert this to a depth map for each pixel in an image
  7. Given the camera pose, and depth of each pixel, back project points 3D point in space
  8. Use some technique such as bundle adjustment to optimise the derived values of 3D coordinates and camera poses across the entire set of calculated points and images

The OpenCV calib3d library contains many useful functions for this process and Google is your friend for more details on how to apply them.

Also see: OpenCV with stereo 3D reconstruction, OpenCV 3D reconstruction using shipped images and examples

Upvotes: 5

Related Questions