Image-Aligned Dynamic Liver Reconstruction Using Intra-Operative Field of Views for Minimal Invasive Surgery.

During hepatic minimal invasive surgery (MIS), 3D reconstruction of a liver surface by interpreting the geometry of its soft-tissues is achieving attractions. One of the major issues to be addressed in MIS is liver deformation. Moreover, it severely inhibits free sight and dexterity of tissue manipulation which causes its intra-operative morphology and soft tissue motion altered as compared to its pre-operative shape. While many applications focus on 3D reconstruction of rigid or semi-rigid scenes, the techniques applied in hepatic MIS must be able to cope with a dynamic and deformable environment. We propose an efficient technique for liver surface reconstruction based on structure from motion to handle liver deformation. The reconstructed liver will assist surgeons to visualize liver surface more efficiently with better depth perception. We use the intra-operative field of views to generate 3D template mesh from a dense keypoints cloud. We estimate liver deformation by finding best correspondence between 3D template and reconstruct liver image to calculate translation and rotational motions. Our technique then finely tunes deformed surface by adding smoothness using shading cues. Up till now, this technique is not used for solving human liver deformation problem. Our approach is tested and validated with synthetic as well as real in-vivo data, which reveal that the reconstruction accuracy can be enhanced using our approach even in challenging laparoscopic environments.