Best Paper Award PSI at Advanced Concepts for Intelligent Vision Systems (ACIVS) Conference

Automatic occlusion removal from facades for 3D urban reconstruction, C. Engels, D. Tingdahl, M. Vercruysse, T. Tuytelaars, H. Sahli, and L.
Van Gool, in Proceedings of Advanced Concepts for Intelligent Vision Systems (ACIVS), 2011.

Object removal and inpainting approaches typically require a user to manually create a mask around occluding objects. While cre-
ating masks for a small number of images is possible, it rapidly becomes untenable for longer image sequences. Instead, we accomplish this step
automatically using an object detection framework to explicitly recognize and remove several classes of occlusions. We propose using this tech-
nique to improve 3D urban reconstruction from street level imagery, in which building facades are frequently occluded by vegetation or vehicles.
By assuming facades in the background are planar, 3D scene estimation provides important context to the inpainting process by restricting input
sample patches to regions that are coplanar to the occlusion, leading to more realistic nal textures. Moreover, because non-static and reflective
occlusion classes tend to be dfficult to reconstruct, explicitly recognizing and removing them improves the resulting 3D scene.

http://homes.esat.kuleuven.be/~cengels/files/engels_acivs_2011.pdf