Generating shadows for placed objects in depth estimated scenes of two-dimensional images

Fuente: Wipo "digitalization"
Modifying a two-dimensional image 4000 comprises estimating 3-dimensional characteristics 4004 for one or more background objects within the image, determining a request to place an object 4002 in the image, and generating a modified 2D image 4006 comprising shadows updated based on the selected position of the object and the estimated 3D characteristics of the background objects. A mesh of the scene may be estimated based on pixel depth values corresponding to objects in the scene. A plurality of meshes may be used to determine the characteristics. Segmentation maps and shadow maps may be used to determine the characteristics and update the shadows respectively. The request may comprise moving an object in the scene from a first position to a second position. Proxy meshes may be used, the meshes being generated based on determining an axis corresponding to the object represented by the mesh and visible features of the visible portion of the object, and generating a 3D mesh based on the visible portion of the object and a mirrored portion representing the non-visible portion of the object. Updating 2D images based on meshes and relative 3D characteristics between the background and placed objects is also disclosed.