IMPLEMENTATION OF AN ADVANCED IMAGE FORMATION PROCESS AS A NETWORK LAYER AND ITS APPLICATIONS

Fuente: Wipo "digitalization"
A system for generating modified digital images from input digital images, using a neural network with a rendering layer trained to generate synthesized digital images from input digital images portraying diffuse materials and input digital images portraying specular materials. The neural network predicts at least two of a material property set, a surface orientation map, or an illumination environment map based on the input digital image and replace at least one of the material property set, the surface orientation map, or the illumination environment map with a target material property set, a target surface orientation map, or a target illumination map.
The rendering layer of the neural network then generates a modified digital image from the input image based on at least one of the target material property set, the target surface orientation map, or the target illumination map.