USING SLAM 3D INFORMATION TO OPTIMIZE TRAINING AND USE OF DEEP NEURAL NETWORKS FOR RECOGNITION AND TRACKING OF 3D OBJECT

Fecha de publicación: 05/01/2023
Fuente: Wipo Milk or dairy products
A system for tracking of an inventory of products on one or more shelves includes a mobile device. The mobile device has an image sensor, at least one processor, and a non-transitory computer-readable medium having instructions that, when executed by the processor, causes the processor to: apply a simultaneous localization and mapping in three dimensions program, on images of a shelf input from the image sensor, to thereby generate a plurality of bounding boxes, each bounding box representing a three-dimensional location and boundaries of a product from the inventory; capture a plurality of two-dimensional images of the shelf; assign an identification to each product displayed in the plurality of two- dimensional images using a deep neural network; associate each identified product in a respective two-dimensional image with a corresponding bounding box, and associate each bounding box with a textual identifier signifying the identified product.