Fuente: WIPO "tomato" A method for operating a semantic robotic system in communication with a plurality of devices, the semantic robotic system having at least one processor and at least one transceiver includes storing in the memory an intrinsic semantic associated with an object type, the intrinsic semantic further indicating a purpose of the object type. The method further causes the at least one processor to detect a first object of a first object type based on one or more first data inputs, infer a first semantic in rapport with the first object of the first object type based on one or more second data inputs, generate semantic augmentation data based on a determination that the first inferred semantic is non-affirmative by having a high entropy with respect to the intrinsic semantic, and cause the at least one transceiver to transmit the semantic augmentation data to a remote device.