Fecha de publicación:
22/05/2018
Fuente: Wipo "BigData"
The embodiment of the invention relates to the technical field of big data and provides a data processing method and device. According to the method, first, a first fingerprint set corresponding to asource database and a second fingerprint set corresponding to a target database are established, wherein the first fingerprint set comprises a source data fingerprint of each piece of source data in the source database, the second fingerprint set comprises a target data fingerprint of each piece of target data in the target database, meanwhile, each source data fingerprint comprises a source datahash value, and each target data fingerprint comprises a target data hash value; and then an update fingerprint set corresponding to to-be-updated data is acquired, wherein the update fingerprint setcomprises the source data fingerprints, different from the target data fingerprints, in the first fingerprint set and the target data fingerprints, different from the source data fingerprints, in thesecond fingerprint set. Compared with the prior art, through the embodiment, data incremental extraction under a big data scene can be realized under the condition of not changing the source database.