Data quality evaluation method and system based on big data analysis

Fecha de publicación: 21/07/2023
Fuente: Wipo "BigData"
The invention provides a data quality evaluation method and system based on big data analysis, and relates to the technical field of data analysis, and the method comprises the steps: firstly, obtaining a plurality of forms from a plurality of systems; thirdly, establishing a data quality analysis model, inputting the forms into the data quality analysis model to obtain an integrity index, an accessibility index, a timeliness index and a normativity index respectively, multiplying the indexes by corresponding initial weights respectively, and performing accumulation to obtain an initial data quality score; then, according to an externally input weight adjustment instruction, adjusting each initial weight, calculating to obtain a data quality score, and adding the number of adjustment times to obtain an adjustment counting result; and finally, adjusting the corresponding weight for multiple times until the adjusted counting result is greater than a preset counting threshold value, and outputting the data quality score obtained after weight adjustment as the data quality score. The method has the beneficial effects that the data quality analysis model is established, and the standard of data quality evaluation is simplified and clarified, so that the data quality score more truly reflects the data quality condition.