Fuente:
Wipo "BigData"
The invention provides a big data information management system, and relates to the field of big data information management, and the system comprises the following modules: a data collection module which collects data from a plurality of sources in real time and in batches by using data capture, web crawler and API interface technologies; the data storage module is used for storing mass data by adopting a distributed storage system and ensuring high availability and expandability of the data; the data processing module is used for processing and analyzing big data by utilizing a distributed computing framework and improving the processing efficiency through parallel computing; a sorting algorithm is used for data sorting. Through distributed storage and calculation, efficient data processing, advanced visualization, comprehensive data security, system operation and maintenance improvement and flexible data collection, efficient storage and management of mass data are realized, the data processing and analysis capability is improved, the data readability and security are enhanced, the system stability and reliability are ensured, and the application prospect is wide. And meanwhile, the flexibility and efficiency of data collection and integration are improved.