Unified log management system applied to big data platform

Fecha de publicación: 14/06/2024
Fuente: Wipo "BigData"
The invention provides a unified log management system applied to a big data platform, and relates to the technical field of data management, and the system comprises a log collection module which is used for collecting log data of each service node of the big data platform in a plug-in manner, converting the log data into a preset standard log format, and then carrying out centralized storage; the front-end visualization tool is used for sending a full-text retrieval instruction or an audit query instruction input by a user to the background management module; and the background management module calls a full-text retrieval service according to the full-text retrieval instruction or calls an audit query service according to the audit query instruction so as to send the obtained full-text retrieval result or audit query result to the front-end visualization tool for display. The method has the beneficial effects that the log data of each service node is centrally stored in the preset standard log format, and a front-end visual tool is provided, so that the consulting efficiency of the log data is effectively improved; the auditing query service is provided, and the appeal for auditing query of operation behaviors can be met.