METADATA ACCESS FOR DISTRIBUTED DATA LAKE USERS

Fecha de publicación: 30/12/2021
Fuente: WIPO "hive"
Aspects of the disclosure relate to providing metadata access to distributed data lake users. In some embodiments, a computing platform may load metadata from an external metadata database into a staging database. Then, the computing platform may transform the metadata in the staging database and move the transformed metadata to a master database. The master database may comprise information indicating a relationship between the transformed metadata and one or more distributed data lakes. The computing platform may receive a request to access one or more metadata items. Then, the computing platform may authorize a distributed computing cluster user to access at least one metadata item based on the information. Based on the authorization, the computing platform may provide, to the distributed computing cluster user, access to the at least one metadata item of the one or more metadata items.