Manufacturing

Development and implementation of a data governance framework for an MS Purview-based data platform including a data marketplace

Starting point

  • Missing data governance policies in a data platform slow down the development of new use cases
  • Unclear responsibilities in data management and opaque regulatory requirements
  • No unified authorization concept to control data access
  • Lack of process standards for integrating new data sources into the data platform
  • Silo formation in the specialist departments and use cases

Approach

  • Process modeling along the data lifecycle
  • Development and implementation of a data classification policy and standardized metadata schemas
  • Introduction and training of Data Stewards to take responsibility for data in their respective departments
  • Development of a user concept for a Data Marketplace for company-wide data discovery and access control
  • Training of platform engineers and data stewards

Features/Project outcome

  • Development of process standards for data management and platform administration
  • Introduction of a Data Governance policy for traceability, transparency, data quality, and security
  • Data Stewards and Platform Engineers have been trained on the new policy
  • Integration of Databricks Unity Catalog and Microsoft Purview ensures seamless data management, monitoring of metadata quality, and data discoverability

Customer benefits

  • Enabling many new use cases through data sharing
  • Systematic improvement of data and metadata quality in the Data Lakehouse
  • Data Marketplace accelerates and simplifies the evaluation of new use cases
  • Highest security and quality standards through data classification
  • Data platform meets GDPR requirements
Lars Ritter | Senior Manager