Streamlining your Azure Master Data Management can be a daunting task, especially with the vast amounts of data involved. By implementing our solution, you can expect a significant reduction in data duplication and inconsistencies.
Our solution leverages the power of Azure's robust data management capabilities to ensure that your master data is accurate, complete, and up-to-date. This includes utilizing Azure's data quality features to identify and correct errors, as well as its data governance capabilities to establish and enforce data standards.
With our solution, you can say goodbye to manual data entry and hello to automated data processing, freeing up your team to focus on more strategic initiatives. By streamlining your Azure Master Data Management, you can improve data quality, reduce costs, and enhance overall business efficiency.
Creating and Managing Azure Purview
Creating Azure Purview requires both project and instance details, which can be accessed via the Azure Portal. This is because Azure Purview is now publicly available for preview.
To create Azure Purview, you'll need to select a platform size, which must be at least four units to keep Purview Data Map up to date and running. You'll also need to add Purview as a resource provider at the subscription level, which requires full AD permissions or the ability to view and search AD.
Once you've added Purview as a resource provider, you can create a new instance and configure additional settings.
Create Purview
To create Azure Purview, you can access it via the Azure Portal, which is now publicly available for preview.
First, you'll need to provide both project and instance details, just like any other Azure resource.
Platform size is also a crucial configuration option, requiring a minimum of four capacity units to keep Purview Data Map up to date and running.
You may encounter errors when trying to create an Azure Purview instance, as Purview needs to be added as a provider at the subscription level.
To add Purview as a resource provider, you'll need full AD permissions or the ability to view and search AD.
Once added, you can see that Purview has successfully validated and is ready to be created.
As you progress, you'll need to add and register data sources with your Purview account, starting by creating a collection and then registering a source.
You can register a source by searching from and selecting from the list of registered sources, such as Azure Blob Storage or Azure SQL Database.
Create a Scan
To create a scan in Azure Purview, you can start by clicking the scan icon within the catalog. This will allow you to set up a new scan for various data sources.
A scan rule set is a container for grouping a set of scan rules together, making it easy to associate them with a scan. You can create a new scan rule set or utilize a default rule set that includes all supported system classification rules.
The default rule set can include a sample list of classification system rules available in Azure Purview. Alternatively, you can create a customized scan rule set to specify the rules that should be applied.
To set up a scan, you'll need to populate the required credential details. You can also customize the scope of the scan by selecting or de-selecting objects within the source.
Once you've configured your scan rule set, you can set a manual or recurring trigger, including an option to set the recurring end date. This will determine when the scan will be run.
Profisee for Microsoft Enterprise
Profisee is a Microsoft Gold ISV Partner, meaning it's natively built on the Microsoft platform and compatible with tools like Microsoft Dynamics, Power BI, and SharePoint.
Profisee Master Data Management (MDM) is the preferred MDM solution by field reps and solution architects due to its ease of use, fast time-to-value deployment, and cost-effectiveness.
Profisee is the only data management solution that is natively built on the Microsoft platform, making it a seamless fit for Azure investments.
Profisee MDM can help your organisation fully realise the value of your Azure investments by making high quality, trusted data available as you need it.
The Enterprise Channel Manager of Financial Services at Microsoft calls Profisee their go-to partner for MDM, highlighting its strengths in this area.
Profisee Master Data Management (MDM) can help take away the anxiety associated with implementation and cost, making it an obvious choice for Microsoft enterprises.
QMetrix, a certified Microsoft and Profisee partner, is a Field Certified Partner –Gold status with Profisee, further solidifying its credibility in the industry.
Access and Governance
To manage credentials and access in Azure Purview, you need to create and manage credentials for scans, which involves using key vault to store passwords and secrets as a minimum requirement.
Purview will display a message on how to grant Purview access to Key Vault, and you'll need to provide GET access permissions to Purview from Azure Key Vault.
Once the connections are created and verified in Purview, they'll appear in the 'Manage Key Vault Connections' section.
You can then configure the key vault connection within the credential authentication UIs when adding new data sources and connections, for example, to extract the account key for an ADLS2 account.
Azure Purview also offers immediate data governance, allowing you to input data policies directly into the platform and enforce them instantly.
Exploring and Browsing Azure Purview
Once you've registered your assets in Azure Purview, you can access them from the home page by searching for them in the search box.
The registered list of assets will be available at a granular level, allowing you to explore and edit their details, including data lineage.
You can also access assets from the 'Browse Assets' icon on the home page, making it easy to navigate and find the information you need.
The classification section auto-captures fields that adhere to defined sensitivity and privacy rule sets, providing an added layer of security and control.
Explore the Glossary
In Azure Purview, you can explore the glossary to define and manage glossary terms easily.
The business glossary is a powerful tool that lets you create and manage glossary terms with ease.
You can add additional data, contacts, and related items to enrich the terms and link them to assets to further enhance the metadata.
Within the schema section, you can change column names and data types of the tables, but this should be used sparingly and well governed from an access perspective.
Every field in the sample Customer table can be linked to a glossary term, allowing you to capture descriptions at the column level and alter column level classifications as needed.
Browse Assets
In Azure Purview, you can browse assets from the home page by searching for them in the search box. This allows you to access all your registered assets in one place.
The 'Browse Assets' icon on the home page is another way to access your assets. From here, you can explore and manage your assets with ease.
You can view the registered list of assets at a granular level, which is incredibly useful for managing large datasets. This level of detail allows you to see all the assets and their associated metadata.
The details section provides a wealth of information about each asset, including data lineage. This means you can track the origin and movement of your data, which is essential for data governance.
You can also edit and enrich the details of each asset in this section, making it easy to update and refine your asset metadata. This is particularly useful for ensuring that your assets are properly classified and meet sensitivity and privacy requirements.
Classification is automatically captured in the classification section, which adheres to defined sensitivity and privacy rule sets. This ensures that your assets are properly protected and compliant with relevant regulations.
Using AI and Automation
With the integration of Azure OpenAI with CluedIn, data management tasks can be done in minutes, not days or weeks. This is a game-changer for organizations looking to realize their data-driven ambitions on Microsoft Azure.
You can onboard, clean, and standardize data in a matter of minutes, no code required, thanks to the CluedIn AI Copilot. This means that anyone with a basic level of computer literacy can perform data management tasks without needing to rely on IT.
The CluedIn AI Copilot can automate data governance, fuel intelligent decision-making, automate data integration, and easily enhance data quality. This is a significant reduction in manual work, allowing organizations to save time, money, and resources.
Here are some of the benefits of using AI and automation in Azure Master Data Management:
- Automate data governance
- Fuel intelligent decision-making
- Automate data integration
- Easily enhance data quality
With the CluedIn AI Assistant, you can build Golden Record rules instantly, in just 90 seconds, after a natural language prompt. This means that you can quickly and easily create rules to manage your data, without needing to spend hours or days doing it manually.
Data leaders who have used CluedIn and Azure OpenAI report that they can now do tasks that would have taken them hours or days in just one minute. This is a huge time-saver and can help organizations to realize their data-driven ambitions more quickly.
Frequently Asked Questions
What is master data management in Azure?
Master data management in Azure is a solution that integrates and standardizes data from various sources, ensuring high-quality and trusted data for business intelligence and analytics. This integration enables seamless data alignment and enforcement of consistent data standards across the organization.
Is Microsoft Azure an MDM?
No, Microsoft Azure is not an MDM (Master Data Management) solution itself, but it can be used as a platform for MDM with solutions like Semarchy's Azure master data management.
What is Azure data management?
Azure Data Management helps clients organize and access data from various sources with the assistance of a dedicated global team. It provides customized solutions for optimizing data access and insights.
What does master data management do?
Master data management automates data integration, cleansing, and governance for business-critical entities, enhancing data quality and operational efficiency. It enables better decision-making by providing accurate and consistent data across the organization.
Sources
- https://www.mssqltips.com/sqlservertip/6881/getting-started-with-azure-purview-for-data-governance/
- https://www.cluedin.com/azureopenai
- https://quisitive.com/why-do-we-need-microsoft-purview-for-data-governance/
- https://www.semarchy.com/azure-master-data-management-solution/
- https://qmetrix.com.sg/technology/microsoft/
Featured Images: pexels.com