03- Unity Catalog Creating metastore in Azure Unity Catalog
Creating a Unity Catalog Meta Store
Introduction to Unity Catalog
- The video introduces the process of creating a Unity catalog meta store, referencing previous videos for foundational knowledge on Unity catalog and prerequisites.
Accessing Azure Portal
- Users are instructed to log into the Azure portal where resources like Databricks workspace, ADL storage, and access connector for Azure Databricks have been created within a resource group.
Navigating the Unity Catalog Interface
- Upon logging in, users will see the Unity catalog account page with options such as workspace menu and data tab. The workspace menu lists available workspaces in the tenant.
- The data tab shows any existing metastore; since this is a new environment, no metastore has been created yet.
User Management Features
- User management allows onboarding of users from Azure Active Directory (AAD), including service principals and groups. Settings enable user provisioning through AAD integration.
Creating a Meta Store
- A meta store is defined as a repository for databases, tables, schemas, etc., utilizing ADLS storage in the backend.
- To create a meta store, users must provide a name and select an appropriate location that matches other resources.
Configuring Storage Account Details
- Users need to specify their container name within the ADLS Gen 2 path and obtain necessary details from the Azure portal settings endpoint.
Access Connector ID Requirement
- An access connector ID is required during setup; it should have "Storage Blob Contributor" permissions on the specified storage account to avoid permission issues.
Assigning Workspaces to Meta Store
- Users can assign their newly created meta store to one or more workspaces during creation or later.
Validating Meta Store Integration
- After creating the meta store, validation can be done by launching the associated workspace where users can confirm that their meta store is attached.
Exploring Data Menu Options
- In the data menu of Unity catalog, users can view details about their attached meta store including its path and associated workspaces.