Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Private preview
This feature is in preview and available to select accounts. Reach out to your Immuta representative for details.
Domains are containers of data sources that allow you to assign data ownership and access management to specific business units, subject matter experts, or teams at the nexus of cross-functional groups. Instead of centralizing your data governance and giving users too much governance over all your data, you control how much power they have over data sources by granting them permission within domains in Immuta.
Domains must be enabled in your account. Reach out to your Immuta representative for guidance.
Required Immuta permission: GOVERNANCE
Navigate to the Domains page.
Click Create Domain.
Enter a Name and Description for your domain.
Click Save.
To create a domain using the API, see the Domains API guide.
Required Immuta permission: USER_ADMIN
Click Domains and navigate to the domain.
Click the Permissions tab.
Click + Grant Permissions.
Select a user and assign the Manage Policies permission to allow them to create policies that will apply to the data sources within the domain.
Click Grant Permissions to save your changes.
To assign permissions using the API, see the Domains API guide.
Required Immuta permission: GOVERNANCE
or Manage Policies
Click Policies and select Data Policies or Subscription Policies.
Write your subscription policy or data policy as outlined in the policies how-to guide.
When building your policy, add your domain in the What domain of data should this policy be targeting section. This step will assign the policy to all data sources added to that domain.
Required Immuta permission: GOVERNANCE
Navigate to the Domains page and select your domain.
Click the Data Sources tab, and then click +Add data sources.
Select the checkboxes for the data sources you want to add to your domain.
Click Add to domain.
To assign data sources using the API, see the Domains API guide.
Required Immuta permission: GOVERNANCE
Navigate to the Domains page and select your domain.
Click Remove Domain.
Confirm your changes.
To delete a domain using the API, see the Domains API guide.
Private preview
This feature is only available to select accounts. Reach out to your Immuta representative to enable this feature.
Snowflake Enterprise Edition
Snowflake X-Large or Large warehouse is strongly recommended
Set the default subscription policy to None for bulk data source creation. This will simplify the data source creation process by not automatically applying policies.
Make a request to the Immuta V2 API create data source endpoint, as the Immuta UI does not support creating more than 1000 data sources. The following options must be specified in your request to ensure the maximum performance benefits of bulk data source creation. The Skip Stats Job
tag is only required if you are using specific policies that require stats; otherwise, Snowflake data sources automatically skip the stats job.
Specifying disableSensitiveDataDiscovery
as true
ensures that sensitive data discovery will not be applied when the new data sources are created in Immuta, regardless of how it is configured for the Immuta tenant. Disabling sensitive data discovery improves performance during data source creation.
Applying the Skip Stats Job
tag using the tableTag
value will ensure that some jobs that are not vital to data source creation are skipped, specifically the fingerprint and high cardinality check jobs.
When the Snowflake bulk data source creation feature is configured, the create data source endpoint operates asynchronously and responds immediately with a bulkId
that can be used for monitoring progress.
To monitor the progress of the background jobs for the bulk data source creation, make the following request using the bulkId
from the response of the previous step:
The response will contain a list of job states and the number of jobs currently in each state. If errors were encountered during processing, a list of errors will be included in the response:
With these recommended configurations, bulk creating 100,000 Snowflake data sources will take between six and seven hours for all associated jobs to complete.
Requirement: Must be an owner of the schema project
Navigate to the Project Overview tab.
Click Edit Connection.
Use the Connection Information modal to make any necessary changes.
Click Save.
Requirement: Must be an owner of the schema project
Navigate to the Project Overview tab.
Click Edit Schema Monitoring.
Use the Basic Information modal to make any necessary changes to naming formats.
Click Save.
Requirement: Must be an owner of the schema project
Navigate to the Project Overview tab.
Click Edit Schema Monitoring.
Use the dropdown menu in the Schema Monitoring modal to select a new schema detection owner. The new owner must be an owner of one or more of the data sources belonging to that schema.
Click Save.
Requirement: Immuta permission USER_ADMIN
Navigate to the App Settings page and scroll down to the Advanced Configuration.
Copy and paste this YAML into the text box:
Replace your-new-frequency
with the time you would like between schema jobs. For example use */30 * * * *
for the queries to run every 30 minutes.
Click Save.
Requirement: Immuta permission USER_ADMIN
Navigate to the App Settings page and scroll down to the Advanced Configuration.
Copy and paste this YAML into the text box:
Replace your-new-frequency
with the time you would like between column detection jobs. For example use */30 * * * *
for the queries to run every 30 minutes.
Click Save.
Private preview
Google BigQuery is available to select accounts. Reach out to your Immuta representative for details.
CREATE_DATA_SOURCE
Immuta permission
Google BigQuery roles:
roles/bigquery.metadataViewer
on the source table (if managed at that level) or dataset
roles/bigquery.dataViewer
(or higher) on the source table (if managed at that level) or dataset
roles/bigquery.jobUser
on the project
Google BigQuery data sources in Immuta must be created using a Google Cloud service account rather than a Google Cloud user account. If you do not currently have a service account for the Google Cloud project separate from the Google Cloud service account you created when configuring the Google BigQuery integration, you must create a Google Cloud service account with privileges to view and run queries against the tables you are protecting.
You have two options to create the required Google Cloud service account:
Using the Google Cloud documentation, create a service account with the following roles:
BigQuery User
BigQuery Data Viewer
Using the Google Cloud documentation, generate a service account key for the account you just created.
Copy the script below and update the SERVICE_ACCOUNT, PROJECT_ID, and IMMUTA_GCP_KEY_FILE
values.
SERVICE_ACCOUNT is the name for the new service account.
PROJECT_ID is the project ID for the Google Cloud Project that is integrated with Immuta.
IMMUTA_GCP_KEY_FILE
is the path to a new output file for the private key.
Use the script below in the gcloud
command line. This script is a template; change values as necessary:
Required Google BigQuery roles
Ensure that the user creating the data source has these Google BigQuery roles:
roles/bigquery.metadataViewer
on the source table (if managed at that level) or dataset
roles/bigquery.dataViewer
(or higher) on the source table (if managed at that level) or dataset
roles/bigquery.jobUser
on the project
Click the + button in the top-left corner of the screen and select New Data Source.
Select the Google BigQuery tile in the Data Platform section.
Complete these fields in the Connection Information box:
Account Email Address: Enter the email address of a user with access to the dataset and tables. This is the account created in the Google BigQuery configuration guide.
Project: Enter the name of the project that has been integrated with Immuta.
Dataset: Enter the name of the dataset with the tables you want Immuta to ingest.
Upload a BigQuery Key File in the modal. Note that the account in the key file must match the account email address entered in the previous step.
Click the Test Connection button. If the connection is successful, a check mark and successful connection notification will appear and you will be able to proceed. If an error occurs when attempting to connect, the error will be displayed in the UI. In order to proceed to the next step of data source creation, you must be able to connect to this data source using the connection information that you just entered.
Decide how to virtually populate the data source by selecting one of the options:
Create sources for all tables in this database: This option will create data sources and keep them in sync for every table in the dataset. New tables will be automatically detected and new Immuta views will be created.
Schema / Table: This option will allow you to specify tables or datasets that you want Immuta to register.
Provide basic information about your data source to make it discoverable to users.
Enter the SQL Schema Name Format to be the SQL name that the data source exists under in Immuta. For BigQuery the schema will be the BigQuery dataset. The format must include a schema macro but you may personalize it using lowercase letters, numbers, and underscores to personalize the format. It can have up to 255 characters.
Enter the Schema Project Name Format to be the name of the schema project in the Immuta UI. This is an Immuta project that will hold all of the metadata for the tables in a single dataset.
When selecting Create sources for all tables in this database and monitor for changes, you may personalize this field as you wish, but it must include a schema macro to represent the dataset name.
When selecting Schema/Table, this field is pre-populated with the recommended project name and you can edit freely.
Select the Data Source Name Format, which will be the format of the name of the data source in the Immuta UI.
<Tablename>
: The Immuta data source will have the same name as the original table.
<Schema><Tablename>
: The Immuta data source will have both the dataset and original table name.
Custom: This is a template you create to make the data source name. You may personalize this field as you wish, but it must include a tablename macro. The case of the macro will apply to the data source name (i.e., <Tablename>
will result in "Data Source Name," <tablename>
will result in "data source name," and <TABLENAME>
will result in "DATA SOURCE NAME").
Enter the SQL Table Name Format, which will be the format of the name of the table in Immuta. It must include a table name macro, but you may personalize the format using lowercase letters, numbers, and underscores. It may have up to 255 characters.
When selecting the Schema/Table option, you can opt to enable schema monitoring by selecting the checkbox in this section. This step will only appear if all tables within a server have been selected for creation.
Optional Advanced Settings:
Column Detection: To enable, select the checkbox in this section. This setting monitors when remote tables' columns have been changed, updates the corresponding data sources in Immuta, and notifies data owners of these changes. See schema projects overview to learn more about column detection.
Data Source Tags: Adding tags to your data source allows users to search for the data source using the tags and governors to apply global policies to the data source. Note if schema detection is enabled, any tags added now will also be added to the tables that are detected.
Click the Edit button in the Data Source Tags section.
Begin typing in the Search by Tag Name box to select your tag, and then click Add.
Click Create to save the data source(s).
With data sources registered in Immuta, your organization can now start
building global subscription and data policies to govern data.
creating projects to collaborate.
For a complete list of supported databases, see the Immuta Support Matrix.
This page contains references to the term whitelist, which Immuta no longer uses. When the term is removed from the software, it will be removed from this page.
Redshift data sources
Redshift Spectrum data sources must be registered via the Immuta CLI or V2 API using this payload.
Registering Redshift datashares as Immuta data sources is unsupported.
CREATE_DATA_SOURCE
Immuta permission
Snowflake data source requirements:
USAGE
Snowflake privilege on the schema and database
REFERENCES
Snowflake privilege on the tables
Databricks Spark integration requirements: Ensure that at least one of the traits below is true.
The user exposing the tables has READ_METADATA and SELECT permissions on the target views/tables (specifically if Table ACLs are enabled).
The user exposing the tables is listed in the immuta.spark.acl.whitelist
configuration on the target cluster.
The user exposing the tables is a Databricks workspace administrator.
Databricks Unity Catalog integration requirements: When exposing a table from Databricks Unity Catalog, be sure the credentials used to register the data sources have the Databricks privileges listed below.
The following privileges on the parent catalogs and schemas of those tables:
SELECT
USE CATALOG
USE SCHEMA
USE SCHEMA
on system.information_schema
Snowflake imported databases
Immuta does not support Snowflake tables from imported databases. Instead, create a view of the table and register that view as a data source.
Best Practice: Connections Use SSL
Although not required, it is recommended that all connections use SSL. Additional connection string arguments may also be provided.
Note: Only Immuta uses the connection you provide and injects all policy controls when users query the system. In other words, users always connect through Immuta with policies enforced and have no direct association with this connection.
Navigate to the My Data Sources page.
Click the New Data Source button in the top right corner.
Select the data platform containing the data you wish to expose by clicking a tile.
Input the connection parameters to the database you're exposing. Click the tabs below for guidance for select data platforms.
See the Create an Amazon S3 data source guide for instructions.
Required Google BigQuery roles for creating data sources
Ensure that the user creating the Google BigQuery data source has these roles:
roles/bigquery.metadataViewer
on the source table (if managed at that level) or dataset
roles/bigquery.dataViewer
(or higher) on the source table (if managed at that level) or dataset
roles/bigquery.jobUser
on the project
See the Create a Google BigQuery data source guide for instructions.
Azure Databricks Unity Catalog limitation
Set all table-level ownership on your Unity Catalog data sources to an individual user or service principal instead of a Databricks group before proceeding. Otherwise, Immuta cannot apply data policies to the table in Unity Catalog. See the Azure Databricks Unity Catalog limitation for details.
Complete the first four fields in the Connection Information box:
Server: hostname or IP address
Port: port configured for Databricks, typically port 443
SSL: when enabled, ensures communication between Immuta and the remote database is encrypted
Database: the remote database
Enter your Databricks API Token. Use a non-expiring token so that access to the data source is not lost unexpectedly.
Enter the HTTP Path of your Databricks cluster or SQL warehouse.
If you are using a proxy server with Databricks, specify it in the Additional Connection String Options:
UseProxy=1;ProxyHost=my.host.com;ProxyPort=6789
Click the Test Connection button.
Further Considerations
Immuta pushes down joins to be processed on the native database when possible. To ensure this happens, make sure the connection information matches between data sources, including host, port, ssl, username, and password. You will see performance degradation on joins against the same database if this information doesn't match.
Some data platforms require different connection information than pictured in this section. Please refer to the tool-tips in the Immuta UI for this step if you need additional guidance.
If you are creating an Impala data source against a Kerberized instance of Impala, the username field locks down to your Immuta username unless you possess the IMPERSONATE_HDFS_USER permission.
If a client certificate is required to connect to the source database, you can add it in the Upload Certificates section at the bottom of the form.
Decide how to virtually populate the data source by selecting Create sources for all tables in this database and monitor for changes or Schema/Table.
Complete the workflow for Create sources for all tables in this database and monitor for changes or Schema/Table selection, which are outlined on the tabs below:
Create sources for all tables in this database and monitor for changes
Selecting this option will create and keep in sync all data sources within this database. New schemas will be automatically detected and the corresponding data sources and schema projects will be created.
Select Create sources for all tables in this database and monitor for changes.
Schema/Table
Selecting this option will create and keep in sync all tables within the schema(s) selected. No new schemas will be detected.
If you choose Schema/Table, click Edit in the table selection box that appears.
By default, all schemas and tables are selected. Select and deselect by clicking the checkbox to the left of the name in the Import Schemas/Tables menu. You can create multiple data sources at one time by selecting an entire schema or multiple tables.
After making your selection(s), click Apply.
Provide information about your source to make it discoverable to users.
Enter the SQL Schema Name Format to be the SQL name that the data source exists under in the Immuta Query Engine. It must include a schema macro but you may personalize it using lowercase letters, numbers, and underscores to personalize the format. It may have up to 255 characters.
Enter the Schema Project Name Format to be the name of the schema project in the Immuta UI. This field is disabled if the schema project already exists within Immuta.
When selecting Create sources for all tables in this database and monitor for changes you may personalize this field as you wish, but it must include a schema macro.
When selecting Schema/Table this field is prepopulated with the recommended project name and you can edit freely.
Select the Data Source Name Format, which will be the format of the name of the data source in the Immuta UI.
<Tablename
>
The data source name will be the name of the remote table, and the case of the data source name will match the case of the macro.
<Schema
><Tablename
>
The data source name will be the name of the remote schema followed by the name of the remote table, and the case of the data source name will match the cases of the macros.
Custom
Enter a custom template for the Data Source Name. You may personalize this field as you wish, but it must include a tablename macro. The case of the macro will apply to the data source name (i.e., <Tablename
> will result in "Data Source Name," <tablename
> will result in "data source name," and <TABLENAME
> will result in "DATA SOURCE NAME").
Enter the SQL Table Name Format, which will be the format of the name of the table in the Immuta Query Engine. It must include a table name macro, but you may personalize the format using lowercase letters, numbers, and underscores. It may have up to 255 characters.
Data source duplicates
In order to avoid two data sources referencing the same table, users can not create duplicate data sources. If you attempt to create a duplicate data source in the UI, you will encounter a warning stating "a data source with the same remote table already exists."
By default Immuta prevents users from creating data source duplicates. If you want to change this behavior,
Navigate to the App Settings page, and scroll to the Advanced Configuration section.
Copy and paste this YAML into the text box:
Click Save.
When selecting the Schema/Table option you can opt to enable Schema Monitoring by selecting the checkbox in this section.
Note: This step will only appear if all tables within a server have been selected for creation.
In most cases, Immuta’s schema detection job runs automatically from the Immuta web service. For Databricks, that automatic job is disabled because of the ephemeral nature of Databricks clusters. In this case, Immuta requires users to download a schema detection job template (a Python script) and import that into their Databricks workspace.
Generate Your Immuta API Key
Before you can run the script referenced in this tutorial, generate your Immuta API Key from your user profile page. The Immuta API key used in the Databricks notebook job for schema detection must either belong to an Immuta Admin or the user who owns the schema detection groups that are being targeted.
Enable Schema Monitoring or Detect Column Changes on the Data Source creation page.
Click Download Schema Job Detection Template.
Click the Click Here To Download text.
Before you can run the script, create the correct scope and secret by running these commands in the CLI using the Immuta API Key generated on your user profile page:
Import the Python script you downloaded into a Databricks workspace as a notebook. Note: The job template has commented out lines for specifying a particular database or table. With those two lines commented out, the schema detection job will run against ALL databases and tables in Databricks. Additionally, if you need to add proxy configuration to the job template, the template uses the Python requests library, which has a simple mechanism for configuring proxies for a request.
Schedule the script as part of a notebook job to run as often as required. Each time the job runs, it will make an API call to Immuta to trigger schema detection queries, and these queries will run on the cluster from which the request was made. Note: Use the api_immuta
cluster for this job. The job in Databricks must use an Existing All-Purpose Cluster so that Immuta can connect to it over ODBC. Job clusters do not support ODBC connections.
Opt to configure settings in the Advanced Options section (outlined below), and then click Create to save the data source(s).
None of the following options are required. However, completing these steps will help maximize the utility of your data source.
Column Detection
This setting monitors when remote tables' columns have been changed, updates the corresponding data sources in Immuta, and notifies Data Owners of these changes.
To enable, select the checkbox in this section.
See Schema Projects Overview to learn more about Column Detection.
Event Time
An Event Time column denotes the time associated with records returned from this data source. For example, if your data source contains news articles, the time that the article was published would be an appropriate Event Time column.
Click the Edit button in the Event Time section.
Select the column(s).
Click Apply.
Selecting an Event Time column will enable
more statistics to be calculated for this data source including the most recent record time, which is used for determining the freshness of the data source.
the creation of time-based restrictions in the Policy Builder.
Latency
Click Edit in the Latency section.
Complete the Set Time field, and then select MINUTES, HOURS, or DAYS from the subsequent dropdown menu.
Click Apply.
This setting impacts the following behaviors:
How long Immuta waits to refresh data that is in cache by querying the native data source. For example, if you only load data once a day in the native source, this setting should be greater than 24 hours. If data is constantly loaded in the native source, you need to decide how much data latency is tolerable vs how much load you want on your data source; however this is only relevant to Immuta S3, since SQL will always interactively query the native database.
How often Immuta checks for new values in a column that is driving row-level redaction policies. For example, if you are redacting rows based on a country column in the data, and you add a new country, it will not be seen by the Immuta policy until this period expires.
Sensitive Data Discovery
Data Owners can disable Sensitive Data Discovery for their data sources in this section.
Click Edit in this section.
Select Enabled or Disabled in the window that appears, and then click Apply.
CREATE_S3_DATA_SOURCE
Immuta permission
Configure the Amazon S3 integration
Private preview
The Amazon S3 integration is available to select accounts. Reach out to your Immuta representative for details.
Navigate to the My Data Sources page in Immuta.
Click New Data Source.
Select the Native S3 tile in the data platform section.
Select your AWS Account/Region from the dropdown menu.
Click Next.
The prefix field is populated with the base path. Add to this prefix to create a data source for a prefix, bucket, or object.
If the data source prefix ends in a wildcard (*
), it protects all items starting with that prefix. For example, a base location of s3://
and a data source prefix surveys/2024*
would protect paths like s3://surveys/2024-internal/research-dept.txt
or s3://surveys/2024-customer/april/us.csv
.
If the data source prefix ends without a wildcard (*
), it protects a single object. For example, a base location path of s3://
and a data source prefix of research-data/demographics
would only protect the object that exactly matches s3://research-data/demographics
.
Click Add Prefix, and then click Next.
Verify that your prefixes are correct and click Complete Setup.
Your outgoing and incoming requests for data source access are consolidated on the requests tab on your user profile page. Similar to notifications, a red dot also displays on the request icon whenever you have pending requests. The sections below guide you through managing these requests.
Navigate to your Profile page, and then click the Requests tab. The names of the users who have submitted requests are displayed in the left pane. Once a user is selected, the corresponding pending requests are displayed on the right.
To view more information about the request, click the Details button in the Actions column of a request.
Click the Approve or Deny button in the Actions column of the request.
To approve or deny multiple access requests simultaneously,
Navigate to your Profile page, and then click the Requests tab.
Select the checkbox next to each request you want to address, and then click the Approve Selected or Deny Selected button.
If users make an unmask request, a tasks tab will appear on the data source overview page for the user making the request and the user receiving the request. From this tab, users can view and manage two different task views:
Your Created Tasks: This page lists the status and information of the unmask requests you've submitted.
Tasks For You: This page lists the status and information of the unmask requests that have been submitted to you.
To complete a task,
Navigate to the Tasks tab from the Data Source Overview page, and then click the toggle at the top of the page to Tasks For You.
Click the Unmask Values icon in the Actions column of the task.
A dialog box will appear with the masked and unmasked value. Note: You can view information about this request, including the reason for the request and the date is was created, by clicking the Task Info button in the Actions column.
To delete a task,
Navigate to the Tasks tab from the Data Source Overview page, and then click the toggle at the top of the page to Tasks For You.
Click Delete Task in the Actions column of the relevant task.
In addition to managing data source requests as outlined above, data owners can manage data source
As a data owner, you can and , , and a data source.
For other guides related to data source members and management, see the .
Navigate to the Overview tab.
Click the menu icon in the upper right corner of the page and select Edit.
Change your settings in the data source workflow.
Note: Some settings cannot be changed once the data source has been created. In these cases, simply create a new data source with the new settings.
When completed, navigate to the end of the workflow and click Save.
Note: Some data sources may require the data owner to reconnect to the remote database before any changes to the data source can be saved.
For information on specific settings, see the .
Data owners can bulk edit data sources that contain the same connection information.
Navigate to the Data Source Overview page and click the hyperlinked Parent Server text, or type the connection string in the search box in the top left of the UI and select your connection string from the list of auto-completed results.
All data sources created from this parent server will display in the center pane.
Select the data sources you would like to edit by clicking the checkbox next to each data source.
Click the Bulk Actions menu and select the change you would like to make from the dropdown menu.
Confirm your edits by following the prompts in the modals that appear.
Disabling a data source hides it and its data from all users except the data owner. While in this state, the data source will display as disabled in the console for the data owner(s) and other users will not be able to see it at all.
Navigate to the Overview tab.
Click on the menu icon in the upper right corner and select Disable.
A label will appear next to the data source indicating it is now disabled, and a notification will be sent to all users of the data source informing them that the data source has been disabled.
Navigate to the Overview tab.
Click on the menu icon in the upper right corner and select Enable.
A notification will be sent out to all users of the data source informing them that the data source has been enabled.
Deleting a data source permanently removes it from Immuta. Data sources must first be disabled before they can be deleted.
Navigate to the Overview tab and click the menu icon and select Delete.
Confirm that the data source should be deleted by clicking Delete.
A notification will be sent out to all users of the data source informing them that the data source has been deleted.
For information about data sources and policies, see the following guides:
In addition to adding and managing data source settings as outlined above, data owners can manage data source
Data owners can apply tags to and data source . To add a tag, that tag must have already been created by an Immuta governor.
For other guides related to data sources and tags, see the .
Navigate to the Overview tab, scroll to the Tags section, and click Add Tags.
In the resulting pop-up window, search for tags that you want to add to the data source. You can apply multiple tags at once.
Click Add at the bottom of the window.
You can now view the tags that have been applied to this data source in the Overview tab.
Navigate to the Data Dictionary tab.
In the Data Dictionary tab, find the column(s) that you want to tag, and click the Add Tags for that column on the right side of the page.
In the resulting pop-up window, search for tags that you want to add to the column. You can apply multiple tags at once. When complete, Click Add at the bottom of the window.
You can now view the tags that have been applied to this column in the Data Dictionary tab.
For information about data sources and tags, see the following guides:
In addition to adding and managing data source tags as outlined above, data owners can manage data source
Prerequisite: Immuta permission: USER_ADMIN
You can manually run a schema monitoring job globally using the with an empty payload.
You can manually run a schema monitoring job for all data sources that you own using the with a payload containing the hostname for your data sources or their individual IDs.
You can manually run a schema monitoring job for data sources you are subscribed to using the with a payload containing the hostname for your data source and the table name or data source ID.
Navigate to the data source overview page.
Click on the health check icon.
Scroll to Column Detection, and click Trigger Detection.
The data dictionary provides information about the columns within the data source, including column names and value types.
As a data owner, you can manage data dictionary , , and column tags. For other guides related to the data dictionary, see the .
Navigate to the Data Dictionary tab.
To add or edit column descriptions, click the menu icon in the Actions column next to the entry you want to change and select Edit.
Complete the fields in the form that appears, and then click Save.
Deprecation notice
Support for this feature has been deprecated.
Navigate to the Data Dictionary tab.
Click the talk bubble icon to the right of the definition.
View discussions on the far right side of the Data Dictionary page.
Click Resolved to review any resolved threads or Open to review all open threads.
To reply to an existing thread, click on the comment, type in a reply, and then click the Save button.
To start a new discussion, click New Discussion, type a new comment or question, and click the Save button.
To resolve or delete a thread, click the menu icon and select Mark Resolved or Delete.
A notification will be sent to all subscribers of the data source.
In addition to managing data dictionary descriptions and discussions as outlined above, you can interact with the data dictionary in the following ways:
In addition to creating and managing data sources, data owners can add and manage data source members manually. While this is supported, it is not recommended and instead it is much more scalable to manage user access through
For other guides related to data source members and management, see the .
Navigate to the data source and click the Members tab.
Click Add Members and enter the group name or username.
Select their Role:
Subscriber: The role can have read or write access to the table. This role is only available if there are on the data source.
Owner: The role can manage data source members and policies and have read or write access to the table.
Expert: The role can manage the data dictionary descriptions and have read or write access to the table. This role is only available if there are on the data source.
You can also opt to for when the user’s access should expire.
Select Read or Write from the Access Grant dropdown. This option is only available if have been enabled.
Click Add.
Search by tag name, column name, global policy, or connection string in the search box in the top left corner of the console. After selecting from the dropdown menu, you will automatically navigate to the Search page, where all relevant data sources will appear.
Select the data sources you want to add users to by clicking the checkbox next to the data source.
Click the dropdown menu in the top right corner of the results page and select Add Users.
In the modal, type the user name or group name in the Enter User Name or Group Name field and select the user or group you would like to add from the dropdown menu.
Opt to set an Expiration for the users' subscriptions. Additionally, you can change the role from Subscriber to Expert or Owner for the users or groups using the dropdown menu in the Actions column.
Click Add. All users and groups will be added to the data sources you selected.
As a data owner, you can limit the amount of time a user or group has access to your data source by setting an access expiration date.
Navigate to the Members tab.
Adjust the number of days under the Expires column for the user/group whose access you want to limit (the limit is counting from today, so users/groups with 0 days left means their access will be revoked by the end of today and users with 1 day left means their access will be revoked by the end of tomorrow).
Save your changes.
To remove the limit (or set the limit to Never), delete the number from the field and save your changes.
Navigate to the Members tab.
Click the drop-down arrow under the Role column next to the user/group whose role you’d like to change.
Select another role (subscribed, expert, owner or ingest user, if applicable).
Notifications about the change will be sent to the affected users and groups (as well as alternative Owners).
Navigate to the Members tab.
Click the Name of the user or group whose history you want to review.
As a data owner, you can deny access to any users or groups at any time.
Navigate to the Members tab.
To remove a user or group from a data source, click Deny in the Actions column next to the user or group you want to remove.
Complete the Deny Access form, including a reason for revoking the access.
This action will immediately update users' or groups' subscription status, and they will no longer have any access to the data source. Notifications will be sent to the affected users (as well as alternative data owners) informing them of the change in subscription status.
In addition to adding and managing data source members as outlined above, data owners can manage data source
For information about data sources see the .
.
For information about the data dictionary, see the .
Data owners or experts can manage .
Users subscribed to the data source can by commenting on the data dictionary.
For information about data source members and subscriptions, see the .
Audience: Data Users
Content Summary: This page offers a tutorial on how to query data within the Redshift integration.
Prerequisites:
REVOKE
users' access to raw tables
Use your tool of choice to connect to Redshift.
Select the Immuta database name used when configuring the integration.
Query the Immuta-protected data, which takes the form of immuta_database.backing_schema.table_name
:
Immuta Database: The Immuta database name used when configuring the integration.
Backing Schema: The schema that houses the backing tables of your Immuta data sources.
Table Name: The name of the table backing your Immuta data sources.
Run your query (it is recommended that you use the catalog in the query). It should look something like this:
Audience: Data Users
Content Summary: This page offers a tutorial on how to query data within the Databricks integration.
Prerequisites:
Create a new workspace.
Query the Immuta-protected data, which takes the form of database.table_name
:
Database: The database that houses the backing tables of your Immuta data sources.
Table Name: The name of the table backing your Immuta data sources.
Run your query, it should look something like:
Create a new workspace.
Query the Immuta-protected data, which takes the form of database.table_name
:
Database: The database that houses the backing tables of your Immuta data sources.
Table Name: The name of the table backing your Immuta data sources.
Run your query. It should look something like this:
Create a new workspace.
Run:
In the same workspace, but a different cell, query the Immuta-protected data, which takes the form of database.table_name
:
Database: The database that houses the backing tables of your Immuta data sources.
Table Name: The name of the table backing your Immuta data sources.
Run your query. It should look something like this:
Query the Immuta-protected data, which takes the form of database.table_name
:
Database: The database that houses the backing tables of your Immuta data sources.
Table Name: The name of the table backing your Immuta data sources.
Run your query. It should look something like this:
Audience: Data Users
Content Summary: This page offers a tutorial on how to query data within the Snowflake integration.
Prerequisites:
Query the data exactly as you would have before Immuta.
Prerequisite: Users have been granted SELECT
privileges on all or relevant Snowflake tables
Query the data exactly as you would have before Immuta.
Prerequisite: REVOKE
users' access to backing tables
Create a new worksheet.
Select the appropriate role/database/schema to query the views:
Role: any or just PUBLIC.
Warehouse: any.
Database: The Immuta database name used when configuring the integration (default is IMMUTA).
Schema: The schema that houses the backing tables of your Immuta data sources.
Run the following query in the worksheet (replace IMMUTA
with the name of your database and replace TABLE.NAME
with the name of the backing Snowflake table):
Audience: Data Users
Content Summary: This page offers a tutorial on how to query data within the Starburst (Trino) integration.
Prerequisites:
REVOKE
users' access to raw tables
Use your tool of choice to connect to Starburst (Trino).
Select the Immuta catalog name used when configuring the integration.
Query the Immuta-protected data, which takes the form of immuta_catalog.backing_schema.table_name
:
Immuta Catalog: The Immuta catalog name used when configuring the integration.
Backing Schema: The schema that houses the backing tables of your Immuta data sources.
Table Name: The name of the table backing your Immuta data sources.
Run your query (it is recommended that you use the catalog in the query). It should look something like this:
Audience: Data Users
Content Summary: This page offers a tutorial on how to query data within the Databricks SQL integration.
Prerequisites:
REVOKE
users' access to raw tables
Select SQL from the upper left menu in Databricks.
Click Create → Query.
Select the Immuta database name used when configuring the integration.
Query the Immuta-protected data, which takes the form of immuta_database.backing_database_table_name
:
Immuta Database: The Immuta database name used when configuring the integration.
Backing Database: The database that houses the backing tables of your Immuta data sources.
Table Name: The name of the table backing your Immuta data sources.
Run your query (you must include the database). It should look something like this:
Audience: Data Users
Content Summary: Immuta provides a one-stop shop for all data across an organization through data sources, which are virtual exposures of data. This data is protected by policy rules written and applied to the data sources by Data Owners, so Data Users can view details about, comment on, and subscribe to these data sources without violating privacy regulations.
This guide delineates the processes of accessing and using data source features in the Immuta UI.
Immuta provides the My Data Sources view for users to quickly view data sources they are affiliated with.
Click on the Data Source icon in the panel on the left.
By default, all data sources will be displayed.
To view only data sources you have access to, click on the My Data Sources tab.
Note: If no data sources are displayed, you are not subscribed to, an expert of, or an owner of any data sources.
To view the details of a data source, simply click on the Data Source.
Click the Get Access button from either this data sources view or the Data Source Overview tab, which can be accessed by clicking on the Data Source.
If prompted, fill out the custom request form set up by the system admin and click Request Access.
A notification will be sent to the Data Owner(s) informing them of your request.
Once reviewed, you will receive a notification with a response indicating if your request was accepted or denied.
If accepted, the status displayed next to that data source will be updated to "Subscribed" and you will have access to the data source via your personal SQL connection. If not accepted, a reason will be provided in the notification details.
To request access to multiple data sources simultaneously,
Filter data sources by connection string in the search bar.
Click the connection string from the auto-completed results to navigate to the Search Results page.
Select the data sources you would like to subscribe to by clicking the checkbox next to each relevant data source.
Click the dropdown menu button in the top right corner of the page, and then select Request Access.
Describe how you plan to use the data in the dialog box that appears, and then click Subscribe.
If you no longer need access to a data source, click Unsubscribe in the upper right corner of the Data Source Overview tab.
If a data source health check fails and needs to be re-generated,
Click the health indicator in the upper right-hand corner.
Select Re-run on the job you want to run.
Note: To generate a fingerprint, the row count must be up-to-date.
To view the Data Dictionary,
Navigate to the Data Dictionary tab.
When provided, the Data Dictionary will display in the center pane and include the column’s name, type, and comments. Masked columns will display a symbol next to their names.
Deprecation notice
Support for this feature has been deprecated.
Data Users have the ability to comment on or ask questions about the Data Dictionary columns and definitions, public queries, and the data source in general.
To comment on general data source discussions,
Navigate to the Discussions tab.
Click Open to review open discussions or Resolved to review resolved discussions.
Click a discussion to view comments.
Click New Discussion to create a new discussion.
Type in your comment or question and click Save.
To comment on Data Dictionary discussions,
Navigate to the Data Dictionary tab.
Click the talk bubble icon to the right of the definition.
View discussions on the far right side of the Data Dictionary page.
Click Resolved to review any resolved threads or Open to review all open threads.
To reply to an existing thread, click on the comment, type in a reply, and then click the Save button.
To start a new discussion, click New Discussion, type a new comment or question, and click the Save button.
A notification will be sent to all subscribers of the data source, including the Data Owner and Experts so that they can review the thread and reply.
Once created, Data Dictionary discussions can be continued under the Discussions tab.
Contact information for Data Owners is provided for each data source, which allows other users to ask them questions about accessibility and attributes required for viewing the data.
To view this contact information, click the Contacts tab.
To request to unmask a value in a data source,
Navigate to the Data Source Overview tab, click the dropdown menu in the top right corner, and select Make Unmasking Request.
In the modal that appears, select the column from the first dropdown menu, and then complete the Values to Unmask and the Reason for Unmasking fields.
Select the user to unmask the value from the final dropdown menu, and then click Submit.
A Tasks tab will then appear for your data source that details the task type and the status of your request. You may also view task information or delete the task from this page.
After sending an Unmask request, a Tasks tab will appear on the Data Source Overview page listing the target and requesting users, the task type, and the state of the task.
To view information about a task,
Navigate to the Tasks tab from the Data Source Overview page.
Click the Task Info icon in the Actions column of the relevant task.
To delete a task,
Navigate to the Tasks tab from the Data Source Overview page.
Click Delete Task.
Audience: Data Users
Content Summary: This page offers a tutorial on how to query data within the .
Prerequisites:
REVOKE
users' access to raw tables
GRANT
users' access to the Immuta schema
From Synapse Studio click on the Data menu on the left.
Click on the Workspace tab.
Expand databases and you should see the dedicated pool you specified when .
Expand the dedicated pool and you should see the Immuta schema you created when .
Select that schema.
Select New SQL script and then Empty script.
Run your query (note that Synapse does not support LIMIT and the SQL is case sensitive). It should look something like this: