Register a Google BigQuery Connection

Public preview: This integration is available to all accounts that request to enable it for their tenant. Contact your Immuta representative to enable it.

Immuta policies will not be automatically enforced in Google BigQuery

While you can author and apply subscription and data policies on Google BigQuery data sources within Immuta, these policies will not be enforced natively in the Google BigQuery platform.

To use this integration, contact your Immuta representative.

Requirement

BigQuery Enterprise or Enterprise Plus edition

Permissions

The user registering the connection must have the permissions below.

• APPLICATION_ADMIN Immuta permission
• The Google BigQuery user setting up the connection must be able to

  • Create a service account and grant that service account the necessary BigQuery permissions. To do so, the setup user needs the following permissions:

    • roles/iam.serviceAccountCreator
    • roles/iam.serviceAccountAdmin
    • roles/resourcemanager.projectIamAdmin (or a project owner)
  • Create a JSON key

Create a Google Cloud service account and custom role

Create the prerequisite role, service account, and private key file for Immuta to connect to Google BigQuery.

1. Create a custom role using the console and bind it to the project or the specific datasets you want ingested in Immuta. The custom role should have the following privileges:

   • bigquery.datasets.get
   • bigquery.tables.get
   • bigquery.tables.list
2. Create a service account and grant it the custom role you just created.
3. Enable the Google BigQuery API.

You will use the private key file generated after completing these steps to register your Google BigQuery connection.

Register a Google BigQuery connection

1. In Immuta, click Data and select Connections in the navigation menu.
2. Click the + Add Connection button.
3. Select the Google BigQuery tile.
4. Enter the connection information:

   1. Display Name: This is the name of your new connection. This name will be used in the API (connectionKey), in data source names from the host, and on the connections page. Avoid the use of periods (.) or restricted words in your connection name.
   2. Upload your GCP Service Account Key JSON File. This is the private key file generated in create a Google Cloud service account and role for Immuta to use to connect to Google BigQuery. Uploading this file will auto-populate the following fields:

      1. Project ID: The Google Cloud Platform project to operate on (where your Google BigQuery data warehouse is located).
      2. Service Account: The service account you created.
   3. Location: This is the location or region used for the dataset and query operations.
   4. Directory Customer ID: This is the Google Workspace customer ID for the organization that the governed BigQuery project belongs to. See the Google Workspace documentation for guidance on how to find this ID.
   5. Immuta Dataset: The name of the Google BigQuery dataset to create inside the project. If you are using multiple environments in the same Google BigQuery project, this dataset must be unique across environments.
   6. Immuta role: The custom role you created.
5. Opt to Enable Object Sync, which will keep your connection objects up to date with your Google BigQuery environment.

   1. Select the Start Time for when the first object sync job will run each day.
   2. Select the Run Frequency to determine how frequently object sync will run each day.
   3. Opt to Run Object Sync on Create to create all the data objects for your connection. If you do not select this option, you must run object sync manually or wait for the scheduled object sync for your connection's data objects.
6. Click Save connection.