Databricks Integration Readiness Checklist

Introduction

1. Documentation Review

   • Has the customer gone through our Databricks integration documentation?

2. Integration Type

   • Is this Databricks UC integration or Databricks Spark integration?

     • If it is Databricks Spark, which Databricks Runtime Version is being used? (Immuta 2024.2+ supports Databricks 11.3 LTS.)

   • Is this a Databricks migration to Databricks Unity Catalog (UC)?

3. Databricks Metastore - UC Integration Only

   • Has the Databricks metastore been created and attached to a Databricks workspace?

   • Are there other Databricks workspaces added to the same metastore?

     • Will you be linking multiple workspaces with a single Immuta?

       • If so, ensure there is an non-isolated workspace that Immuta can integrate with

4. Compute Resources

   • What computing resources will the customer be using for this integration?

     • SQL Warehouse or Databricks Cluster?

       • If setting up a Spark Integration, confirm runtime is supported

       • If setting up a UC Integration, confirm that UC is enabled on Spark Compute

         • Do not use an Immuta-protected Compute cluster for UC.

     • Make sure whichever resource is selected, that it is located in the same workspace as the data being pulled into Immuta

5. Authentication Method

   • What is the authentication method for the integration?

     • Databricks Personal Access Token?

       • If so, does this service principal have metastore privileges and permissions listed in the documentation?

     • OAuth? - UC Integration Only

       • Has the client secret been created with the same privileges and permissions as the service principal for the access token?

6. Audit Configuration

   • Does the customer want to enable Databricks Native Query Audit?

     • This will ping and wake up the compute resources hourly by default

       • Does the customer need to adjust native query audit log configuration to run at a different interval (up to once per 24 hours)?

7. Integration Process

   • Will this be an automated or manual integration?

     • Have the customers reviewed the bootstrap script for the manual integration?

   • Does the service principal have the necessary permissions to complete the integration setup?

   • Has the customer attempted to run through the integration process themselves?

     • Were any errors encountered or questions raised during the process?