Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Run a profile on Databricks Delta tables using Azure Databricks with ODBC connection

Run a profile on Databricks Delta tables using Azure Databricks with ODBC connection

Step 5. Create and run profiles

Step 5. Create and run profiles

Create and run profiles on Databricks Delta tables using Azure Databricks with ODBC connection to view and analyze the content and structure of source objects.
  1. In
    Data Profiling
    , click
    New
    .
  2. In the
    New
    dialog box, click
    Data Profiling Task
    .
    The
    Definition
    tab for the profile appears.
  3. On the
    Definition
    tab, enter the asset, source, and profile details. You can also choose columns and add a filter for the profile.
  4. On the
    Rules
    tab, add one or more
    Data Quality
    assets as rules to the profile.
  5. On the
    Schedules
    tab, optionally choose a runtime environment and schedule. You can also change the default email notification options and advanced options for the profile run as necessary.
  6. Choose one of the following options to save and run the profile:
    • Click
      Save
      to save the profile.
    • Click
      Run
      to save and run the profile.
    • Save the profile and choose a schedule on the
      Schedules
      tab to run the profile.

0 COMMENTS

We’d like to hear from you!
Sam Greene - April 17, 2023

Is there no way to run a profile through a data integration map, map task, or taskflow? 

Informatica Documentation Team - April 18, 2023

Hi Sam Greene,

We’re working to address your comments and will get back to you.

Thanks,

Informatica Documentation team


Ricardo Sobral - June 05, 2023

Currently, the option is to use a CAI process and use public Profiling APIs to start a profiling task in a task flow. The documentation of profiling API is here:

https://docs.informatica.com/data-governance-and-quality-cloud/data-profiling/h2l/1547-getting-started-with-cloud-data-profiling-rest-api/abstract.html

We have plans to make the profiling task available directly in CAI to orchestrate the profiling tasks in a taskflow without using the profiling APIs.