Table of Contents

Search

  1. Preface
  2. Introduction to Databricks Delta Connector
  3. Connections for Databricks Delta
  4. Mappings for Databricks Delta
  5. Migrating a mapping
  6. Databricks Delta SQL ELT optimization
  7. Data type reference

Databricks Delta Connector

Databricks Delta Connector

Create a target table at runtime

Create a target table at runtime

You can use an existing target or create a target to hold the results of a mapping. If you choose to create the target, the agent creates the target if it does not exist already when you run the task.
You can create both managed and external tables for mappings
and mappings in advance mode
.
To specify the target properties, perform the following tasks:
  1. Select the Target transformation in the mapping.
  2. To specify the target, click the
    Target
    tab.
  3. Select the target connection.
  4. For the target type, choose
    Single Object
    or
    Parameter
    .
  5. Specify the target object or parameter.
  6. To specify a target object, perform the following tasks:
    1. Click
      Select
      and choose a target object. You can select an existing target object or create a new target object at runtime.
      This image displays the page where you can create a new target at runtime.
    2. To create a target object at runtime, select
      Create New at Runtime
      .
    3. In the
      Object Name
      field, enter the name of the target table that you want to create. Specify the table name in lowercase.
    4. In the
      Table Location
      field, enter the location of the target table data.
      The table location is relative to the data bucket or data filesystem name specified in the connection. External table is created if you specify the table location.
      For unity catalog, specify a pre-existing location to create a new target at runtime.
      When you use personal staging location, specify a pre-existing table location with an absolute path to the directory to create a new target at runtime. The following image shows the table location for personal staging location.
      PSL unity catalog with table location
    5. In the
      Database Name
      field, specify the Databricks database name.
      The database name that you specify in the connection properties takes precedence.
      If you do not specify the Database Name when you create a new target or in the Database connection attribute, the default database is used to create a new target irrespective of the database name specified in the SQL Warehouse JDBC URL.
    6. Specify the
      Table Properties
      to optimize the table configuration settings. You can use table properties to tag tables with information that are not tracked by SQL queries. To see the list of table properties and table options, see the Databricks Delta documentation.
    7. Click
      OK
      .

0 COMMENTS

We’d like to hear from you!