Table of Contents

Search

  1. Preface
  2. Part 1: Getting Started with Snowflake Data Cloud Connector
  3. Part 2: Data Integration with Snowflake Data Cloud Connector
  4. Part 3: SQL ELT with Snowflake Data Cloud Connector
  5. Appendix A: Data type reference
  6. Appendix B: Additional runtime configurations
  7. Appendix C: Upgrading to Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Snowflake Data Cloud Connector

Handling dynamic schemas

Handling dynamic schemas

When you add a mapping to a mapping task, you can choose how
Data Integration
handles changes in the data object schemas. To refresh the schema every time the task runs, you can enable dynamic schema handling in the task.
A schema change includes one or more of the following changes to the data object:
  • Fields added, deleted, or renamed.
  • Fields updated for data type, precision, or scale.
Configure schema change handling in the
Advanced Options
section on the
Runtime Options
tab when you configure the task. You can configure asynchronous or dynamic schema change handling.
When you configure dynamic schema change handling, you can choose from the following options to refresh the schema:
Alter and apply changes
Data Integration
applies the following changes from the source schema to the target schema:
  • New fields. Alters the target schema and adds the new fields from the source.
  • Renamed fields. Adds renamed fields as new columns in the target.
  • Data type and precision updates. Applies these changes to the target. Updates to the scale are not applicable.
  • Deleted fields. Ignores deleted fields.
To include schema changes for renamed or new fields for mappings in advanced mode, see Handling dynamic schemas for mappings in advanced mode.
Don't apply DDL changes
Data Integration
does not apply the schema changes to the target.
Drop current and recreate
Drops the existing target table and then recreates the target table at runtime using all the incoming metadata fields from the source.

0 COMMENTS

We’d like to hear from you!