Table of Contents

Search

  1. Preface
  2. Introduction to Google Cloud Storage V2 Connector
  3. Google Cloud Storage V2 connections
  4. Mappings for Google Cloud Storage
  5. Migrating a mapping
  6. Upgrading to Google Cloud Storage V2 Connector
  7. Appendix A: Data type reference

Google Cloud Storage V2 Connector

Google Cloud Storage V2 Connector

Handling dynamic schemas

Handling dynamic schemas

When you add a mapping to a mapping task, you can choose how
Data Integration
handles changes in the data object schemas. To refresh the schema every time the task runs, you can enable dynamic schema handling in the task.
Configure schema change handling in the Advanced Options section on the
Runtime Options
tab when you configure the task. You can configure asynchronous or dynamic schema change handling.
When you configure dynamic schema change handling, you can choose from the following options to refresh the schema:
Keep Existing File Format
Data Integration
fetches the most recent target schema at runtime and does not apply upstream schema changes to the target file.
Drop Current and Recreate
Data Integration
updates the target schema to match the incoming schema on every task run.

Restrictions

Consider the following restrictions when you configure dynamic schema handling:
  • When you select the
    Keep Existing File Format
    option while configuring dynamic schema handling in a mapping that creates a new target at runtime and the target already exists, the changes in the source are propagated to the target.
  • You cannot use the
    Drop Current and Recreate
    option in mappings in advanced mode.
  • When you select the
    Keep Existing File Format
    option while configuring dynamic schema handling in a mapping that creates a new target at runtime and the target already exists, the changes in the source are propagated to the target when the object name contains special characters.

0 COMMENTS

We’d like to hear from you!