Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Snowflake
  3. Snowflake Connections
  4. PowerExchange for Snowflake Data Objects
  5. PowerExchange for Snowflake Mappings
  6. PowerExchange for Snowflake Dynamic Mappings
  7. Snowflake Run-Time Processing
  8. Pushdown Optimization
  9. Appendix A: Snowflake Data Type Reference

PowerExchange for Snowflake User Guide

PowerExchange for Snowflake User Guide

Configure Loader Properties as Additional Runtime Parameters

Configure Loader Properties as Additional Runtime Parameters

You can configure write properties to load data to Snowflake in the
Additional Write Runtime Parameters
field in the advanced target properties of the Snowflake target.
The following table lists some of the additional runtime parameters that you can specify to load data to Snowflake:
Property
Supported Type
Description
Default Value
oneBatch
Boolean
Process all data in a single batch.
false
remoteStage
String
Specifies to use internal stage.
External stage is not supported.
"~"(user stage)
onError
String
Specifies the action to perform when an error is encountered while loading data from a file.
For example,
on_error option ABORT_STATEMENT|CONTINUE|SKIP_FILE
CONTINUE
compressFileByPut
Boolean
Compress file by PUT.
false
compressDataBeforePut
Boolean
Compress data before PUT.
The loader compresses the data to a gzip format before uploading the data.
true
copyEmptyFieldAsEmpty
Boolean
The COPY command option to set incoming empty fields as null.
-
When you set the values in the additional runtime parameters field, every configured partition initializes a new loader instance and the configured values apply similarly across all the partitions.

Example 1

You want to compress files by using the Put command before loading data to Snowflake.
Specify the following compression option:
compressDataBeforePut=false&compressFileByPut=true
If you specify both the options as true, Snowflake considers the
compressDataBeforePut
option.

Example 2

You want to replace the incoming fields with empty values as NULL while loading the data to Snowflake.
Specify the
copyEmptyFieldAsEmpty Boolean
option and set the value to true or false based on your requirement.
Consider the following scenarios before you configure the
copyEmptyFieldAsEmpty Boolean
parameter:
  • If you do not configure this parameter, Null values are received as NULL, and empty values are received as Empty. This is the default behavior.
  • If you set the parameter
    copyEmptyFieldAsEmpty=false
    , Null values as received as Null and empty values are received as Null.
  • If you set the parameter
    copyEmptyFieldAsEmpty=true
    , Null values are received as empty, while empty values are received as empty.

0 COMMENTS

We’d like to hear from you!