Greenplum Connector

Greenplum Connector

Greenplum sources in mappings

Greenplum sources in mappings

To read data from Greenplum, configure a Greenplum object as a source in the mapping.
Specify the name and description of the Greenplum source. Configure the source and advanced properties for the source object. You can parameterize the source object name.
The following table describes the source properties that you can configure in a Source transformation:
Property
Description
Connection
Name of the source connection.
Source Type
Type of the source object. Select Single, Multiple, or Parameter.
Object
The source object.
The following table describes the Greenplum Query options:
Property
Description
Filter
Filters records based on the filter condition you specify. Specify the source field and configure the operator and value to use in the filter.
You can specify the following filter conditions:
  • Not Parameterized. Specify the source field and configure the operator and value to use in the filter.
  • Completely Parameterized. Use a parameter for a filter expression and define the filter expression in the task.
  • Advanced. Create a filter expression using the expression editor.
Sort
Not applicable.
The following table describes the Greenplum advanced source properties:
Property
Description
Pipe Directory Path
The file system location where the pipes that are used for data transfer are created.
Default is
$PMRootDir/Temp
.
Delimiter
Separates successive input fields.
For data in the text format, use any 7-bit ASCII value except a-z, A-Z, and 0-9.
For data in the CSV format, use any 7-bit ASCII value except \n, \r, and \\.
Default is pipe (|).
You can also specify a non-printable ASCII character through an escape sequence by using the decimal representation of the ASCII character. For example, \014 represents the shift out character.
Null Value
String that represents a null value.
In the source data, any data item that matches the string is treated as a null value.
Default is backslash N (\N).
Escape Character
Character that treats special characters in the data as regular characters.
In the text format, special characters comprise delimiter and escape characters.
In the CSV format, special characters comprise quotes and escape characters.
Use any 7-bit ASCII value as an escape character.
Default is backslash (\).
You can improve the task performance if the data does not contain escape characters.
SQL Query Override
Overrides the schema specified in the Greenplum connection object. If you do not configure this property, the Data Secure Agent uses the schema value specified in the Greenplum connection object.
Owner Name
The schema name in Greenplum.
Source Table Name
Overrides the default Greenplum source table name.
PreSQL
The SQL command to run before reading data from the source.
PostSQL
The SQL command to run after reading data from the source.
GPFDist Port
The HTTP port on which gpfdist serves files.
Default is 39871.
GPFDIST Log File
The fully qualified path and log file name for the standard output message logs.
Default is INFAGPFDistLogfile.out.
GPFDIST Timeout
The time allowed for Greenplum Database to establish a connection to a gpfdist process.
Default is 60 seconds. Allowed values are 2 to 7200 seconds (2 hours).
GPFDist Maximum Line Length
The integer that specifies the maximum length of a line in the XML transformation data that is passed to gpload.
Default is 32768. Valid range is 32 K to 256 MB, with the upper limit at 1 MB on Windows operating systems.)
Encoding
Character set encoding of the source data.
Greenplum Connector supports only the UTF-8 character set encoding.
GPFDist Logging
Sets the logging level for the gpload utility.
You can specify from the following logging options:
  • None
  • Verbose. Shows the progress and status messages.
  • Very Verbose. Shows all the output messages generated by this utility.
Tracing Level
Determines the amount of detail that appears in the log for the source. You can choose Terse, Normal, Verbose Initialization, or Verbose Data tracing level.
Default is Normal.

0 COMMENTS

We’d like to hear from you!