Table of Contents

Search

  1. Preface
  2. Introduction to Test Data Management
  3. Test Data Manager
  4. Projects
  5. Policies
  6. Data Discovery
  7. Creating a Data Subset
  8. Performing a Data Masking Operation
  9. Data Masking Techniques and Parameters
  10. Plans and Workflows
  11. Monitor
  12. Reports
  13. ilmcmd
  14. Data Type Reference
  15. Data Type Reference for Hadoop

Connection Properties

Connection Properties

The following table describes connection options that you can configure at the data source level and the table level:
Connection Options
Description
Source Connection
A connection to the source database. Choose relational or HDFS from the list. Select the source connection from the list.
For Hadoop sources, you can select a Hive or an HDFS connection.
Source Type
Appears if flat file sources are present. You can choose the following source file types:
  • Direct. For source files that contain the source data.
  • Indirect. For source files that contain a list of files. When you select Indirect, the Integration Service finds the file list and reads each listed file when it runs the session.
Source File Directory Path
The path to the flat file source directory. Appears if flat file sources are present.
Source File Name
The name of the source file. Required if the source is a flat file. Default is <name of selected source>.dat.
Target Connection
A connection to the target database or the target file. Choose variable, relational, or flat file from the list. Select a target connection or variable name from the list. For Hadoop targets, you can select a Hive or an HDFS connection.
Output Filename
The name of the target file. Required if the target is a flat file. Default is <name of selected source>.out.
File Encoding
The file encoding type. Required if the target is a flat file. If the source is a flat file, the default type is what the flat file contains.
If the source is relational, default is MS Windows Latin 1 (ANSI), superset of Latin1. You can select the type of flat file encoding that you want in the target.
File Format
The format of a flat file. Required if the target is a flat file.
You can choose one of the following options:
  • Fixed Width. The width of the columns is fixed. You cannot specify a column delimiter.
  • Delimited. You can limit the width of the columns. Specify a column delimiter.
Default is Delimited.
Column Delimiter
A character that separates columns of data. Required if the source is a flat file and if the file format is delimited. Default is a comma (,).
Row Separator
A character that separates rows of data. Required if the source is a flat file. Default is \012 LF (\n).
Optional Quotes
Select No Quotes, Single Quote, or Double Quotes. If you select a quote character, the Integration Service ignores delimiter characters within the quote characters. Therefore, the Integration Service uses quote characters to escape the delimiter.
For example, a source file uses a comma as a delimiter and contains the following row:
342-3849, ‘Smith, Jenna’, ‘Rockville, MD’, 6.
If you select the optional single quote character, the Integration Service ignores the commas within the quotes and reads the row as four fields.
If you do not select the optional single quote, the Integration Service reads six separate fields.
When the Integration Service reads two optional quote characters within a quoted string, it treats them as one quote character. For example, the Integration Service reads the following quoted string as
I’m going tomorrow:
2353, ‘I’’m going tomorrow’, MD
Additionally, if you select an optional quote character, the Integration Service reads a string as a quoted string if the quote character is the first character of the field.
You can improve session performance if the source file does not contain quotes or escape characters.
Include Headers
Optional. You can choose to include the headers in the target flat file. Default is Yes.