Hadoop Files V2 Connector

Back Next

Rules and guidelines for file formats

You must set the appropriate source and target properties when you select the file format types.

Use the following guidelines when you select a file format type:

The

Object

field in the source properties from which you want to read data should be same as the source object specified in the

File path

field in advanced source properties.

If you write data to a complex file target and the File path field is mapped to any of the source fields, the file name in the

Object

field in the target properties should be different from the target

File Name

specified in the in advanced target properties.

You cannot write data to a complex file object in Avro, Parquet, or JSON file format using

Create Target

option, if one of the field name is FilePath in the source schema.

You cannot read and write nested and multi-line indented JSON files.

You can use the following JSON file structure to read data from and write data to a complex file object in JSON file format:

{"Field Name1": "value", "Field Name2": "value", "Field Name3": "value",..........,"Field Name n": "value"}

[\{"Field Name1": "value", "Field Name2": "value", "Field Name3": "value",..........,"Field Name n": "value"},\{"Field Name1": "value", "Field Name2": "value", "Field Name3": "value",..........,"Field Name n": "value"},\{"Field Name1": "value", "Field Name2": "value", "Field Name3": "value",..........,"Field Name n": "value"}]

Rename Saved Search

Table of Contents

Hadoop Files V2 Connector

Hadoop Files V2 Connector

Rules and guidelines for file formats

Rules and guidelines for file formats