Table of Contents

Search

  1. Preface
  2. Part 1: Version 10.4.0
  3. Part 2: Version 10.2.2
  4. Part 3: Version 10.2.1
  5. Part 4: Version 10.2
  6. Part 5: Version 10.1.1
  7. Part 6: Version 10.1

Sqoop

Sqoop

Effective in version 10.2.2, the following changes apply to Sqoop:
  • You can specify a file path in the Spark staging directory of the Hadoop connection to store temporary files for Sqoop jobs. When the Spark engine runs Sqoop jobs, the Data Integration Service creates a Sqoop staging directory within the Spark staging directory to store temporary files:
    <Spark staging directory>/sqoop_staging
    Previously, the Sqoop staging directory was hard-coded and the Data Integration Service used the following staging directory:
    /tmp/sqoop_staging
    For more information, see the
    Informatica Big Data Management 10.2.2 User Guide
    .
  • Sqoop mappings on the Spark engine use the OpenJDK (AzulJDK) packaged with the Informatica installer. You no longer need to specify the
    JDK Home Directory
    property for the Data Integration Service.
    Previously, to run Sqoop mappings on the Spark engine, you installed the Java Development Kit (JDK) on the machine that runs the Data Integration Service. You then specified the location of the JDK installation directory in the
    JDK Home Directory
    property under the Data Integration Service execution options in Informatica Administrator.

0 COMMENTS

We’d like to hear from you!