Search

Tuning and Sizing Guidelines for Data Engineering Integration (10.4.x)

Tuning and Sizing Guidelines for Data Engineering Integration (10.4.x)

Back Next

Sqoop Command Line Arguments

Sqoop Command Line Arguments

You can tune certain parameters to optimize performance of Sqoop readers and writers. Add the parameters in the JDBC connection or to Sqoop mappings.

The following table lists the parameters that you can tune:

Parameter	Applies To	Description
batch	Writer	Specifies that you can group the related SQL statements into a batch when you export data.
direct	Reader and writer	Specifies the direct import fast path when you import data from a relational source. Applies to Oracle and TDCH connectors.
Dsqoop.export.records.per.statement	Writer	Specifies to insert multiple rows with a single statement.
Enable primary key	Reader	Enables the primary key constraint on the source table to optimize performance when reading data from a source.
fetch-size	Reader	Specifies the number of entries that Sqoop can import at a time.
num-mappers	Reader and writer	Specifies the number of map tasks that can run in parallel.
compress or z	Reader	Enables compression.
Dmapreduce.map.java.opts	Reader	Specifies the Java options per statement if Java runs out of memory.
Dmapred.child.java.opts	Reader	Specifies the Java options per mapper if Java runs out of memory.

Tune the Sqoop Parameters

Watch

Comments

0 COMMENTS

We’d like to hear from you! Log in to comment.