Performance tuning and best practices for Google BigQuery V2 Connector

Performance tuning and best practices for Google BigQuery V2 Connector

JVM heap size

JVM heap size

You can specify the amount of memory that the Secure Agent uses for each pmdtm process. Default is 64 MB.
If you use the default JVM heap size, the mapping fails with an out-of-memory error. You can increase the JVM heap size to improve the performance of the read and write operations.
The following graph shows the results and the recommended values for setting the JVM maximum heap size:
The performance optimizes by 30% when you increase the Java heap size.
For Google BigQuery V2 mappings and mapping tasks that read data from Google BigQuery, specify a JVM memory of -Xmx256m.
If you already configured a heap size value that is higher than 256 MB in the JVM options, do not change it to -Xmx256m.
Perform the following steps to configure the JVM memory:
  1. In Administrator, select the Secure Agent listed on the
    Runtime Environments
    tab.
  2. Click
    Edit
    .
  3. In the
    System Configuration Details
    section, select
    Data Integration Service
    as the service and
    DTM
    as the type.
  4. Edit the
    JVMOption1
    property, and enter
    -Xmx256m
    .
  5. Click
    Save
    .