English
  • Data Engineering Integration 10.1.1 HotFix 1
  • All Products

Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in the Hadoop Environment
  5. Mapping Objects in the Hadoop Environment
  6. Monitoring Mappings in the Hadoop Environment
  7. Mappings in the Native Environment
  8. Profiles
  9. Native Environment Optimization
  10. Data Type Reference
  11. Function Reference
  12. Parameter Reference
  13. Multiple Blaze Instances on a Cluster

User Guide

User Guide

Back Next

Queuing Configuration

Queuing Configuration

The following table describes the Hadoop connection properties you configure to direct a job to a specific YARN scheduler queue:
Property
Description
YARN Queue Name
The Blaze engine connection property to specify a YARN scheduler queue name. The name is case sensitive.
Spark Execution Parameter
The Spark engine connection property to specify a YARN scheduler queue name.
Use the following format:
spark.yarn.queue=<YARN queue name>
The following table describes the Hive connection property you configure to direct a job to a specific YARN scheduler queue:
Property
Description
Data Access Connection String
The Hive connection string to specify the queue name for Hive SQL override mappings on the Blaze engine.
Use the following format:
  • MapReduce.
    mapred.job.queue.name=<YARN queue name>
  • Tez.
    tez.queue.name=<YARN queue name>
For example,
jdbc:hive2://business.com:10000/default;principal=hive/_HOST@INFAKRB?mapred.job.queue.name-root.test
The following table describes the JDBC connection property you configure to direct a job to a specific YARN scheduler queue:
Property
Description
Sqoop Arguments
The Sqoop connection-level argument to direct a MapReduce job to a specific YARN queue.
Use the following format:
-Dmapred.job.queue.name=<YARN queue name>
If you do not direct the job to a specific queue, the Spark engine uses the default queue.