Table of Contents

Search

  1. Preface
  2. Introduction to Big Data Management Administration
  3. Authentication
  4. Running Mappings on a Cluster with Kerberos Authentication
  5. Authorization
  6. Cluster Configuration
  7. Cloud Provisioning Configuration
  8. Data Integration Service Processing
  9. Connections
  10. Multiple Blaze Instances on a Cluster
  11. Monitoring REST API

Big Data Management Administrator Guide

Big Data Management Administrator Guide

Execution Pools

Execution Pools

You can configure execution pool sizes to limit the number of jobs that can run concurrently. You can configure native, Hadoop, and on-demand execution pool sizes.
The execution pool size acts as a threshold. When the number of job requests exceeds the threshold, the Data Integration Service stops accepting new jobs.
When the number of concurrent jobs exceeds the native and Hadoop execution pool threshold, the Data Integration Service stops taking jobs from the queue until the number of concurrently running jobs falls below the threshold you configured.
When the number of concurrent jobs exceeds the on-demand execution pool threshold, the Data Integration Service rejects on-demand job requests. When the number of concurrently running jobs falls below the threshold you configured, you can resume running on-demand jobs and re-run rejected jobs.
Configure execution pool sizes in Data Integration Service Execution Options settings.

0 COMMENTS

We’d like to hear from you!