Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Administration
  3. Authentication
  4. Running Mappings on a Cluster with Kerberos Authentication
  5. Authorization
  6. Cluster Configuration
  7. Cloud Provisioning Configuration
  8. Data Integration Service Processing
  9. Appendix A: Connections Reference
  10. Appendix B: Monitoring REST API

Execution Pools

Execution Pools

Execution pools define the number of jobs that can run concurrently on the Data Integration Service.
Configure execution pool sizes to limit the number of jobs that can run concurrently. You can configure native, Hadoop, and on-demand execution pool sizes.
The execution pool size acts as a threshold for concurrent jobs. When the number of job requests exceeds the threshold, the Data Integration Service stops accepting new jobs.
When the number of concurrent jobs exceeds the native and Hadoop execution pool size, the Data Integration Service stops taking jobs from the queue until the number of concurrently running jobs falls below the threshold you configured.
When the number of concurrent jobs exceeds the on-demand execution pool threshold, the Data Integration Service rejects on-demand job requests. When the number of concurrently running jobs falls below the threshold you configured, you can resume running on-demand jobs and re-run rejected jobs.
Configure execution pool sizes in Data Integration Service Execution Options settings.

0 COMMENTS

We’d like to hear from you!