Data Integration Performance Tuning

Back Next

Secure Agent machine sizing requirements for advanced mode

For a Secure Agent that processes mappings in advanced mode, consider Secure Agent machine requirements for optimal performance.

At a minimum, the Secure Agent requires 4 CPUs, 16 GB of memory, and 100 GB of disk space. For optimal processing, use an SSD.

The following table lists the optimal Secure Agent configuration based on the number of concurrent Spark tasks that the Secure Agent processes:

Number of concurrent Spark tasks	CPU and memory	JVM heap size
0-250 Spark tasks	8 CPUs and 32 GB memory	2 GB
250-500 Spark tasks	16 CPUs and 64 GB memory On AWS, use 8 CPUs and 32 GB memory.	4 GB On AWS, use 2 GB.

The JVM heap size is set to 2 GB by default. Increase the heap size to avoid out of memory errors.

Watch

Comments

0 COMMENTS

We’d like to hear from you! Log in to comment.