Enable continuous tuning to silently monitor every run of the
mapping
task and adjust the Spark properties over time.
For example, you design a
mapping
task in your development environment and run initial tuning. When you migrate the
mapping
task to your production environment, you expect production loads to vary day-by-day. Continuous tuning analyzes the varying parameters to adjust the Spark properties.
During continuous tuning, CLAIRE analyzes all runs of the
mapping
task. The adjusted Spark properties override the Spark property values that are set in the
mapping
task. You can view the values of the adjusted Spark properties in the Spark driver and agent job logs.
When you copy or import a mapping task with continuous tuning enabled, continuous tuning restarts from the Spark properties that are set in the