Use storage auto-scaling to dynamically change the amount of disk space that is available to process jobs. Jobs require disk space based on the data logic and the data volume in the job.
Enable worker node auto-scaling.
Use worker node auto-scaling to dynamically change the number of nodes that are available to process jobs.
Spot Instances provide the same performance as On-Demand Instances but at a lower price. However, they might not always be available. Use Spot Instances with a frequency of interruption that is less than 5%. For a list of Spot Instances and their frequency of interruption, see AWS's
Spot Instance advisor.
Development and QA environments can use Spot Instances to save costs during internal tests and debugging. Avoid Spot Instances for jobs that have a strict SLA.