Table of Contents

Search

  1. Preface
  2. Advanced clusters
  3. Setting up AWS
  4. Setting up Google Cloud
  5. Setting up Microsoft Azure
  6. Setting up a self-service cluster
  7. Setting up a local cluster
  8. Advanced configurations
  9. Troubleshooting
  10. Appendix A: Command reference

Advanced Clusters

Advanced Clusters

Cluster budget estimates

Cluster budget estimates

CLAIRE uses the target average cost per hour to determine how to create a cluster and control cluster infrastructure costs. It uses the maximum cost per hour to optimize the maximum reachable number of worker nodes based on the workload that the cluster runs.
When CLAIRE isn't familiar with the workload that the cluster runs, it uses a default minimum and maximum number of worker nodes to start the cluster for the first time. As CLAIRE collects and processes cluster metadata to learn about the typical cluster workload, it updates the worker nodes up to a maximum reachable number of worker nodes based on the cluster budget. If your workload is smaller than expected, the cluster might have fewer worker nodes than it started with.
You can use the following tables to estimate how many worker nodes your cluster might have based on your budget. Currency values are in USD.

Optimized for cost

The following table lists the minimum and maximum number of worker nodes on a cluster that's optimized for cost based on a given budget:
Target average cost per hour
Maximum cost per hour
Default number of worker nodes
Maximum reachable number of worker nodes
$1
$2
Min: 1
Max: 3
Min: 1
Max: 5
$1
$5
Min: 1
Max: 5
Min: 1
Max: 13
$4
$10
Min: 1
Max: 14
Min: 1
Max: 28
$4
$15
Min: 1
Max: 17
Min: 1
Max: 42
If Spot Instances are enabled, the cluster always uses a minimum of one worker node so that CLAIRE can add Spot Instances to the cluster as needed. If you disable Spot Instances, the minimum number of worker nodes might change.

Optimized for performance

The following table lists the minimum and maximum number of worker nodes on a cluster that's optimized for performance based on a given budget:
Target average cost per hour
Maximum cost per hour
Default number of worker nodes
Maximum reachable number of worker nodes
$1
$5
Min: 1
Max: 7
Min: 1
Max: 9
$5
$10
Min: 5
Max: 15
Min: 9
Max: 18
$5
$15
Min: 5
Max: 22
Min: 9
Max: 28
$10
$20
Min: 9
Max: 31
Min: 18
Max: 38

0 COMMENTS

We’d like to hear from you!