Table of Contents

Search

  1. Preface
  2. Advanced clusters
  3. Setting up AWS
  4. Setting up Google Cloud
  5. Setting up Microsoft Azure
  6. Setting up a self-service cluster
  7. Setting up a local cluster
  8. Advanced configurations
  9. Troubleshooting
  10. Appendix A: Command reference

Advanced Clusters

Advanced Clusters

Setting up AWS

Setting up AWS

Before you create an
advanced configuration
in your organization, set up your cloud environment so that the Secure Agent can create an
advanced cluster
.
Complete the following tasks:
  1. Complete the prerequisites. Verify that you have the necessary privileges and learn about resource access in the cloud environment.
  2. Create storage locations for cluster files. The advanced cluster requires Amazon S3 storage to store staging, log, and initialization script files.
  3. Optionally, create a VPC and subnets. If you don't create a VPC and subnets and specify them in your
    advanced configuration
    , the cluster creates a default VPC and subnet when you run a job on the cluster.
  4. Create user-defined security groups for Amazon EC2. Security groups define inbound and outbound rules for traffic into and out of the load balancer, master nodes, and worker nodes. You can also use default security groups instead of user-defined security groups.
  5. Download and install the Secure Agent on a Linux virtual machine on Amazon EC2. Set up the agent on a virtual machine that meets the minimum resource requirements.
  6. Allow domains in AWS. The cluster requires to access certain domains to fetch artifacts and to access sources and targets.
  7. Create IAM roles. The cluster operator, Secure Agent, master nodes, and worker nodes use IAM roles and policies to provide authentication when the cluster runs a job.
  8. Optionally, configure environment variables on the Secure Agent machine. Some environment variables are required to run shell commands.
  9. Configure the
    Elastic Server
    . The
    Elastic Server
    manages the advanced cluster and the jobs that run on the cluster.
To create an
advanced cluster
that uses a CLAIRE-powered configuration, see Additional setup for CLAIRE-powered configurations.
In an AWS environment, you can use a serverless runtime environment instead of performing these tasks and creating an
advanced configuration
. For more information, see
Runtime Environments
.

0 COMMENTS

We’d like to hear from you!