Complete the prerequisites. Verify that you have the necessary privileges and learn about resource access in the cloud environment.
Create storage locations for cluster files. The advanced cluster requires Amazon S3 storage to store staging, log, and initialization script files.
Optionally, create a VPC and subnets. If you don't create a VPC and subnets and specify them in your
, the cluster creates a default VPC and subnet when you run a job on the cluster.
Create user-defined security groups for Amazon EC2. Security groups define inbound and outbound rules for traffic into and out of the load balancer, master nodes, and worker nodes. You can also use default security groups instead of user-defined security groups.
Download and install the Secure Agent on a Linux virtual machine on Amazon EC2. Set up the agent on a virtual machine that meets the minimum resource requirements.
Allow domains in AWS. The cluster requires to access certain domains to fetch artifacts and to access sources and targets.
Create IAM roles. The cluster operator, Secure Agent, master nodes, and worker nodes use IAM roles and policies to provide authentication when the cluster runs a job.
Optionally, configure environment variables on the Secure Agent machine. Some environment variables are required to run shell commands.
manages the advanced cluster and the jobs that run on the cluster.