in your organization, set up your cloud environment so that the Secure Agent can create an
advanced cluster
.
Complete the following tasks:
Complete the prerequisites. Verify that you have the necessary privileges and learn about resource access in the cloud environment.
Create storage locations for cluster files. The advanced cluster requires Amazon S3 storage to store staging, log, and initialization script files.
Optionally, create a VPC and subnets. If you don't create a VPC and subnets and specify them in your
advanced configuration
, the cluster creates a default VPC and subnet when you run a job on the cluster.
Create user-defined security groups for Amazon EC2. Security groups define inbound and outbound rules for traffic into and out of the load balancer, master nodes, and worker nodes. You can also use default security groups instead of user-defined security groups.
Download and install the Secure Agent on a Linux virtual machine on Amazon EC2. Set up the agent on a virtual machine that meets the minimum resource requirements.
Allow domains in AWS. The cluster requires to access certain domains to fetch artifacts and to access sources and targets.
Create IAM roles. The cluster operator, Secure Agent, master nodes, and worker nodes use IAM roles and policies to provide authentication when the cluster runs a job.
Optionally, configure environment variables on the Secure Agent machine. Some environment variables are required to run shell commands.
Configure the
Elastic Server
. The
Elastic Server
manages the advanced cluster and the jobs that run on the cluster.