Table of Contents

Search

  1. Preface
  2. Advanced clusters
  3. Setting up AWS
  4. Setting up Google Cloud
  5. Setting up Microsoft Azure
  6. Setting up a self-service cluster
  7. Setting up a local cluster
  8. Advanced configurations
  9. Troubleshooting
  10. Appendix A: Command reference

Advanced Clusters

Advanced Clusters

Advanced clusters

Advanced clusters

An
advanced cluster
is a Kubernetes cluster that provides a distributed processing environment on the cloud. Fully-managed and self-service clusters can run data logic using a scalable architecture, while local clusters use a single node to quickly onboard projects for advanced use cases.
To use an
advanced cluster
, you perform the following steps:
  1. Set up your cloud environment so that the Secure Agent can connect to and access cloud resources.
  2. In Administrator, create an
    advanced configuration
    to define the cluster and the cloud resources.
  3. In Monitor, monitor cluster health and activity while developers in your organization create and run jobs on the cloud.
The following image shows the workflow that you use to get an advanced cluster up and running in your organization:
As an administrator, you set up the cloud environment and create an advanced configuration. Then, a developer creates a mapping in advanced mode and runs a mapping task. When the Secure Agent receives the job, it creates an advanced cluster or connects to a cluster and reports monitoring statistics while the job runs on the cloud. You can review the monitoring statistics to monitor cluster health and activity.

0 COMMENTS

We’d like to hear from you!