Table of Contents

Search

  1. Preface
  2. Advanced clusters
  3. Setting up AWS
  4. Setting up Google Cloud
  5. Setting up Microsoft Azure
  6. Setting up a self-service cluster
  7. Setting up a local cluster
  8. Advanced configurations
  9. Troubleshooting
  10. Appendix A: Command reference

Advanced Clusters

Advanced Clusters

Step 12. Create a staging connection (optional)

Step 12. Create a staging connection (optional)

If the Secure Agent machine doesn't have a system-assigned managed identity or a single user-assigned managed identity that can access the cluster staging location, create a staging connection to the staging location so that the
advanced cluster
can share staging data with the Data Integration Server.
  1. In Administrator, open the
    Connections
    page.
  2. Create a connection to Azure Data Lake Storage Gen2.
    In the connection properties, enter the storage account name of the location that you created to store staging files in Step 2. Create storage accounts for cluster files.
  3. Open the
    Advanced Clusters
    page.
  4. Create an
    advanced configuration
    or edit the existing
    advanced configuration
    for the cluster.
  5. On the
    Platform Configuration
    tab, configure the staging location to specify the same storage account name that you entered in the connection properties. You can specify a folder path within the bucket.
  6. On the
    Runtime Properties
    tab, add the property
    clusterconfig.stagingConnectionName
    and set the value to the name of the connection.

0 COMMENTS

We’d like to hear from you!