Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Administration
  3. Authentication
  4. Running Mappings on a Cluster with Kerberos Authentication
  5. Authorization
  6. Cluster Configuration
  7. Cloud Provisioning Configuration
  8. Data Integration Service Processing
  9. Appendix A: Connections Reference
  10. Appendix B: Monitoring REST API

Data Engineering Administrator Guide

Data Engineering Administrator Guide

Refresh the Cluster Configuration

Refresh the Cluster Configuration

When property values change on the cluster, refresh the cluster configuration to import the changes. Similar to when you import the cluster configuration, you can refresh it either directly or from a .zip or .tar archive file.
You can refresh the cluster configuration from the Actions menu.
The refresh operation updates the cluster configuration in the following ways:
  • Unedited values of imported properties are refreshed with the value from the cluster.
  • The refresh operation refreshes the contents of the cluster configuration and properties in the connections that are associated with it, such as fs.defaultFS. For example, if you refresh a Hadoop cluster configuration from an archive file that does not contain one of the required *-site.xml files, the refresh cluster configuration drops the configuration set. If a missing *-site.xml file contained properties that get propagated to a connection, the refresh operation succeeds, but the connection refresh fails.
  • If you override an imported property value, the refresh operation refreshes the imported value and maintains the overridden value. The Administrator tool displays the updated imported value and the active override value.
  • If you override an imported property value, and the property is subsequently removed from the cluster, the refresh operation converts the property to a user-defined property.
  • User-defined properties that do not exist in the cluster are not affected.
  • If you configure a user-defined property that is subsequently configured on the cluster, the refresh operation converts the user-defined property to an imported property. The user-defined property value becomes an overridden value of the imported property.
  • If you deleted an imported property, the refresh operation imports the property again if it exists on the cluster.
If you refresh the cluster configuration while a mapping task is queued, the queued task uses outdated cluster configuration settings instead of the refreshed settings. This might happen when you manually refresh the cluster configuration, or start a task that automatically refreshes the cluster configuration. For best results, verify that all mapping tasks are complete before you refresh the cluster configuration.

0 COMMENTS

We’d like to hear from you!