Table of Contents

Search

  1. Preface
  2. Part 1: Version 10.5.4 - 10.5.4.x
  3. Part 2: Version 10.5.3 - 10.5.3.x
  4. Part 3: Version 10.5.2 - 10.5.2.1.x
  5. Part 4: Version 10.5.1 - 10.5.1.1
  6. Part 5: Versions 10.5 - 10.5.0.1
  7. Part 6: Versions 10.4.1 - 10.4.1.3
  8. Part 7: Versions 10.4 - 10.4.0.2
  9. Part 8: Versions 10.2.2 - 10.2.2 HotFix 1
  10. Part 9: Version 10.2.1
  11. Part 10: Version 10.2 - 10.2 HotFix 2

What's New and Changed (10.5.4.0.1)

What's New and Changed (10.5.4.0.1)

Spark Monitoring

Spark Monitoring

Effective in version 10.2.1, the Spark executor listens on a port for Spark events as part of Spark monitoring support and it is not required to configure the SparkMonitoringPort.
The Data Integration Service has a range of available ports, and the Spark executor selects a port from the available range. During failure, the port connection remains available and you do not need to restart the Data Integration Service before running the mapping.
The custom property for the monitoring port is retained. If you configure the property, the Data Integration Service uses the specified port to listen to Spark events.
Previously, the Data Integration Service custom property, the Spark monitoring port could configure the Spark listening port. If you did not configure the property, Spark Monitoring was disabled by default.

0 COMMENTS

We’d like to hear from you!