Effective in version 10.5, the Spark engine writes NULL values to the target when the mapping contains certain invalid values.
The Spark engine writes NULL values in the following situations:
The
terms
argument in PV, FV, PMT, and RATE finance functions passes a 0 value. The value of
terms
must be an integer greater than 0.
The
month
argument in the MAKE_DATE_TIME function passes an invalid value. The value of
month
must be from 1 to 12.
Previously, the Spark engine wrote random values.
The Data Integration Service rejects rows with invalid values. If you want rows with invalid values to be rejected and not written to the target, run the mapping in the native environment.