Expression Transformation on the Databricks Spark Engine
Expression Transformation on the Databricks Spark Engine
Mapping validation fails in the following situations:
The transformation contains stateful variable ports.
The transformation contains unsupported functions in an expression.
If an expression results in numerical errors, such as division by zero or SQRT of a negative number, it returns a null value and rows do not appear in the output. In the native environment, the expression returns an infinite or an NaN value.