When you configure a mapping to read date or timestamp information from a string column and process the data with the default date/time format to write to Databricks Delta target, the mapping fails with the following error:

[ERROR] The Secure Agent failed to run the full pushdown query due to the following error: [Invalid timestamp: '12/31/1972 00:00:00.000001']

To resolve this issue, set the JVM option

-DHonorInfaDateFormat=true

for the Secure Agent.

Perform the following steps to configure the JVM option in Administrator:

Select
Administrator
Runtime Environments
.
On the Runtime Environments page, select the Secure Agent machine that runs the mapping.
Click
Edit
.
In the System Configuration Details section, select
Data Integration Server
as the Service and
DTM
as the Type.
Edit the JVMOption system property and set the value to
-DHonorInfaDateFormat=true
.
Click
Save
.

When you use IS_DATE(), IS_SPACES(), and IS_NUMBER() functions, the functions return 0 or 1 instead of True or False.

To resolve this issue, set the JVM option

-DDeltaSQLELTBooleanReturnAsString=true

for the Secure Agent.

Perform the following steps to configure the JVM option in Administrator:

Select
Administrator
Runtime Environments
.
On the Runtime Environments page, select the Secure Agent machine that runs the mapping.
Click
Edit
.
In the System Configuration Details section, select
Data Integration Server
as the Service and
DTM
as the Type.
Edit the JVMOption system property and set the value to
-DDeltaSQLELTBooleanReturnAsString=true
.
Click
Save
.