Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in the Hadoop Environment
  5. Mapping Objects in the Hadoop Environment
  6. Processing Hierarchical Data on the Spark Engine
  7. Stateful Computing on the Spark Engine
  8. Monitoring Mappings in the Hadoop Environment
  9. Mappings in the Native Environment
  10. Profiles
  11. Native Environment Optimization
  12. Data Type Reference
  13. Complex File Data Object Properties
  14. Function Reference
  15. Parameter Reference

Function Support in a Hadoop Environment

Function Support in a Hadoop Environment

Some Informatica transformation language functions that are valid in the native environment might be restricted or unsupported in a Hadoop environment. Functions not listed in this table are supported on all engines without restrictions.
The following table lists functions and levels of support for functions on different engines in a Hadoop environment.
Function
Blaze Engine
Spark Engine
Hive Engine
ABORT
Not supported
Not supported
Not supported
ANY
Supported
Restricted
Restricted
ARRAY
Not supported
Supported
Not supported
AVG
Supported
Restricted
Restricted
CAST
Not supported
Supported
Not supported
COLLECT_LIST
Not supported
Supported
Not supported
CONCAT_ARRAY
Not supported
Supported
Not supported
COUNT
Supported
Restricted
Restricted
CREATE_TIMESTAMP_TZ
Supported
Not supported
Not supported
CUME
Not supported
Not supported
Not supported
DECOMPRESS
Supported
Restricted
Supported
ERROR
Not supported
Not supported
Not supported
FIRST
Not supported
Not supported
Not supported
GET_TIMEZONE
Supported
Not supported
Not supported
GET_TIMESTAMP
Supported
Not supported
Not supported
LAST
Not supported
Not supported
Not supported
LAG
Not supported
Restricted
Not supported
LEAD
Not supported
Restricted
Not supported
MAX (Dates)
Supported
Supported
Not supported
MAX (Numbers)
Supported
Restricted
Restricted
MAX (String)
Supported
Restricted
Restricted
METAPHONE
Supported
Restricted
Supported
MIN (Dates)
Supported
Supported
Not supported
MIN (Numbers)
Supported
Restricted
Restricted
MIN (String)
Supported
Restricted
Restricted
MOVINGAVG
Not supported
Not supported
Not supported
MOVINGSUM
Not supported
Not supported
Not supported
PERCENTILE
Supported
Restricted
Restricted
RESPEC
Not supported
Supported
Not supported
SIZE
Not supported
Supported
Not supported
STDDEV
Supported
Restricted
Restricted
STRUCT
Not supported
Supported
Not supported
STRUCT_AS
Not supported
Supported
Not supported
SUM
Supported
Restricted
Restricted
SYSTIMESTAMP
Supported
Restricted
Supported
TO_DECIMAL
Supported
Restricted
Restricted
TO_DECIMAL38
Supported
Restricted
Restricted
TO_TIMESTAMP_TZ
Supported
Not supported
Supported
UUID4
Supported
Supported
Restricted
UUID_UNPARSE
Supported
Supported
Restricted
VARIANCE
Supported
Restricted
Restricted


Updated November 09, 2018