Table des matières

Search

  1. Preface
  2. Introduction aux transformations
  3. Ports de transformation
  4. Caches de transformation
  5. Transformation Outil de validation des adresses
  6. Transformation Agrégation
  7. Transformation Association
  8. Transformation Exception d'enregistrements incorrects
  9. Transformation Convertisseur de casse
  10. Transformation Classeur
  11. Transformation Comparaison
  12. Transformation Consolidation
  13. Transformation Masquage des données
  14. Transformation Processeur de données
  15. Transformation Décision
  16. Transformation Exception d'enregistrements dupliqués
  17. Transformation Expression
  18. Transformation filtre
  19. Transformation Hiérarchique à relationnel
  20. Transformation Java
  21. Référence de l'API de transformation Java
  22. Expressions Java
  23. Transformation jointure
  24. Transformation Générateur de clés
  25. Transformation Libellé
  26. Transformation Recherche
  27. Caches de recherche
  28. Cache de recherche dynamique
  29. Transformation Correspondance
  30. Transformations Correspondance dans l'analyse de champ
  31. Transformations de correspondance dans l'analyse d'identité
  32. Transformation Fusion
  33. Transformation Normaliseur
  34. Transformation Analyseur
  35. Transformation Python
  36. Transformation Rang
  37. Transformation Lecture
  38. Transformation Relationnel à hiérarchique
  39. Transformation Consommateur de service Web REST
  40. Transformation Routeur
  41. Transformation Générateur de séquence
  42. Transformation Trieur
  43. Transformation SQL
  44. Transformation Normalisation
  45. Transformation Union
  46. Transformation Stratégie de mise à jour
  47. Transformation Consommateur de service Web
  48. Analyse des messages SOAP du service Web
  49. Génération des messages SOAP du service Web
  50. Transformation moyenne pondérée
  51. Transformation Écriture
  52. Délimiteurs de transformation

Developer Transformation Guide

Developer Transformation Guide

Transformations in the Native and Hadoop Environments

Transformations in the Native and Hadoop Environments

Mappings that run in the Hadoop environment can return different results than mappings that run in the native environment.
Consider the following processing differences:
  • Hadoop uses distributed processing and processes data on different nodes. Each node does not have access to the data that is being processed on other nodes. As a result, the Hadoop execution engine might not be able to determine the order in which the data originated. So, when you run a mapping in a Hadoop environment and you run the same mapping in the native environment, both mappings return correct results, but the results might not be identical.
  • Each of the run-time engines in the Hadoop environment can process mapping logic differently. In the Hadoop environment, Informatica transformations might be fully supported, supported with restrictions, or not supported. Similarly, in the native environment, some Informatica transformations and transformation behavior might not be supported.
The following table lists transformations and support for different engines in a Hadoop environment:
Transformation
Blaze Engine
Spark Engine
Hive Engine
Transformations not listed in this table are not supported in the Hadoop environment.
Address Validator
Supported
Supported*
Supported
Aggregator
Supported
Supported
Supported
Case Converter
Supported
Supported*
Supported
Classifier
Supported
Supported*
Supported
Comparison
Supported
Supported*
Supported
Consolidation
Supported
Supported*
Supported
Data Masking
Supported
Supported
Supported
Data Processor
Supported
Not supported
Supported
Decision
Supported
Supported*
Supported
Expression
Supported
Supported
Supported
Filter
Supported
Supported
Supported
Java
Supported
Supported
Supported
Joiner
Supported
Supported
Supported
Key Generator
Supported
Supported*
Supported
Labeler
Supported
Supported*
Supported
Lookup
Supported
Supported
Supported
Match
Supported
Supported*
Supported
Merge
Supported
Supported*
Supported
Normalizer
Supported
Supported
Supported
Parser
Supported
Supported*
Supported
Python
Not supported
Supported
Not supported
Rank
Supported
Supported
Supported
Router
Supported
Supported
Supported
Sequence Generator
Supported
Supported*
Not supported
Sorter
Supported
Supported
Supported
Standardizer
Supported
Supported*
Supported
Union
Supported
Supported
Supported
Update Strategy
Supported
Supported*
Supported
Weighted Average
Supported
Supported*
Supported
*Not supported for Big Data Streaming on the Spark engine. For more information about Big Data Streaming transformations, see the
Big Data Streaming User Guide
.