Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in the Hadoop Environment
  5. Mapping Objects in the Hadoop Environment
  6. Monitoring Mappings in the Hadoop Environment
  7. Mappings in the Native Environment
  8. Profiles
  9. Native Environment Optimization
  10. Data Type Reference
  11. Function Reference
  12. Parameter Reference
  13. Multiple Blaze Instances on a Cluster

Step 1. Collect the Data

Step 1. Collect the Data

Identify the data sources from which you need to collect the data.
Big Data Management provides several ways to access your data in and out of Hadoop based on the data types, data volumes, and data latencies in the data.
You can use PowerExchange adapters to connect to multiple big data sources. You can schedule batch loads to move data from multiple source systems to HDFS without the need to stage the data. You can move changed data from relational and mainframe systems into HDFS or the Hive warehouse. For real-time data feeds, you can move data off message queues and into HDFS.
You can collect the following types of data:
  • Transactional
  • Interactive
  • Log file
  • Sensor device
  • Document and file
  • Industry format


Updated July 03, 2018