Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Mappings
  4. Sources
  5. Targets
  6. Transformations
  7. Data Preview
  8. Cluster Workflows
  9. Profiles
  10. Monitoring
  11. Hierarchical Data Processing
  12. Hierarchical Data Processing Configuration
  13. Hierarchical Data Processing with Schema Changes
  14. Intelligent Structure Models
  15. Stateful Computing
  16. Appendix A: Connections
  17. Appendix B: Data Type Reference
  18. Appendix C: Function Reference

Step 1. Collect the Data

Step 1. Collect the Data

Identify the data sources from which you need to collect the data.
Big Data Management provides several ways to access your data in and out of Hadoop based on the data types, data volumes, and data latencies in the data.
You can use PowerExchange adapters to connect to multiple big data sources. You can schedule batch loads to move data from multiple source systems to HDFS without the need to stage the data. You can move changed data from relational and mainframe systems into HDFS or the Hive warehouse. For real-time data feeds, you can move data off message queues and into HDFS.
You can collect the following types of data:
  • Transactional
  • Interactive
  • Log file
  • Sensor device
  • Document and file
  • Industry format


Updated July 10, 2020