Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Edge Data Streaming
  3. Licenses
  4. Using Informatica Administrator
  5. Creating and Managing the Edge Data Streaming Service
  6. Edge Data Streaming Entity Types
  7. Edge Data Streaming Nodes
  8. Data Connections
  9. Working With Data Flows
  10. Managing the Edge Data Streaming Components
  11. Security
  12. High Availability
  13. Disaster Recovery
  14. Monitoring Edge Data Streaming Entities
  15. Appendix A: Troubleshooting
  16. Appendix B: Frequently Asked Questions
  17. Appendix C: Regular Expressions
  18. Appendix D: Command Line Program
  19. Appendix E: Configuring Edge Data Streaming to Work With a ZooKeeper Observer
  20. Appendix F: Glossary

User Guide

User Guide

Troubleshooting Edge Data Streaming High Availability

Troubleshooting
Edge Data Streaming
High Availability

I get the following exception in the
EDS Node
log file:
2013-12-31 15:27:10,524 ERROR [HDFS-41] com.informatica.um.binge.writer.TargetWrapper - Exception in target org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: failed to create/append/truncate file /<...>/LFdelimiter/hdfs_json.txt for DFSClient_NONMAPREDUCE_1329143897_18 on client 10.75.40.149 because pendingCreates is non-null but no leases found.
This error occurs when the new primary node does not have write access on the HDFS target. When a
EDS Node
goes down and another
EDS Node
comes up, the HDFS target does not release the lock while writing to the target service.
To resolve this error, make sure that the file names do not conflict if you configure high availability. Include the
infa.timestamp
variable in the file name in the
Destination
field of the HDFS target properties. For example:
hdfs://<HDFS hostname>:<port>/<foldername>/demo_#infa.timestamp.txt

0 COMMENTS

We’d like to hear from you!