Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Edge Data Streaming
  3. Licenses
  4. Using Informatica Administrator
  5. Creating and Managing the Edge Data Streaming Service
  6. Edge Data Streaming Entity Types
  7. Edge Data Streaming Nodes
  8. Data Connections
  9. Working With Data Flows
  10. Managing the Edge Data Streaming Components
  11. Security
  12. High Availability
  13. Disaster Recovery
  14. Monitoring Edge Data Streaming Entities
  15. Troubleshooting
  16. Frequently Asked Questions
  17. Regular Expressions
  18. Command Line Program
  19. Configuring Edge Data Streaming to Work With a ZooKeeper Observer
  20. Glossary

User Guide

User Guide

Troubleshooting Edge Data Streaming High Availability

I get the following exception in the EDS Node log file:
2013-12-31 15:27:10,524 ERROR [HDFS-41] com.informatica.um.binge.writer.TargetWrapper - Exception in target
	org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: failed to create/append/truncate file /<...>/LFdelimiter/hdfs_json.txt for DFSClient_NONMAPREDUCE_1329143897_18 on client 10.75.40.149 because pendingCreates is non-null but no leases found.
		
This error occurs when the new primary node does not have write access on the HDFS target. When a EDS Node goes down and another EDS Node comes up, the HDFS target does not release the lock while writing to the target service.
To resolve this error, make sure that the file names do not conflict if you configure high availability. Include the infa.timestamp variable in the file name in the Destination field of the HDFS target properties. For example: hdfs://<HDFS hostname>:<port>/<foldername>/demo_#infa.timestamp.txt


Updated March 19, 2019


Explore Informatica Network