Edge Data Streaming High Availability
- I get the following exception in the
EDS Node log file:
2013-12-31 15:27:10,524 ERROR [HDFS-41] com.informatica.um.binge.writer.TargetWrapper - Exception in target
org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: failed to create/append/truncate file /<...>/LFdelimiter/hdfs_json.txt for DFSClient_NONMAPREDUCE_1329143897_18 on client 10.75.40.149 because pendingCreates is non-null but no leases found.
This error occurs when the new primary node does not have write access on the HDFS target. When a
EDS Node goes down and another
EDS Node comes up, the HDFS target does not release the lock while writing to the target service.
To resolve this error, make sure that the file names do not conflict if you configure high availability. Include the
infa.timestamp variable in the file name in the
Destination field of the HDFS target properties. For example: