Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Edge Data Streaming
  3. Licenses
  4. Using Informatica Administrator
  5. Creating and Managing the Edge Data Streaming Service
  6. Edge Data Streaming Entity Types
  7. Edge Data Streaming Nodes
  8. Data Connections
  9. Working With Data Flows
  10. Managing the Edge Data Streaming Components
  11. Security
  12. High Availability
  13. Disaster Recovery
  14. Monitoring Edge Data Streaming Entities
  15. Appendix A: Troubleshooting
  16. Appendix B: Frequently Asked Questions
  17. Appendix C: Regular Expressions
  18. Appendix D: Command Line Program
  19. Appendix E: Configuring Edge Data Streaming to Work With a ZooKeeper Observer
  20. Appendix F: Glossary

User Guide

User Guide

Insert String Transformation Type

Insert String Transformation Type

Use the Insert String transformation type to insert strings into a record. Insert strings by building an expression of tokens. An Insert String transformation does not perform conditional processing, so it transforms and forwards all the records that it receives.

Insert String Properties

You can configure the following properties for the Insert String transformation type:
Entity Name
Name of the transformation. Maximum length is 32 characters.
Description
Description of the transformation. Maximum length is 256 characters.
String Expression
Token expression that describes how to transform each record.
Apply Transformation On
Select the source service, target service, or aggregator on which you want to apply the transformation.
Statistics
You can collect and monitor the following statistics:
  • Events Received
  • Bytes Received
  • Events Sent
  • Bytes Sent
  • Time Taken for Transformation (Milliseconds)

Tokens to Use to Insert a String

Tokens begin with the pound sign (
#
). Use a built-in token to add a time stamp, host name, or delimiter. Use the custom-string token to add a custom string to the record that you want to transform.
EDS
also provides a token for the input data, and you must include that token in your expression. Delimiters are optional.
Use the following tokens to construct an expression:
  • #HOSTNAME
    . Name of the host on which the source service runs.
  • #TIMESTAMP
    . System time, in milliseconds, recorded from the host that runs the source. The time stamp indicates the time at which the transformation transformed the record.
  • #DATA
    . Data to transform.
  • #<custom_string>
    . Custom string to insert.
  • #LF
    . Line feed delimiter.
  • #CRLF
    . Carriage return line feed delimiter.
  • #TIMEUUID.
    Unique identifier to append or prepend to the event based on timestamp and IP address.
  • #RANDOMUUID
    . Random unique identifier to append or prepend to the event.
You can insert a token multiple times in an expression. For example, you can insert the host name twice, as follows:
#HOSTNAME#DATA#HOSTNAME
EDS
does not validate token expressions. Use the following rules to verify that the token expression is valid:
  • The token must begin with the pound sign (
    #
    ).
  • Use only upper case characters in the token. For example, enter
    #HOSTNAME
    , and not
    #hOSTNAME
    . If you try to insert a host name with the token
    #hOSTNAME
    ,
    EDS
    considers
    hOSTNAME
    as a custom string. Custom string tokens can contain both uppercase and lowercase characters. If all the characters in a string use uppercase, verify that the string does not match the strings in the built-in tokens, such as
    HOSTNAME
    or
    TIMESTAMP
    .
  • Insert delimiter tokens at the end of your expression.
  • Always include the
    #DATA
    token.
  • Do not use an expression that includes only the
    #DATA
    token.
If you specify an erroneous token expression for an Insert String transformation, it forwards the record to the targets without performing any transformation.

Sample Token Expressions

The following token expression prefixes the host name and the system time to the input data:
#HOSTNAME#TIMESTAMP#DATA
The following token expression appends the custom string
MyCustomString
to the input data:
#DATA#MyCustomString
The following example appends a line feed delimiter to the input data:
#DATA#LF
The following example appends a unique identifier based on timestamp and IP address to the input data:
#DATA#TIMEUUID
The following example appends a random unique identifier to the input data:
#DATA#RANDOMUUID
If you are transforming raw data, you cannot predict where the strings that you specify in the token expression will appear in a line of data. If the source service breaks a line down into blocks, the transformation appends and prefixes strings to each block of raw data. After transformation, the line includes multiple instances of the prefixed and appended strings.
For example, if you configure the Insert String transformation to prefix the time stamp and append the host name to data, and the source service breaks a line down into three data blocks, the transformed line includes multiple instances of the time stamp and host name strings, as follows:
<timestamp><first_line_fragment><hostname><timestamp><second_line_fragment><hostname><timestamp><third_line_fragment><hostname>

0 COMMENTS

We’d like to hear from you!