English
MDM - Relate 360 All Products

Table of Contents

Search

  1. Preface
  2. Installing Informatica MDM - Relate 360
  3. Configuring Relate 360
  4. Configuring Security
  5. Setting Up the Environment to Process Streaming Data
  6. Configuring Distributed Search
  7. Packaging and Deploying the RESTful Web Services

Installation and Configuration Guide

Installation and Configuration Guide

Back Next

Step 3. Deploy Relate 360 on Storm

Step 3. Deploy
Relate 360
 on Storm

You must deploy
Relate 360
 on Storm to link, consolidate, or tokenize the input data. Run the
setup_realtime.sh
 script located in the following directory to deploy
Relate 360
 on Storm:
/usr/local/mdmbdrm-<Version Number>
Use the following command to run the
setup_realtime.sh
 script: 
setup_realtime.sh

--config=configuration_file_name

--rule=matching_rules_file_name

--useStorm

[--consolidate=consolidation_rules_file_name]

[--instanceName=instance_name]

[--spoutName=spout_name]

[--workers=number_of_worker_processes]

[--zookeeper=zookeeper_connection_string]

[--skipCreateTopic]

[--partitions=number_of_partitions]

[--replica=number_of_replicas]

[--outputTopic=output_topic_name]
The following table describes the options and arguments that you can specify to run the
setup_realtime.sh
 script:
Option
Argument
Description
--config
configuration_file_name
Absolute path and file name of the configuration file that you create.
--rule
matching_rules_file_name
Absolute path and file name of the matching rules file that you create.
The values in the matching rules file override the values in the configuration file.
--useStorm
Indicates to deploy
Relate 360
 on Storm.
--consolidate
consolidation_rules_file_name
Optional.
Absolute path and file name of the consolidation rules file.
Use the consolidation rules file only when you want to consolidate the linked data and create preferred records for all the clusters.
--instanceName
topology_name
Optional. Name for the topology that processes the input data.
Default is
BDRMIngest-topology
.
--spoutName
spout_name
Optional. Name for the spout that reads the input data and emits the input data into the topology.
Default is
BDRMIngest-spout
.
--workers
number_of_worker_processes
Optional. Number of worker processes for the topology. Each worker process is a physical JVM and runs a subset of all the tasks for the topology.
Default is 3.
--zookeeper
zookeeper_connection_string
Optional. Connection string to access the ZooKeeper server.
Use the following format for the connection string:
<Host Name>:<Port>[/<chroot>]
The connection string uses the following parameters:
  • Host Name
    . Host name of the ZooKeeper server.
  • Port
    . Port on which the ZooKeeper server listens.
  • chroot
    . Optional. ZooKeeper root directory that you configure in Kafka. Default is /.
The following example connection string uses the default ZooKeeper root directory:
server1.domain.com:2182
The following example connection string uses the user-defined ZooKeeper root directory:
server1.domain.com:2182/kafkaroot
If you use an ensemble of ZooKeeper servers, you can specify multiple ZooKeeper servers separated by commas.
--skipCreateTopic
Required if the topic that you specify in the configuration file already exists in Kafka. Indicates to skip creating the topic.
By default, the script creates the topic.
--partitions
number_of_partitions
Optional. Number of partitions for the topic. Use partitions to split the data in the topic across multiple brokers. Default is 1.
--replica
number_of_replicas
Optional. Number of replicas that you want to create for the topic. Use replicas for high availability purposes.
Default is 1.
--outputTopic
output_topic_name
Optional. Name of the topic in Kafka to which you want to publish the output messages. By default, the output messages are not published.
The script does not create the output topic, so ensure that you create the output topic to publish the output messages to it.
For example, the following command runs the script that deploys
Relate 360
 on Storm: 
setup_realtime.sh --config=/usr/local/conf/config_big.xml --rule=/usr/local/conf/matching_rules.xml --useStorm --consolidate=/usr/local/conf/consolidationfile.xml --instanceName=Prospects --zookeeper=10.28.10.345 --skipCreateTopic --partitions=3 --replica=2 --spoutName=Insurance --workers=5 --outputTopic=InsuranceOutput

Updated June 27, 2019

Download Guide
Send Feedback
Explore Informatica Network
Communities
Knowledge Base
Success Portal