Data Engineering Integration
- Data Engineering Integration 10.5.5
- All Products
Prompt
| Description
|
---|---|
1
| Cloudera. You can create a cluster configuration for a Cloudera cluster on either Cloudera Data Platform (CDP) or for Cloudera Distribution Hadoop (CDH).
|
2
| Hortonworks
|
3
| Azure HDInsight
|
4
| MapR. You must import MapR cluster configuration properties from an archive file.
|
5
| Amazon EMR. You must import Amazon EMR cluster configuration properties from an archive file.
|
6
| Databricks
|
7
| Google Dataproc
|
Hadoop Component
| Port
|
---|---|
HDFS read
| 50010
|
HDFS write
| 50020
|
Hive metastore
| 9083
|
HiveServer
| 10000
|
MySQL
| 3306
|
NameNode
| 8020
|
ResourceManager
| 8050
|
ResourceManager webapp
| 8088
|
ResourceTracker
| 8031
|
Scheduler address
| 8030
|
Shuffle HTTP
| 13562
|
ZooKeeper
| 2181
|
Property
| Description
|
---|---|
Host
| The host name or IP address of the cluster manager.
|
Port
| Port of the cluster manager.
|
User ID
| Cluster user name.
|
Password
| Password for the cluster user.
|
Cluster Name
| Name of the cluster. Use the display name if the cluster manager manages multiple clusters. If you do not provide a cluster name, the wizard imports information based on the default cluster.
|
Engine type
| If you specified a Cloudera cluster, the installer prompts for the engine type.
2 to set the engine type to MRv2.
Default is
1 .
|
Property
| Description
|
---|---|
Databricks domain
| Enter the URL of the Databricks cluster.
|
Databricks token ID
| Enter the token ID of the Databricks cluster.
|
Databricks cluster ID
| Enter the cluster ID of the Databricks cluster.
|