Common Content for Data Engineering
- Common Content for Data Engineering 10.5.3
- All Products
... -o option_name=value option_name=value ...
Property
| Description
|
---|---|
Name
| The name of the connection. The name is not case sensitive and must be unique within the domain. You can change this property after you create the connection. The name cannot exceed 128 characters, contain spaces, or contain the following special characters:~ ` ! $ % ^ & * ( ) - + = { [ } ] | \ : ; " ' < , > . ? /
|
ID
| String that the Data Integration Service uses to identify the connection. The ID is not case sensitive. It must be 255 characters or less and must be unique in the domain. You cannot change this property after you create the connection. Default value is the connection name.
|
Description
| Optional. The description of the connection. The description cannot exceed 4,000 characters.
|
Location
| The domain where you want to create the connection.
|
Type
| The Amazon S3 connection type.
|
Access Key
| Access key to access the Amazon S3 bucket. Provide the access key value based on the following authentication methods:
|
Secret Key
| Secret access key to access the Amazon S3 bucket.
The secret key is associated with the access key and uniquely identifies the account. Provide the access key value based on the following authentication methods:
|
IAM Role ARN
| The ARN of the IAM role assumed by the user to use the dynamically generated temporary security credentials.
Enter the value of this property if you want to use the temporary security credentials to access the AWS resources.
If you want to use the temporary security credentials with IAM authentication, do not provide the Access Key and Secret Key connection properties. If you want to use the temporary security credentials without IAM authentication, you must enter the value of the Access Key and Secret Key connection properties.
For more information about how to obtain the ARN of the IAM role, see the AWS documentation.
|
Folder Path
| The complete path to Amazon S3 objects. The path must include the bucket name and any folder name.
Do not use a slash at the end of the folder path. For example,
<bucket name>/<my folder name> .
|
Master Symmetric Key
| Optional. Provide a 256-bit AES encryption key in the Base64 format when you enable client-side encryption. You can generate a master symmetric key using a third-party tool.
|
S3 Account Type
| The type of the Amazon S3 account.
Select
Amazon S3 Storage or
S3 Compatible Storage .
Select the Amazon S3 storage option to use the Amazon S3 services. Select the S3 compatible storage option to specify the endpoint for a third-party storage provider such as Scality RING.
By default, Amazon S3 storage is selected.
|
REST Endpoint
| The S3 storage endpoint.
Specify the S3 storage endpoint in HTTP/HTTPs format when you select the S3 compatible storage option. For example,
http://s3.isv.scality.com .
|
Region Name
| Select the AWS region in which the bucket you want to access resides.
Select one of the following regions:
Default is US East (N. Virginia).
Not applicable for S3 compatible storage.
|
Customer Master Key ID
| Optional. Specify the customer master key ID or alias name generated by AWS Key Management Service (AWS KMS) or the Amazon Resource Name (ARN) of your custom key for cross-account access. You must generate the customer master key for the same region where Amazon S3 bucket reside.
You can specify any of the following values:
|
Federated SSO IdP
| SAML 2.0-enabled identity provider for the federated user single sign-on to use with the AWS account.
PowerExchange for Amazon S3 supports only the
ADFS 3.0 identity provider.
Select
None if you do not want to use federated user single sign-on.
|
Property
| Description
|
---|---|
Federated User Name
| User name of the federated user to access the AWS account through the identity provider.
|
Federated User Password
| Password for the federated user to access the AWS account through the identity provider.
|
IdP SSO URL
| Single sign-on URL of the identity provider for AWS.
|
SAML Identity Provider ARN
| ARN of the SAML identity provider that the AWS administrator created to register the identity provider as a trusted provider.
|
Role ARN
| ARN of the IAM role assumed by the federated user.
|