Integration Guide

10.5.4.1
- 10.5.5
- 10.5.4
- 10.5.3
- 10.5.2
- 10.5.1
- 10.5
- 10.4.1
- 10.4.0
- 10.2.2 HotFix 1
- 10.2.2 Service Pack 1
- 10.2.2
- 10.2.1

Back Next

Step 1. Create an IAM Role and Policy for S3 Access

Using S3 resources with mappings that run on a Databricks cluster requires you to create IAM roles and policies in your AWS account.

Log in to the AWS account that has administrator access to the Databricks cluster that you want to integrate with Data Engineering Integration.

Optionally create a new IAM role to correspond to an S3 access policy. You can create a policy or use an existing one.

Use the following steps to create the IAM role:

Select the IAM service, then

Roles

Create Role

The Create Roles wizard opens.

Under

Select type of trusted entity

, select

AWS service

Under

Choose the service that will use this role

, select

EC2

Click

Next: Permissions

Next: Tags

Next: Review

In the Role name field, type a role name, then click

Create role

Grant access to the S3 bucket that contains the resources for the mapping to access. To do this, attach an inline policy to the role that you want to use.

In the

Permissions

tab, click

Inline policy

Select the

JSON

tab.

Paste the following JSON statement:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": [
        "s3:ListBucket"
      ],
     "Resource": [
        "arn:aws:s3:::<s3-bucket-name>"
      ]
    },
    {
      "Effect": "Allow",
      "Action": [
        "s3:PutObject",
        "s3:GetObject",
        "s3:DeleteObject",
        "s3:PutObjectAcl"
      ],
      "Resource": [
         "arn:aws:s3:::<s3-bucket-name>/*"
      ]
    }
  ]
}

Edit the pasted JSON statement with the name of the S3 bucket, then click

Review

In the

Name

field, type a name for the policy, then click

Create policy

The

Summary

window opens.

In the

Summary

window, select and copy the Instance Profile ARN string for use later in this process.

The following image shows the

Summary

window with redacted ARN strings:

Rename Saved Search

Table of Contents

Integration Guide

Integration Guide

Step 1. Create an IAM Role and Policy for S3 Access

Step 1. Create an IAM Role and Policy for S3 Access