Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Open Table Connector

Open Table Connector

Prerequisites

Prerequisites

Before you create an Open Table connection, complete the prerequisites.

Using AWS Glue Catalog and Amazon S3 Storage to interact with Apache Iceberg or Delta Lake tables

If you use an AWS Glue Catalog and Amazon S3 Storage to interact with Apache Iceberg or Delta Lake tables, you need to have access to the following AWS services that manage the tables on AWS:
  • AWS Glue Catalog: AWS Glue Catalog manages the metadata associated with the Apache Iceberg or Delta Lake tables.
  • Amazon S3 Storage: Amazon S3 stores the Apache Iceberg or Delta Lake tables containing actual records in columnar format, organized in partitioned directories.
  • Amazon Athena JDBC driver: Amazon Athena JDBC driver connects to the AWS Glue Catalog to access Apache Iceberg or Delta Lake tables metadata and perform SQL queries on data stored in Amazon S3 storage.
You need to create separate policies to access these services.

Using Hive Metastore catalog and Microsoft Azure Delta Lake Storage Gen2 to interact with Apache Iceberg tables

If you use a Hive Metastore catalog and Microsoft Azure Delta Lake Storage Gen2 to interact with Apache Iceberg tables, you need to have access to the following services that manage the tables on Microsoft Azure Delta Lake Storage Gen2:
  • Hive Metastore catalog: Hive Metastore catalog manages the metadata associated with the Apache Iceberg tables.
  • Microsoft Azure Delta Lake Storage Gen2: Microsoft Azure Delta Lake Storage Gen2 stores the Apache Iceberg tables containing actual records in columnar format, organized in partitioned directories.
  • Hive JDBC driver: Hive JDBC driver connects to the Hive Metastore catalog to access Apache Iceberg tables metadata and perform SQL queries on data stored in Microsoft Azure Delta Lake Storage Gen2.

Using Hive Metastore catalog and Amazon S3 storage to interact with Apache Iceberg tables

If you use a Hive Metastore catalog and Amazon S3 storage to interact with Apache Iceberg tables, you need to have access to the following services that manage the tables on Amazon S3 storage:
  • Hive Metastore catalog: Hive Metastore catalog manages the metadata associated with the Apache Iceberg tables.
  • Amazon S3 storage: Amazon S3 stores the Apache Iceberg tables containing actual records in columnar format, organized in partitioned directories.
  • Hive JDBC driver: Hive JDBC driver connects to the Hive Metastore catalog to access Apache Iceberg tables metadata and perform SQL queries on data stored in Amazon S3 storage.

Using REST catalog and Amazon S3 to interact with Apache Iceberg tables

If you use a REST catalog such as Polaris catalog and Amazon S3 storage to interact with Apache Iceberg tables, you need to have access to the following services that manage the tables on Amazon S3 storage:
  • REST catalog: REST catalog manages the metadata associated with the Apache Iceberg tables.
  • Amazon S3 storage: Amazon S3 stores the Apache Iceberg tables containing actual records in columnar format, organized in partitioned directories.

0 COMMENTS

We’d like to hear from you!