Amazon S3 Tables

Support for S3 Tables is currently experimental.

The iceberg extension supports reading Iceberg tables stored in Amazon S3 Tables.

Requirements

Install the following extensions:

INSTALL aws;
INSTALL httpfs;
INSTALL iceberg;

Connecting to Amazon S3 Tables

You can let DuckDB detect your AWS credentials and configuration based on the default profile in your ~/.aws directory by creating the following secret using the Secrets Manager:

CREATE SECRET (
    TYPE s3,
    PROVIDER credential_chain
);

Alternatively, you can set the values manually:

CREATE SECRET (
    TYPE s3,
    KEY_ID 'key_id',
    SECRET 'secret',
    REGION 'region'
);

Then, connect to the catalog using your S3 Tables ARN (available in the AWS Management Console) and the ENDPOINT_TYPE s3_tables option:

ATTACH 's3_tables_arn' AS my_s3_tables_catalog (
   TYPE iceberg,
   ENDPOINT_TYPE s3_tables
);

To check whether the attachment worked, list all tables:

SHOW ALL TABLES;

You can query a table as follows:

SELECT count(*)
FROM my_s3_tables_catalog.namespace_name.table_name;