Skip to main content

Connect Amazon Athena preview

Your environment(s) must be on "Versionless" to use the Amazon Athena connection.

Connect dbt Cloud to Amazon's Athena interactive query service to build your dbt project. The following are the required and optional fields for configuring the Athena connection:

FieldOptionDescriptionTypeRequired?Example
AWS region nameregion_nameAWS region of your Athena instanceStringRequiredeu-west-1
Database (catalog)databaseSpecify the database (Data catalog) to build models into (lowercase only)StringRequiredawsdatacatalog
AWS S3 staging directorys3_staging_dirS3 location to store Athena query results and metadataStringRequireds3://bucket/dbt/
Athena workgroupwork_groupIdentifier of Athena workgroupStringOptionalmy-custom-workgroup
Athena Spark workgroupspark_work_groupIdentifier of Athena Spark workgroup for running Python modelsStringOptionalmy-spark-workgroup
AWS S3 data directorys3_data_dirPrefix for storing tables, if different from the connection's s3_staging_dirStringOptionals3://bucket2/dbt/
AWS S3 data naming conventions3_data_namingHow to generate table paths in s3_data_dirStringOptionalschema_table_unique
AWS S3 temp tables prefixs3_tmp_table_dirPrefix for storing temporary tables, if different from the connection's s3_data_dirStringOptionals3://bucket3/dbt/
Poll intervalpoll_intervalInterval in seconds to use for polling the status of query results in AthenaIntegerOptional5
Query retriesnum_retriesNumber of times to retry a failing queryIntegerOptional3
Boto3 retriesnum_boto3_retriesNumber of times to retry boto3 requests (e.g. deleting S3 files for materialized tables)IntegerOptional5
Iceberg retriesnum_iceberg_retriesNumber of times to retry iceberg commit queries to fix ICEBERG_COMMIT_ERRORIntegerOptional0

Development credentials

Enter your development (not deployment) credentials with the following fields:

FieldOptionDescriptionTypeRequiredExample
AWS Access Key IDaws_access_key_idAccess key ID of the user performing requestsStringRequiredAKIAIOSFODNN7EXAMPLE
AWS Secret Access Keyaws_secret_access_keySecret access key of the user performing requestsStringRequiredwJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
SchemaschemaSpecify the schema (Athena database) to build models into (lowercase only)StringRequireddbt
ThreadsthreadsIntegerOptional3
0