Skip to content

Amazon S3

S3 object discovery and ingestion connector using aiobotocore.

Property Value
Key s3
Source type s3
Status native
Active by default yes
Default cache strategy semantic_first
Capabilities supports_discovery, supports_incremental_sync, supports_ingestion, supports_write

Secret fields should be given as a reference, <field>_ref, such as env://NAME, rather than a literal.

Key Secret
bucket no
prefix no
region_name no
endpoint_url no
aws_access_key_id_ref no
aws_secret_access_key_ref no
aws_access_key_id yes; prefer aws_access_key_id_ref
aws_secret_access_key yes; prefer aws_secret_access_key_ref

Offered when a source is created with default roles. Edit them to fit.

Effect Action Resource type Pattern
deny * * *
Effect Action Resource type Pattern
allow storage.bucket.list storage.bucket *
allow storage.prefix.list storage.prefix *
Effect Action Resource type Pattern
allow storage.bucket.list storage.bucket *
allow storage.prefix.list storage.prefix *
allow storage.object.read storage.object *
allow storage.object.metadata.read storage.object *
allow discovery.search discovery.asset *
allow discovery.asset.read discovery.asset *
allow storage.object.delete storage.object *
Effect Action Resource type Pattern
allow storage.bucket.list storage.bucket *
allow storage.prefix.list storage.prefix *
allow storage.object.read storage.object *
allow storage.object.metadata.read storage.object *
allow discovery.search discovery.asset *
allow discovery.asset.read discovery.asset *
Effect Action Resource type Pattern
allow storage.bucket.list storage.bucket *
allow storage.prefix.list storage.prefix *
allow storage.object.read storage.object *
allow storage.object.metadata.read storage.object *
allow discovery.search discovery.asset *
allow discovery.asset.read discovery.asset *
allow storage.object.write storage.object *