Version: 2.0.0

S3Location

class

class S3Location(
    bucket: S3BucketSpec,
    region: AwsRegionSpec,
    credentials: AwsAccessSecretKey,
    base_path: CloudRelativePathSpec = '/',
    cfg: CfgSpec | None = None,
)

Bases: CloudLocation

Categories: destination

S3 staging area for DruidDest.

The plugin uploads parquet here, then issues a Druid ingestion spec referencing the S3 input source.

Parameters

parameter

bucketS3BucketSpec (str | Secret)

A valid S3 bucket name.

parameter

regionAwsRegionSpec (str | Secret)

A valid AWS region, e.g. us-east-1.

parameter

credentialsAwsAccessSecretKey

AwsAccessSecretKey (access key id / secret access key).

parameter

base_pathCloudRelativePathSpec (str | Secret)

Object-key prefix from the bucket root, e.g. /staging/druid; starts with /, has no trailing / and no empty segments (//) (the leading / is trimmed when forming the key). Defaults to /.

parameter

cfgCfgSpec | None (dict | None)

Optional connector config for the underlying S3 client (see CfgSpec).

#

Parameters​

#

#

#

#

#

Parameters