DruidDestConn

class

class DruidDestConn(
    overlord_url: UrlSpec,
    staging: CloudLocation,
    credentials: CredentialsSpec,
    conn_cfg: CfgSpec | None = None,
)

Bases: Conn

Categories: destination

Druid Overlord connection used by DruidDest.

Registered on a collection; the runtime resolves it and hands it to the plugin at run time.

Examples

A connection that stages parquet in S3 before Druid ingests it:

DruidDestConn(
    overlord_url="http://druid.example:8081",
    staging=S3Location(
        bucket="my-bucket",
        region="us-east-1",
        credentials=AwsAccessSecretKey(
            access_key_id=Secret("AKIA..."),
            secret_access_key=Secret("..."),
        ),
        base_path="/staging/druid",
    ),
    credentials=UserPassword(
        user=Secret("admin"),
        password=Secret("..."),
    ),
)

Parameters

parameter

overlord_urlUrlSpec (str | Secret)

Druid Overlord http(s):// URL, e.g. http://druid.example:8081. Accepts a plain string or a Secret.

parameter

stagingCloudLocation

Cloud staging area for parquet uploads -- an S3Location or AzBlobLocation.

parameter

credentialsCredentialsSpec (UserPassword)

UserPassword for Overlord HTTP basic auth.

parameter

conn_cfgCfgSpec | None (dict | None)

Optional connector config dict (see CfgSpec).