Version: 2.0.0

GCSLocation

class

class GCSLocation(
    bucket: GCSBucketSpec,
    credentials: GCPJson,
    base_path: CloudRelativePathSpec = '/',
    cfg: CfgSpec | None = None,
)

Bases: CloudLocation

Categories: destination

GCS staging area for BigQueryDest.

The plugin uploads parquet here, then runs a load_table_from_uri load job against BigQuery referencing the object.

Parameters

parameter

bucketGCSBucketSpec (str | Secret)

A valid GCS bucket name.

parameter

credentialsGCPJson

GCP service-account JSON credentials.

parameter

base_pathCloudRelativePathSpec (str | Secret)

Object-key prefix from the bucket root; starts with /, has no trailing / and no empty segments (//) (the leading / is trimmed when forming the key). Defaults to /.

parameter

cfgCfgSpec | None (dict | None)

Optional connector-config dict for the GCS client.

#

Parameters​

#

#

#

#

Parameters