BigQueryDestConn

class

class BigQueryDestConn(
    staging: GCSLocation,
    credentials: CredentialsSpec,
    project: ProjectSpec | None = None,
    dataset: DatasetSpec | None = None,
    entity_whitelist: EntityWhitelistSpec | None = None,
    conn_cfg: CfgSpec | None = None,
)

Bases: Conn

Categories: destination

BigQuery connection.

Registered on a collection; the runtime resolves it and hands it to the plugin at run time. Each string field accepts a plain string or a Secret.

Parameters

parameter

stagingGCSLocation

A GCSLocation used as the parquet staging bucket for load jobs.

parameter

credentialsCredentialsSpec (GCPJson)

GCP service-account JSON credentials (GCPJson).

parameter

projectProjectSpec | None (str | Secret | None)

Optional default GCP project id (6-30 characters, lowercase letters, digits and hyphens, starting with a letter, ending alphanumeric). Required when dataset is set.

parameter

datasetDatasetSpec | None (str | Secret | None)

Optional default BigQuery dataset id (1-1024 characters, letters, digits and underscores).

parameter

entity_whitelistEntityWhitelistSpec | None (list[str] | None)

Optional list of regex patterns narrowing which tables the connector considers; None (the default) filters nothing.

parameter

conn_cfgCfgSpec | None (dict | None)

Optional connector-config dict (see CfgSpec).

Methods

method

validate

def validate()

Cross-field validation: dataset requires project.

Called by the framework; raises BigQueryValidateException.