tabsdatak.conn.bigquery
BigQueryColumnSpec | |
BigQueryDest | BigQuery destination for @subscriber -- one output slot per table. |
BigQueryDestConn | BigQuery connection. |
BigQueryTableNameSpec | |
BigQueryTableNamesSpec | |
CloudLocation | Abstract base for a BigQuery staging location. |
CredentialsSpec | The credential type for BigQuery connections: GCPJson (service-account JSON key). |
DatasetSpec | |
DestCfgKey | |
DestCfgSpec | |
GCSLocation | GCS staging area for BigQueryDest. |
IfTableExistsSpec | |
MergeCfg | How if_table_exists="merge" matches incoming rows onto a target table. |
MergeCfgSpec | One MergeCfg per entry in BigQueryDest.tables, in the same order. |
MergeColumnSpec | |
MergeColumnsSpec | |
ProjectSpec | |
SchemaEvolutionEngineSpec | Which machinery evolves the target's schema. |
SchemaEvolutionSpec |
BigQueryColumnSpec
type_aliasBigQueryColumnSpec: str
BigQueryTableNameSpec
type_aliasBigQueryTableNameSpec: str
BigQueryTableNamesSpec
type_aliasBigQueryTableNamesSpec: list[BigQueryTableNameSpec]
Resolved type:
list[str]
CredentialsSpec
type_aliasCredentialsSpec: GCPJson
The credential type for BigQuery connections: GCPJson
(service-account JSON key).
DatasetSpec
type_aliasDatasetSpec: StrOrSecretSpec
Resolved type:
str | Secret
DestCfgKey
type_aliasDestCfgKey: Literal['bigquery.logging_level', 'bigquery.schema_evolution_engine']
DestCfgSpec
type_aliasDestCfgSpec: Mapping[DestCfgKey, Any]
Resolved type:
Mapping[Literal['bigquery.logging_level', 'bigquery.schema_evolution_engine'], Any]
IfTableExistsSpec
type_aliasIfTableExistsSpec: Literal['append', 'replace', 'merge']
MergeCfgSpec
type_aliasMergeCfgSpec: list[MergeCfg]
One MergeCfg per entry in BigQueryDest.tables, in the same order.
A list even for a single table, so that reading a merge config off a destination never depends on how many tables it happens to write.
MergeColumnSpec
type_aliasMergeColumnSpec: BigQueryColumnSpec
Resolved type:
str
MergeColumnsSpec
type_aliasMergeColumnsSpec: list[BigQueryColumnSpec]
Resolved type:
list[str]
ProjectSpec
type_aliasProjectSpec: StrOrSecretSpec
Resolved type:
str | Secret
SchemaEvolutionEngineSpec
type_aliasSchemaEvolutionEngineSpec: Literal['native', 'iceberg']
Which machinery evolves the target's schema. "native" leans on
BigQuery's own schema_update_options on the load job; "iceberg" has the
connector diff the target against the incoming batch and emit the ALTER
statements itself.
SchemaEvolutionSpec
type_aliasSchemaEvolutionSpec: Literal['update', 'strict']