GCSDest
class GCSDest(
paths: DestPathsSpec,
format: DestFileFormat = DestFileFormat.AUTO,
format_cfg: DestFormatCfgSpec | None = None,
dest_cfg: DestCfgSpec | None = None,
)
Bases: Dest
Categories: destination
GCS destination for @subscriber -- one target file per path.
Parameters
Target paths relative to the connection's base_path,
one write slot per entry. Each path is relative (no leading
/), must not end with /, and must not contain empty
segments (//). Globs are not allowed; the tokens
${EXEC_PLAN_ID}, ${TRX_ID} and ${EXEC_PLAN_TS}
are substituted at write time. Backslashes and NUL are not
allowed.
formatDestFileFormatOutput format -- one of AUTO, CSV, JSON,
AVRO, PARQUET. AUTO (the default) infers it from
the file extension.
format_cfgDestFormatCfgSpec | None (dict[DestFileFormat, dict[Literal['separator', 'quote_char', 'eol_char', 'include_header', 'datetime_format', 'date_format', 'time_format', 'float_scientific', 'float_precision', 'null_value', 'quote_style', 'maintain_order'], Any] | dict] | None)Optional per-format writer options (dest-side keys
only), keyed by the DestFileFormat.
dest_cfgDestCfgSpec | None (Mapping[Literal['tabsdata.file.chunk_size'], Any] | None)Optional connector config; supports the key
tabsdata.file.chunk_size.
Methods
validatedef validate()
Cross-field validation of format_cfg (dest side).
Called by the framework; raises GCSValidateException on
failure.