tabsdatak.conn.databricks
CredentialsSpec | The credential type for Databricks connections: a bare Secret holding the personal access token (PAT). |
DatabricksColumnSpec | |
DatabricksDest | Databricks destination for @subscriber -- one output slot per table. |
DatabricksDestConn | Databricks workspace connection used by DatabricksDest. |
DatabricksSrc | Databricks source for @publisher -- one output slot per query. |
DatabricksSrcConn | Databricks workspace connection used by DatabricksSrc. |
DatabricksTableNameSpec | |
DatabricksTableNamesSpec | |
DatabricksTokenSpec | |
DestCfgKey | |
DestCfgSpec | |
HostUrlSpec | |
IdentifierSpec | |
IfTableExistsSpec | |
MergeCfg | How if_table_exists="merge" matches incoming rows onto a target table. |
MergeCfgSpec | One MergeCfg per entry in DatabricksDest.tables, in the same order. |
MergeColumnSpec | |
MergeColumnsSpec | |
QueriesSpec | |
SchemaEvolutionSpec | |
SrcCfgKey | |
SrcCfgSpec | |
VolumeSpec | |
WarehouseIdSpec | |
WarehouseSpec |
CredentialsSpec
type_aliasCredentialsSpec: DatabricksTokenSpec
Resolved type:
Secret
The credential type for Databricks connections: a bare Secret
holding the personal access token (PAT).
DatabricksColumnSpec
type_aliasDatabricksColumnSpec: str
DatabricksTableNameSpec
type_aliasDatabricksTableNameSpec: str
DatabricksTableNamesSpec
type_aliasDatabricksTableNamesSpec: list[DatabricksTableNameSpec]
Resolved type:
list[str]
DatabricksTokenSpec
type_aliasDatabricksTokenSpec: Secret
DestCfgKey
type_aliasDestCfgKey: Literal['databricks.logging_level']
DestCfgSpec
type_aliasDestCfgSpec: Mapping[DestCfgKey, Any]
Resolved type:
Mapping[Literal['databricks.logging_level'], Any]
HostUrlSpec
type_aliasHostUrlSpec: Secret
IdentifierSpec
type_aliasIdentifierSpec: StrOrSecretSpec
Resolved type:
str | Secret
IfTableExistsSpec
type_aliasIfTableExistsSpec: Literal['append', 'replace', 'merge']
MergeCfgSpec
type_aliasMergeCfgSpec: list[MergeCfg]
One MergeCfg per entry in DatabricksDest.tables, in the same order.
A list even for a single table, so that reading a merge config off a destination never depends on how many tables it happens to write.
MergeColumnSpec
type_aliasMergeColumnSpec: DatabricksColumnSpec
Resolved type:
str
MergeColumnsSpec
type_aliasMergeColumnsSpec: list[DatabricksColumnSpec]
Resolved type:
list[str]
QueriesSpec
type_aliasQueriesSpec: list[str]
SchemaEvolutionSpec
type_aliasSchemaEvolutionSpec: Literal['update', 'strict']
SrcCfgKey
type_aliasSrcCfgKey: Literal['databricks.logging_level', 'tabsdata.src_metadata.drop']
SrcCfgSpec
type_aliasSrcCfgSpec: Mapping[SrcCfgKey, Any]
Resolved type:
Mapping[Literal['databricks.logging_level', 'tabsdata.src_metadata.drop'], Any]
VolumeSpec
type_aliasVolumeSpec: StrOrSecretSpec
Resolved type:
str | Secret
WarehouseIdSpec
type_aliasWarehouseIdSpec: StrOrSecretSpec
Resolved type:
str | Secret
WarehouseSpec
type_aliasWarehouseSpec: StrOrSecretSpec
Resolved type:
str | Secret