tabsdatak.conn.kafka

AwsGlueSchemaRegistry	AWS Glue schema registry attached to a KafkaStreamSrcConn.
AwsGlueSchemaRegistryCredentialsSpec
ConfluentSchemaRegistry	Confluent-style schema registry attached to a KafkaStreamSrcConn.
ConfluentSchemaRegistryCredentialsSpec
ConfluentSchemaRegistryUrlNameSpec
KafkaCredentialsSpec
KafkaGroupSpec
KafkaMessageFormatSpec
KafkaServersSpec
KafkaStreamSrc	Kafka streaming source for @stream_publisher -- one batch per rollover.
KafkaStreamSrcConn	Kafka connection used by KafkaStreamSrc.
KafkaTopicSpec
Protobuf	Protobuf payload marker carrying the message type name.
RegistryNameSpec
SchemaNameSpec
SchemaRegistrySpec
SchemaSpec
SrcCfgKey
SrcCfgSpec

---

AwsGlueSchemaRegistryCredentialsSpec

type_alias

AwsGlueSchemaRegistryCredentialsSpec: AwsAccessSecretKey

---

ConfluentSchemaRegistryCredentialsSpec

type_alias

ConfluentSchemaRegistryCredentialsSpec: UserPassword

---

ConfluentSchemaRegistryUrlNameSpec

type_alias

ConfluentSchemaRegistryUrlNameSpec: StrOrSecretSpec

Resolved type:

str | Secret

---

KafkaCredentialsSpec

type_alias

KafkaCredentialsSpec: UserPassword

---

KafkaGroupSpec

type_alias

KafkaGroupSpec: StrOrSecretSpec

Resolved type:

str | Secret

---

KafkaMessageFormatSpec

type_alias

KafkaMessageFormatSpec: Union[Literal['avro', 'json'], Protobuf]

Resolved type:

Literal['avro', 'json'] | Protobuf

---

KafkaServersSpec

type_alias

KafkaServersSpec: StrOrSecretSpec

Resolved type:

str | Secret

---

KafkaTopicSpec

type_alias

KafkaTopicSpec: str

---

Protobuf

class

class Protobuf(message_name: str)

Protobuf payload marker carrying the message type name.

Used as the data_format of a KafkaStreamSrc when ingesting Protobuf payloads (the "avro" / "json" string variants cover the other wire formats).

Parameters:

parameter

message_namestr

Fully-qualified protobuf message name (e.g. "com.example.UserEvent") -- the descriptor lookup key used at deserialization time.

---

RegistryNameSpec

type_alias

RegistryNameSpec: StrOrSecretSpec

Resolved type:

str | Secret

---

SchemaNameSpec

type_alias

SchemaNameSpec: StrOrSecretSpec

Resolved type:

str | Secret

---

SchemaRegistrySpec

type_alias

SchemaRegistrySpec: Union[ConfluentSchemaRegistry, AwsGlueSchemaRegistry]

Resolved type:

ConfluentSchemaRegistry | AwsGlueSchemaRegistry

---

SchemaSpec

type_alias

SchemaSpec: str

---

SrcCfgKey

type_alias

SrcCfgKey: Literal['kafka.consume_timeout_seconds', 'kafka.connection_timeout_seconds', 'kafka.logging_level', 'kafka.time_rollover_seconds', 'kafka.size_rollover_mb', 'kafka.messages_rollover']

---

SrcCfgSpec

type_alias

SrcCfgSpec: Mapping[SrcCfgKey, Any]

Resolved type:

Mapping[Literal['kafka.consume_timeout_seconds', 'kafka.connection_timeout_seconds', 'kafka.logging_level', 'kafka.time_rollover_seconds', 'kafka.size_rollover_mb', 'kafka.messages_rollover'], Any]