tabsdata

AvroFormat	Avro file format.
AWSGlue
AwsGlueSchemaRegistry	Configuration for AWS Glue Schema Registry.
AwsGlueSchemaRegistryCredentialsSpec	Credentials class to access an S3 bucket using access key credentials (access key id and secret access key).
AzureAccountKeyCredentials	Credentials class to access Azure using account key credentials (account name and account key).
AzureConfig	Configuration for staging files in Azure Blob Storage.
AzureDestination	Azure-file-based data outputs.
AzureDestination.chunk	Trigger the exporting of the data to local parquet chunks.
AzureDestination.stream	Trigger the exporting of the data.
AzureSource	Azure-file-based data inputs.
AzureSource.chunk	Trigger the import of the data.
BigQueryConn	For connection configuration to BigQueryDest.
BigQueryDest	BigQuery based data outputs.
BigQueryDest.stream	Trigger the exporting of the data.
CdcConn	Base connection configuration for Change Data Capture (CDC) connectors.
CdcTrigger	Base StageTrigger for Change Data Capture (CDC) connectors.
CdcTrigger.collect_tables
CdcTrigger.run	Continuously runs the stage trigger logic using the received context to trigger and monitor executions.
ClickHouseConn	Represents a connection configuration for ClickHouse with cloud-staged bulk loading.
ClickHouseDest	Destination plugin for writing data to ClickHouse using cloud-staged bulk loading.
ClickHouseDest.stream	Write each result as a Parquet file and bulk load it into ClickHouse via the cloud staging area.
concat	Combine multiple TableFrames by stacking their rows.
ConfluentSchemaRegistry	Configuration for Confluent Schema Registry.
ConfluentSchemaRegistryCredentialsSpec	Represents credentials consisting of a user and a password.
Conn	Represents a connection configuration.
CronTrigger	Represents a cron-based trigger for scheduling Tabsdata publishers, subscribers and transformers.
CSVFormat	CSV file format.
CustomException	Custom exception for execution errors.
DatabricksDestination	Databricks based data outputs.
DatabricksDestination.chunk	Trigger the exporting of the data to local parquet chunks.
DatabricksDestination.stream	Trigger the exporting of the data.
DatabricksDestination.write	This method is used to write the files to the databricks.
Db2CdcConn	Db2 CDC connection configuration.
Db2CdcTrigger	A CdcTrigger that captures changes from a Db2 database using SQL Replication.
Db2CdcTrigger.collect_tables
Db2Conn	Represents a connection configuration to Db2.
Db2Src	Source plugin for reading data from Db2.
Db2Src.stream	Execute the query and load the results as a list of TableFrames.
DestinationPlugin	Parent class for subscriber connectors.
DestinationPlugin.chunk	Trigger the exporting of the data to local parquet chunks.
DestinationPlugin.stream	Trigger the exporting of the data.
DestinationPlugin.write	Given a file or a list of files, write to the desired destination.
DruidConn	Represents a connection configuration for Apache Druid with cloud-staged bulk loading.
DruidDest	Destination plugin for writing data to Apache Druid using cloud-staged bulk loading.
DruidDest.stream	Write each result as a Parquet file and bulk load it into Druid via the cloud staging area.
EnvironmentSecret	Secrets class representing a secret obtained from an environment variable in the server.
GCPServiceAccountKeyCredentials	Credentials class to store the credentials needed to access GCS using account key credentials (service account key).
GCSConfig	Configuration for staging files in Google Cloud Storage.
GCSDestination	GCS-file-based data outputs.
GCSDestination.chunk	Trigger the exporting of the data to local parquet chunks.
GCSDestination.stream	Trigger the exporting of the data.
GCSSource	GCS-file-based data inputs.
GCSSource.chunk	Trigger the import of the data.
HashiCorpSecret	Secrets class representing a secret stored in Hashicorp Vault.
HMACCredentials	Generic HMAC credentials consisting of an access key and a secret key.
KafkaConn	Kafka Consumer Connection configuration.
KafkaCredentialsSpec	Represents credentials consisting of a user and a password.
KafkaTrigger	A StageTrigger that consumes messages from a Kafka topic and stages them.
KafkaTrigger.run	Run the Kafka stage trigger to consume messages, buffer them, and stage them based on rollover conditions.
lit	Expression for the given literal value.
LocalFileDestination	LocalFile-based data outputs.
LocalFileDestination.chunk	Trigger the exporting of the data to local parquet chunks.
LocalFileDestination.stream	Trigger the exporting of the data.
LocalFileSource	Local-file-based data inputs.
LocalFileSource.chunk	Trigger the import of the data.
LogFormat	Log file format.
MariaDBConn	Represents a connection configuration to MariaDB.
MariaDBDest	Destination plugin for writing data to MySQL.
MariaDBDest.stream	Store the results into the MariaDB database.
MariaDBDestination	MariaDB-based data outputs.
MariaDBDestination.chunk	Store the results in the SQL destination.
MariaDBDestination.write	Given a file or a list of files, write to the desired destination.
MariaDBSource	MariaDB-based data inputs.
MariaDBSource.chunk	Trigger the import of the data.
MariaDBSrc	Source plugin for reading data from MariaDB.
MariaDBSrc.stream	Execute the query and load the results as a list of TableFrames.
MongoDBDestination	MongoDB-based data outputs.
MongoDBDestination.chunk	Trigger the exporting of the data to local parquet chunks.
MongoDBDestination.stream	Trigger the exporting of the data.
MongoDBDestination.write	This method is used to write the files to the database.
MSSQLConn	Represents a connection configuration to Microsoft SQL Server (MSSQL).
MSSQLDestination	MSSQL-based data outputs.
MSSQLDestination.chunk	Trigger the exporting of the data to local parquet chunks.
MSSQLDestination.stream	Trigger the exporting of the data.
MSSQLDestination.write	This method is used to write the files to the database.
MSSQLSource	Microsoft SQL Server based data inputs.
MSSQLSource.chunk	Execute the query and yield chunks of data.
MSSQLSrc	Source Plugin for reading data from a Microsoft SQL Server (MSSQL) database.
MSSQLSrc.stream	Execute the query and load the results as a list of TableFrames.
MySQLCdcConn	MySQL CDC connection configuration.
MySQLCdcTrigger	A CdcTrigger that captures changes from a MySQL database using binlog replication.
MySQLCdcTrigger.collect_tables
MySQLConn	Represents a connection configuration to MySQL.
MySQLDest	Destination plugin for writing data to MySQL.
MySQLDest.stream	Store the results into the MySQL database.
MySQLDestination	MySQL-based data outputs.
MySQLDestination.chunk	Store the results in the SQL destination.
MySQLDestination.write	Given a file or a list of files, write to the desired destination.
MySQLSource	MySQL-based data inputs.
MySQLSource.chunk	Trigger the import of the data.
MySQLSrc	Source plugin for reading data from MySQL.
MySQLSrc.stream	Execute the query and load the results as a list of TableFrames.
NDJSONFormat	JSON file format.
OracleConn	Represents a connection configuration to Oracle.
OracleDestination	Oracle-based data outputs.
OracleDestination.chunk	Store the results in the SQL destination.
OracleDestination.write	Given a file or a list of files, write to the desired destination.
OracleSource	Oracle-based data inputs.
OracleSource.chunk	Trigger the import of the data.
OracleSrc	Source plugin for reading data from Oracle.
OracleSrc.stream	Execute the query and load the results as a list of TableFrames.
ParquetFormat	Parquet file format.
PostgresCdcConn	PostgreSQL CDC connection configuration.
PostgresCdcTrigger	A CdcTrigger that captures changes from a PostgreSQL database using WAL logical replication.
PostgresCdcTrigger.collect_tables
PostgresConn	Represents a connection configuration to Postgres.
PostgresDest	Destination plugin for writing data to PostgreSQL.
PostgresDest.stream	Store the results into the PostgreSQL database.
PostgresDestination	Postgres-based data outputs.
PostgresDestination.chunk	Store the results in the SQL destination.
PostgresDestination.write	Given a file or a list of files, write to the desired destination.
PostgresSource	Postgres-based data inputs.
PostgresSource.chunk	Trigger the import of the data.
PostgresSrc	Source plugin for reading data from Postgres.
PostgresSrc.stream	Execute the query and load the results as a list of TableFrames.
publisher	Decorator to define a function to publish data to Tabsdata.
S3AccessKeyCredentials	Credentials class to access an S3 bucket using access key credentials (access key id and secret access key).
S3Config	Configuration for staging files in Amazon S3.
S3Destination	S3-file-based data outputs.
S3Destination.chunk	Trigger the exporting of the data to local parquet chunks.
S3Destination.stream	Trigger the exporting of the data.
S3Source	S3-file-based data inputs.
S3Source.chunk	Trigger the import of the data.
SalesforceReportSource	Salesforce Reports based data inputs.
SalesforceReportSource.chunk	Trigger the import of the data.
SalesforceSource	Salesforce (SOQL query) based data inputs (not Salesforce Reports).
SalesforceSource.chunk	Trigger the import of the data.
SalesforceTokenCredentials	Credentials class to store the credentials needed to access a Salesforce using a username, a password and a token.
SnowflakeDestination	Snowflake based data outputs.
SnowflakeDestination.chunk	Trigger the exporting of the data to local parquet chunks.
SnowflakeDestination.stream	Trigger the exporting of the data.
SnowflakeDestination.write	This method is used to write the files to the database.
SourcePlugin	Parent class for publisher connectors.
SourcePlugin.chunk	Trigger the import of the data.
SourcePlugin.stream
Stage	Inputs that have been placed in a stage, usually from a StageTrigger.
Stage.stream
StageTrigger
StageTrigger.run	Continuously runs the stage trigger logic using the received context to trigger and monitor executions.
StarRocksConn	Represents a connection configuration for StarRocks with cloud-staged bulk loading.
StarRocksDest	Destination plugin for writing data to StarRocks using cloud-staged bulk loading.
StarRocksDest.stream	Write each result as a Parquet file and bulk load it into StarRocks via the cloud staging area.
subscriber	Decorator to define a function to subscribe to data present in Tabsdata.
TableFrame	> Private Functions
TableFrame.assert_has_cols	Ensures that the (non-system) columns in the TableFrame match the expected columns.
TableFrame.cast	Cast columns to a new data type.
TableFrame.clear	Clears all rows of the TableFrame preserving the schema.
TableFrame.columns
TableFrame.drop	Discard columns from the TableFrame.
TableFrame.drop_nans	Drop rows with NaN values.
TableFrame.drop_nulls	Drop rows with null values.
TableFrame.empty	Creates an empty (no column - no row) TableFrame.
TableFrame.extract_as_columns	Extract a slice of rows from the table as a column-oriented dictionary.
TableFrame.extract_as_rows	Extract a slice of rows from the TableFrame as a list of dictionaries.
TableFrame.fill_nan	Replace all NaN values in the TableFrame with the given value.
TableFrame.fill_null	Replace all null values in the TableFrame with the given value.
TableFrame.filter	Filter the TableFrame based on the given predicates.
TableFrame.first	Return a TableFrame with the first row.
TableFrame.first_row	Return a tuple or dictionary with the first row, or None if no row.
TableFrame.from_dict	Creates tableframe from a dictionary, or None.
TableFrame.from_pandas	Creates tableframe from a pandas dataframe, or None.
TableFrame.from_polars	Creates tableframe from a polars dataframe or lazyframe, or None.
TableFrame.grok	Parse log text into structured fields using a Grok pattern.
TableFrame.group_by	Perform a group by on the TableFrame.
TableFrame.has_cols	Verifies the presence of (non-system) columns in the TableFrame.
TableFrame.has_same_schema	Verifies if the schema of the current TableFrame is same than the provided TableFrame.
TableFrame.head	Return a TableFrame with the first n rows.
TableFrame.is_empty	Checks if a TableFrame has no rows.
TableFrame.item	Returns a scalar value if the TableFrame contains exactly one user column and one row.
TableFrame.join	Join the TableFrame with another TableFrame.
TableFrame.last	Return a TableFrame with the last row.
TableFrame.last_row	Return a tuple or dictionary with the last row, or None if no row.
TableFrame.limit	Return a TableFrame with the first n rows.
TableFrame.rename	Rename columns from the TableFrame.
TableFrame.select	Select column(s) from the TableFrame.
TableFrame.slice	Return a TableFrame with a slice of the original TableFrame
TableFrame.sort	Sort the TableFrame by the given column(s) or expression(s).
TableFrame.tail	Return a TableFrame with the last n rows.
TableFrame.to_dict	Creates a dictionary from this tableframe.
TableFrame.to_pandas	Creates a pandas dataframe from this tableframe.
TableFrame.to_polars_df	Creates a polars dataframe from this tableframe.
TableFrame.to_polars_lf	Creates a polars lazyframe from this tableframe.
TableFrame.udf	Apply a user-defined function (UDF) to the columns resolved by expr.
TableFrame.unique	Deduplicate rows from the TableFrame.
TableFrame.unnest	Expand one or more struct columns so that each field within the struct becomes a separate column in the TableFrame.
TableFrame.with_columns	Add columns to the TableFrame.
TableInput	Table-based data inputs.
TableInput.stream
TableOutput	Table-based data outputs.
TabsdataFunction	Class to decorate a function with metadata and methods for use in a Tabsdata environment.
transformer	Decorator to define a function to transform data present in Tabsdata.
UserPasswordCredentials	Represents credentials consisting of a user and a password.