Skip to main content
Version: 1.7.0

tabsdata

AvroFormatAvro file format.
AWSGlue
AwsGlueSchemaRegistryConfiguration for AWS Glue Schema Registry.
AwsGlueSchemaRegistryCredentialsSpecCredentials class to access an S3 bucket using access key credentials (access key id and secret access key).
AzureAccountKeyCredentialsCredentials class to access Azure using account key credentials (account name and account key).
AzureDestinationAzure-file-based data outputs.
AzureDestination.chunkTrigger the exporting of the data to local parquet chunks.
AzureDestination.streamTrigger the exporting of the data.
AzureSourceAzure-file-based data inputs.
AzureSource.chunkTrigger the import of the data.
BigQueryConnFor connection configuration to BigQueryDest.
BigQueryDestBigQuery based data outputs.
BigQueryDest.streamTrigger the exporting of the data.
concatCombine multiple TableFrames by stacking their rows.
ConfluentSchemaRegistryConfiguration for Confluent Schema Registry.
ConfluentSchemaRegistryCredentialsSpecRepresents credentials consisting of a user and a password.
ConnRepresents a connection configuration.
CronTriggerRepresents a cron-based trigger for scheduling Tabsdata publishers, subscribers and transformers.
CSVFormatCSV file format.
CustomExceptionCustom exception for execution errors.
DatabricksDestinationDatabricks based data outputs.
DatabricksDestination.chunkTrigger the exporting of the data to local parquet chunks.
DatabricksDestination.streamTrigger the exporting of the data.
DatabricksDestination.writeThis method is used to write the files to the databricks.
DestinationPluginParent class for subscriber connectors.
DestinationPlugin.chunkTrigger the exporting of the data to local parquet chunks.
DestinationPlugin.streamTrigger the exporting of the data.
DestinationPlugin.writeGiven a file or a list of files, write to the desired destination.
EnvironmentSecretSecrets class representing a secret obtained from an environment variable in the server.
GCPServiceAccountKeyCredentialsCredentials class to store the credentials needed to access GCS using account key credentials (service account key).
GCSDestinationGCS-file-based data outputs.
GCSDestination.chunkTrigger the exporting of the data to local parquet chunks.
GCSDestination.streamTrigger the exporting of the data.
GCSSourceGCS-file-based data inputs.
GCSSource.chunkTrigger the import of the data.
HashiCorpSecretSecrets class representing a secret stored in Hashicorp Vault.
KafkaConnKafka Consumer Connection configuration.
KafkaCredentialsSpecRepresents credentials consisting of a user and a password.
KafkaTriggerA StageTrigger that consumes messages from a Kafka topic and stages them.
KafkaTrigger.runRun the Kafka stage trigger to consume messages, buffer them, and stage them based on rollover conditions.
litExpression for the given literal value.
LocalFileDestinationLocalFile-based data outputs.
LocalFileDestination.chunkTrigger the exporting of the data to local parquet chunks.
LocalFileDestination.streamTrigger the exporting of the data.
LocalFileSourceLocal-file-based data inputs.
LocalFileSource.chunkTrigger the import of the data.
LogFormatLog file format.
MariaDBConnRepresents a connection configuration to MariaDB.
MariaDBDestDestination plugin for writing data to MySQL.
MariaDBDest.streamStore the results into the MariaDB database.
MariaDBDestinationMariaDB-based data outputs.
MariaDBDestination.chunkStore the results in the SQL destination.
MariaDBDestination.writeGiven a file or a list of files, write to the desired destination.
MariaDBSourceMariaDB-based data inputs.
MariaDBSource.chunkTrigger the import of the data.
MariaDBSrcSource plugin for reading data from MariaDB.
MariaDBSrc.streamExecute the query and load the results as a list of TableFrames.
MongoDBDestinationMongoDB-based data outputs.
MongoDBDestination.chunkTrigger the exporting of the data to local parquet chunks.
MongoDBDestination.streamTrigger the exporting of the data.
MongoDBDestination.writeThis method is used to write the files to the database.
MSSQLConnRepresents a connection configuration to Microsoft SQL Server (MSSQL).
MSSQLDestinationMSSQL-based data outputs.
MSSQLDestination.chunkTrigger the exporting of the data to local parquet chunks.
MSSQLDestination.streamTrigger the exporting of the data.
MSSQLDestination.writeThis method is used to write the files to the database.
MSSQLSourceMicrosoft SQL Server based data inputs.
MSSQLSource.chunkExecute the query and yield chunks of data.
MSSQLSrcSource Plugin for reading data from a Microsoft SQL Server (MSSQL) database.
MSSQLSrc.streamExecute the query and load the results as a list of TableFrames.
MySQLConnRepresents a connection configuration to MySQL.
MySQLDestDestination plugin for writing data to MySQL.
MySQLDest.streamStore the results into the MySQL database.
MySQLDestinationMySQL-based data outputs.
MySQLDestination.chunkStore the results in the SQL destination.
MySQLDestination.writeGiven a file or a list of files, write to the desired destination.
MySQLSourceMySQL-based data inputs.
MySQLSource.chunkTrigger the import of the data.
MySQLSrcSource plugin for reading data from MySQL.
MySQLSrc.streamExecute the query and load the results as a list of TableFrames.
NDJSONFormatJSON file format.
OracleConnRepresents a connection configuration to Oracle.
OracleDestinationOracle-based data outputs.
OracleDestination.chunkStore the results in the SQL destination.
OracleDestination.writeGiven a file or a list of files, write to the desired destination.
OracleSourceOracle-based data inputs.
OracleSource.chunkTrigger the import of the data.
OracleSrcSource plugin for reading data from Oracle.
OracleSrc.streamExecute the query and load the results as a list of TableFrames.
ParquetFormatParquet file format.
PostgresConnRepresents a connection configuration to Postgres.
PostgresDestDestination plugin for writing data to PostgreSQL.
PostgresDest.streamStore the results into the PostgreSQL database.
PostgresDestinationPostgres-based data outputs.
PostgresDestination.chunkStore the results in the SQL destination.
PostgresDestination.writeGiven a file or a list of files, write to the desired destination.
PostgresSourcePostgres-based data inputs.
PostgresSource.chunkTrigger the import of the data.
PostgresSrcSource plugin for reading data from Postgres.
PostgresSrc.streamExecute the query and load the results as a list of TableFrames.
publisherDecorator to define a function to publish data to Tabsdata.
S3AccessKeyCredentialsCredentials class to access an S3 bucket using access key credentials (access key id and secret access key).
S3DestinationS3-file-based data outputs.
S3Destination.chunkTrigger the exporting of the data to local parquet chunks.
S3Destination.streamTrigger the exporting of the data.
S3SourceS3-file-based data inputs.
S3Source.chunkTrigger the import of the data.
SalesforceReportSourceSalesforce Reports based data inputs.
SalesforceReportSource.chunkTrigger the import of the data.
SalesforceSourceSalesforce (SOQL query) based data inputs (not Salesforce Reports).
SalesforceSource.chunkTrigger the import of the data.
SalesforceTokenCredentialsCredentials class to store the credentials needed to access a Salesforce using a username, a password and a token.
SnowflakeDestinationSnowflake based data outputs.
SnowflakeDestination.chunkTrigger the exporting of the data to local parquet chunks.
SnowflakeDestination.streamTrigger the exporting of the data.
SnowflakeDestination.writeThis method is used to write the files to the database.
SourcePluginParent class for publisher connectors.
SourcePlugin.chunkTrigger the import of the data.
SourcePlugin.stream
StageInputs that have been placed in a stage, usually from a StageTrigger.
Stage.stream
StageTrigger
StageTrigger.runContinuously runs the stage trigger logic using the received context to trigger and monitor executions.
subscriberDecorator to define a function to subscribe to data present in Tabsdata.
TableFrame> Private Functions
TableFrame.assert_has_colsEnsures that the (non-system) columns in the TableFrame match the expected columns.
TableFrame.castCast columns to a new data type.
TableFrame.clearClears all rows of the TableFrame preserving the schema.
TableFrame.columns
TableFrame.dropDiscard columns from the TableFrame.
TableFrame.drop_nansDrop rows with NaN values.
TableFrame.drop_nullsDrop rows with null values.
TableFrame.emptyCreates an empty (no column - no row) TableFrame.
TableFrame.extract_as_columnsExtract a slice of rows from the table as a column-oriented dictionary.
TableFrame.extract_as_rowsExtract a slice of rows from the TableFrame as a list of dictionaries.
TableFrame.fill_nanReplace all NaN values in the TableFrame with the given value.
TableFrame.fill_nullReplace all null values in the TableFrame with the given value.
TableFrame.filterFilter the TableFrame based on the given predicates.
TableFrame.firstReturn a TableFrame with the first row.
TableFrame.first_rowReturn a tuple or dictionary with the first row, or None if no row.
TableFrame.from_dictCreates tableframe from a dictionary, or None.
TableFrame.from_pandasCreates tableframe from a pandas dataframe, or None.
TableFrame.from_polarsCreates tableframe from a polars dataframe or lazyframe, or None.
TableFrame.grokParse log text into structured fields using a Grok pattern.
TableFrame.group_byPerform a group by on the TableFrame.
TableFrame.has_colsVerifies the presence of (non-system) columns in the TableFrame.
TableFrame.has_same_schemaVerifies if the schema of the current TableFrame is same than the provided TableFrame.
TableFrame.headReturn a TableFrame with the first n rows.
TableFrame.is_emptyChecks if a TableFrame has no rows.
TableFrame.itemReturns a scalar value if the TableFrame contains exactly one user column and one row.
TableFrame.joinJoin the TableFrame with another TableFrame.
TableFrame.lastReturn a TableFrame with the last row.
TableFrame.last_rowReturn a tuple or dictionary with the last row, or None if no row.
TableFrame.limitReturn a TableFrame with the first n rows.
TableFrame.renameRename columns from the TableFrame.
TableFrame.selectSelect column(s) from the TableFrame.
TableFrame.sliceReturn a TableFrame with a slice of the original TableFrame
TableFrame.sortSort the TableFrame by the given column(s) or expression(s).
TableFrame.tailReturn a TableFrame with the last n rows.
TableFrame.to_dictCreates a dictionary from this tableframe.
TableFrame.to_pandasCreates a pandas dataframe from this tableframe.
TableFrame.to_polars_dfCreates a polars dataframe from this tableframe.
TableFrame.to_polars_lfCreates a polars lazyframe from this tableframe.
TableFrame.udfApply a user-defined function (UDF) to the columns resolved by expr.
TableFrame.uniqueDeduplicate rows from the TableFrame.
TableFrame.unnestExpand one or more struct columns so that each field within the struct becomes a separate column in the TableFrame.
TableFrame.with_columnsAdd columns to the TableFrame.
TableInputTable-based data inputs.
TableInput.stream
TableOutputTable-based data outputs.
TabsdataFunctionClass to decorate a function with metadata and methods for use in a Tabsdata environment.
transformerDecorator to define a function to transform data present in Tabsdata.
UserPasswordCredentialsRepresents credentials consisting of a user and a password.