Skip to main content
GuideServerConfigure and deploy Tabsdata servers on your machine.TutorialsConfigure data integration workflows within a running Tabsdata server.Advanced TutorialsBuild end-to-end workflows between two specific systems.API ReferenceCLI ReferenceRelease Notes
Version: 2.0.0

tabsdatak.dataquality

AllOkA boolean criteria that selects rows where every boolean classifier passes (True).
AnyFailedA boolean criteria that selects rows where at least one boolean classifier fails (False).
BetweenClassifierA boolean classifier that checks if a value is within a specified range.
BinCountSpecA type alias for the number of bins a Scale will have, between 1 and MAX_BINS.
BinIdxSpecA type alias for a zero-based bin index, constrained by MAX_BINS.
BinsCriteriaSpecA non-empty set of bins used in criteria.
BinSpecA type alias for the bin, either an index [0..100] or a special one [none, nan, underflow, overflow]
BoolClassifierAbstract base class for classifiers with a boolean verdict.
BoolCriteriaAbstract base for criteria over boolean classifier verdicts.
CategorizerAbstract base class for classifiers that assign each value to a bin.
CategoryCriteriaAbstract base for criteria over a categorizer's bin assignments.
ClassifierAbstract base class for all data quality classifiers.
ClassifiersSpecA non-empty list of Classifier instances.
ColumnNameSpecA type alias for a single column name, represented as a string.
ColumnNamesWithAltSpecA list of column references.
ColumnNameWithAltSpecA single column reference: either the source column name, or a (source, destination) tuple naming the column to store the result in (destination may be None to auto-generate it).
CriteriaSelects rows for a Filter, Select or Fail operator.
CriteriaOperatorAn operator that uses a criteria to select records.
DataQualityA data quality check applied to one of a function's output tables.
DoesNotMatchA boolean classifier that checks whether a value does not match a regular expression.
EnrichAn operator that appends each classifier's verdict column to the target table.
ExponentialScaleA scale whose bin edges are spaced exponentially over [min_val, max_val] (used with ScaleCategorizer).
FailAn operator that fails (aborts) the current transaction when the rows selected by criteria reach threshold.
FilterAn operator that removes the rows selected by criteria from the target table.
HasLengthA boolean classifier that checks whether a value's length is within a range.
IdentityScaleA scale where every integer in [min_val, max_val) maps to its own bin (used with ScaleCategorizer).
InBinsA category criteria that selects rows whose bin is one of the given bins.
InClassifierA boolean classifier that checks if a value is in a specified set of values.
IncludeQualityColumnsSpecA type alias for quality columns to included in the Select or Filter target table.
IsBetweenA boolean classifier that checks whether a value is inside a range.
IsFalseA boolean classifier that checks whether a value is False.
IsInA boolean classifier that checks whether a value is in a set of values.
IsNanA boolean classifier that checks whether a value is NaN (not a number).
IsNegativeA boolean classifier that checks whether a numeric value is negative.
IsNegativeOrZeroA boolean classifier that checks whether a numeric value is negative or zero.
IsNotBetweenA boolean classifier that checks whether a value is outside a range.
IsNotInA boolean classifier that checks whether a value is not in a set of values.
IsNotNanA boolean classifier that checks whether a value is not NaN.
IsNotNullA boolean classifier that checks whether a value is not null.
IsNotNullNorNanA boolean classifier that checks whether a value is neither null nor NaN.
IsNotZeroA boolean classifier that checks whether a numeric value is not zero.
IsNullA boolean classifier that checks whether a value is null.
IsNullOrNanA boolean classifier that checks whether a value is null or NaN.
IsPositiveA boolean classifier that checks whether a numeric value is positive.
IsPositiveOrZeroA boolean classifier that checks whether a numeric value is positive or zero.
IsTrueA boolean classifier that checks whether a value is True.
IsZeroA boolean classifier that checks whether a numeric value is zero.
LenSpecA type alias for a non-negative integer, typically used for specifying length.
LinearScaleA scale that splits [min_val, max_val] into equal-width bins (used with ScaleCategorizer).
LogarithmicScaleA scale whose bin edges are spaced logarithmically over [min_val, max_val] (used with ScaleCategorizer).
MatchClassifierA boolean classifier that checks if a value matches a regex pattern.
MatchesA boolean classifier that checks whether a value matches a regular expression.
MAX_BINSThe maximum number of bins allowed in a bucketing operation.
MonomialScaleA power-law scale over [min_val, max_val] whose bin widths grow as a power of the value (used with ScaleCategorizer).
NotInBinsA category criteria that selects rows whose bin is not among the given bins.
OnInvalidColumnSpecA type alias that specifies what to do if a column is invalid for the classifier.
OnInvalidValueSpecA type alias that specifies what to do if a classifier value is invalid for column.
OperatorAbstract base class for all data quality operators.
OperatorsSpecA non-empty list of Operator instances.
PercentSpecA type alias for a percentage value, which can be an integer or a float between 0 and 100.
PercentThresholdA Fail threshold expressed as a percentage of the table's rows.
PythonDataTypeSpecA type alias for a union of common Python data types used in data quality checks.
RangeClosedOnSpecA type alias that specifies which side of a range is closed (inclusive).
RangeValueSpecA type alias for a value used in defining a range, based on Python data types.
RowCountSpecA type alias for a non-negative row count.
RowCountThresholdA Fail threshold expressed as an absolute number of rows.
ScaleAbstract base class for the scales used by ScaleCategorizer.
ScaleBaseSpecA type alias for the base of a scale, which must be a float greater than 0.
ScaleCategorizerA classifier that assigns each value to a bin defined by a Scale.
ScaleIdentityLimitSpecA type alias for a limit in a scale identity, ranging from 0 to 100.
ScaleLimitSpecA type alias for a generic limit in a scale, which can be an integer or a float.
ScalePowerSpecA type alias for the power of a scale, which must be a float greater than 0.
SelectAn operator that copies the rows selected by criteria to another table, leaving the target table unchanged.
SpecialBinSpecA type alias for the bins for None, NaN, underflow and overflow values.
SummaryAn operator that writes a data quality summary (one row per classifier: verdict tallies, or bin counts for a categorizer) to a table.
TagOperatorAn operator that is scoped to classifiers by tag.
TagSpecA type alias for a single tag, represented as a string.
TagsSpecA list of tags.
ThresholdAbstract base class for the thresholds used by the Fail operator.
ValuesSpecA non-empty set of values to check membership against (None is allowed, to test for null membership).

BinCountSpec

type_alias
BinCountSpec: StrictInt

A type alias for the number of bins a Scale will have, between 1 and MAX_BINS.


BinIdxSpec

type_alias
BinIdxSpec: StrictInt

A type alias for a zero-based bin index, constrained by MAX_BINS.


BinsCriteriaSpec

type_alias
BinsCriteriaSpec: frozenset[BinSpec]

Resolved type:

frozenset[StrictInt | Literal['none', 'nan', 'underflow', 'overflow']]

A non-empty set of bins used in criteria.


BinSpec

type_alias
BinSpec: Union[BinIdxSpec, SpecialBinSpec]

Resolved type:

StrictInt | Literal['none', 'nan', 'underflow', 'overflow']

A type alias for the bin, either an index [0..100] or a special one [none, nan, underflow, overflow]


ClassifiersSpec

type_alias
ClassifiersSpec: list[Classifier]

A non-empty list of Classifier instances.


ColumnNameSpec

type_alias
ColumnNameSpec: str

A type alias for a single column name, represented as a string.


ColumnNamesWithAltSpec

type_alias
ColumnNamesWithAltSpec: list[ColumnNameWithAltSpec]

Resolved type:

list[str | tuple[str, str | None]]

A list of column references. Each element is a source column name or a (source, destination) tuple; the two forms may be mixed.


ColumnNameWithAltSpec

type_alias
ColumnNameWithAltSpec: Union[ColumnNameSpec, tuple[ColumnNameSpec, Union[ColumnNameSpec, None]]]

Resolved type:

str | tuple[str, str | None]

A single column reference: either the source column name, or a (source, destination) tuple naming the column to store the result in (destination may be None to auto-generate it).


IncludeQualityColumnsSpec

type_alias
IncludeQualityColumnsSpec: Literal['none', 'criteria', 'all']

A type alias for quality columns to included in the Select or Filter target table.


LenSpec

type_alias
LenSpec: StrictInt

A type alias for a non-negative integer, typically used for specifying length.


MAX_BINS

constant
MAX_BINS = 100

The maximum number of bins allowed in a bucketing operation.


OnInvalidColumnSpec

type_alias
OnInvalidColumnSpec: Literal['ignore', 'fail']

A type alias that specifies what to do if a column is invalid for the classifier.


OnInvalidValueSpec

type_alias
OnInvalidValueSpec: Literal['ignore', 'fail']

A type alias that specifies what to do if a classifier value is invalid for column.


OperatorsSpec

type_alias
OperatorsSpec: list[Operator]

A non-empty list of Operator instances.


PercentSpec

type_alias
PercentSpec: Union[StrictInt, StrictFloat]

Resolved type:

StrictInt | StrictFloat

A type alias for a percentage value, which can be an integer or a float between 0 and 100.


PythonDataTypeSpec

type_alias
PythonDataTypeSpec: Union[int, float, bool, str, date, time, datetime, timedelta, bytes, Decimal]

Resolved type:

int | float | bool | str | date | time | datetime | timedelta | bytes | Decimal

A type alias for a union of common Python data types used in data quality checks.


RangeClosedOnSpec

type_alias
RangeClosedOnSpec: Literal['none', 'lower', 'upper', 'both']

A type alias that specifies which side of a range is closed (inclusive).

  • 'none': The range is open on both sides.
  • 'lower': The range is closed on the lower bound.
  • 'upper': The range is closed on the upper bound.
  • 'both': The range is closed on both sides.

RangeValueSpec

type_alias
RangeValueSpec: PythonDataTypeSpec

Resolved type:

int | float | bool | str | date | time | datetime | timedelta | bytes | Decimal

A type alias for a value used in defining a range, based on Python data types.


RowCountSpec

type_alias
RowCountSpec: StrictInt

A type alias for a non-negative row count.


ScaleBaseSpec

type_alias
ScaleBaseSpec: StrictFloat

A type alias for the base of a scale, which must be a float greater than 0.


ScaleIdentityLimitSpec

type_alias
ScaleIdentityLimitSpec: StrictInt

A type alias for a limit in a scale identity, ranging from 0 to 100.


ScaleLimitSpec

type_alias
ScaleLimitSpec: Union[StrictInt, StrictFloat]

Resolved type:

StrictInt | StrictFloat

A type alias for a generic limit in a scale, which can be an integer or a float.


ScalePowerSpec

type_alias
ScalePowerSpec: StrictFloat

A type alias for the power of a scale, which must be a float greater than 0.


SpecialBinSpec

type_alias
SpecialBinSpec: Literal['none', 'nan', 'underflow', 'overflow']

A type alias for the bins for None, NaN, underflow and overflow values.


TagSpec

type_alias
TagSpec: str

A type alias for a single tag, represented as a string.


TagsSpec

type_alias
TagsSpec: list[TagSpec]

Resolved type:

list[str]

A list of tags.


ValuesSpec

type_alias
ValuesSpec: frozenset[Union[PythonDataTypeSpec, None]]

Resolved type:

frozenset[int | float | bool | str | date | time | datetime | timedelta | bytes | Decimal | None]

A non-empty set of values to check membership against (None is allowed, to test for null membership). A list passed to the constructor is coerced to a frozenset (deduplicated) by pydantic.