DataQuality
class DataQuality(
table: TableNameSpec,
classifiers: ClassifiersSpec,
operators: OperatorsSpec,
)
Bases: OnTablesAction
Categories: dq-action
A data quality check applied to one of a function's output tables.
Bundles classifiers (which label each row) with operators (which act on
those labels). Pass it to a @publisher / @transformer /
@subscriber via on_tables=[DataQuality(...)]; the runtime runs
the check against the named output table after the function succeeds.
Examples
DataQuality(
table="checked",
classifiers=[IsNull(["value"])],
operators=[Enrich(), Summary()],
)
Parameters
parameter
tableTableNameSpec (str)Output table the check runs on; a valid table name (alphanumerics and underscores, starting with a letter).
parameter
classifiersClassifiersSpec (list[Classifier])Classifiers that label the table's columns; a non-empty list (at least one).
parameter
operatorsOperatorsSpec (list[Operator])Methods
method
validate_verdict_columnsdef validate_verdict_columns() -> DataQuality