Skip to main content

Semantic Model Data Quality Check

Current configuration of the Semantic Model Data Quality Check task in the Workflow Designer

The Semantic Model Data Quality Check task executes from one to twenty rules ordered on a published model and produces a JSON report.

Configuration

For each rule, define:

FieldDescription
NameUnderstandable label for the check.
SeverityWarning signals the issue; Error may block the workflow.
QuerySemantic query that returns the value to be checked.
Result FieldColumn of the first row to compare.
OperatorEqual, not equal, greater/less than, range, null or not null.
Expected ValueComparison value.
Final ValueSecond extreme, required for the range operator.

Additionally configure:

  • Fail on error: interrupts the task when at least one rule with Error severity is not met;
  • File name: name of the JSON report.

Conceptual example:

Nome: Ordini presenti
Gravità: Error
Campo risultato: totale_ordini
Operatore: maggiore di
Valore atteso: 0

The rule query must return the value to verify in the first row.

Results

The report contains:

  • status passed, warning or failed;
  • total number of checks;
  • number of checks passed, failed and warnings;
  • detail of each comparison;
  • reference to the generated JSON file.

Use Warning for anomalies to observe and Error for conditions that make data unsuitable for the process. Periodically verify rules when the model or sources change.