Quality diagnosis

Quality diagnosis is the state of play of a dataset before cleaning: missing values, duplicates, incorrect types, out-of-range values, format inconsistencies. It is measured through counts and statistics before changing anything, in order to decide on the fixes and be able to justify them.

Example

df.isna().sum()
df.duplicated().sum()

Related concepts

The whole glossary