CSV Data Quality Checker

Find out what's wrong with a CSV before the import fails: one command, a score, and the exact rows to fix.

CSV Data Quality Checker cover

What it does

Run one command on any CSV before you import it into a CRM, a database, Shopify, or a spreadsheet model, and get a score plus a fix list with row numbers. Python standard library only; nothing is uploaded.

python3 -m csvqc customers.csv                # summary
python3 -m csvqc customers.csv --md report.md # shareable Markdown report
python3 -m csvqc orders.csv --key "Order ID" --required email,amount --json

What you get

The screenshot is real output from the kit’s own commands. Tested from a fresh download of this exact zip: ./run_tests.sh ran 8 tests OK on Python 3.13 and 3.10.

Real terminal output from CSV Data Quality Checker: demo and passing tests

What it checks

AreaChecks
Fileencoding (UTF-8, BOM, Windows-1252), delimiter (comma, semicolon, tab, pipe), mixed line endings
Structureblank or duplicate headers, header spaces, rows with the wrong number of fields, blank rows, exact duplicate rows, duplicate or missing keys, required columns
Valuesplaceholder nulls (N/A, null, -, ...), mixed types in number columns, IDs that lost leading zeros, numbers Excel turned into 4.40123E+11, Excel date serials, mixed and ambiguous date formats, invalid and duplicate emails, extra spaces, broken characters (François), hidden zero-width characters, line breaks in cells, outliers (3x IQR)

Exit code 0 = no errors, 1 = errors (with --strict: also warnings), 2 = file can't be read, so it works as a CI or pre-import gate.

./demo.sh checks examples/customers.csv (17 problems planted). ./run_tests.sh runs the 8 tests. Also a Claude Code plugin with a skill (skills/csv-data-quality/) that runs the check and explains the fixes.

Honest limits

  • Reads the whole file into memory: best under a few hundred MB.
  • Heuristic checks: a warning is something to look at, not always wrong (a Canadian postal code in a ZIP column, a real outlier).

Need to fix duplicates? See the CRM Duplicate Cleanup Skill. More tools: https://youraitools.co/marketplace. License: LICENSE.txt (free, keep the notice).

Format and license

Zip, 14 KB, v1.0, 13 files. Free to use, modify and share for any purpose, including commercial work, as long as this notice stays in copies. Not affiliated with or endorsed by Microsoft.

FAQ

Does it change my file?
No, it only reads it.
Does it handle Excel files?
It checks CSV; save the sheet as CSV UTF-8 first.
Can I use it in CI?
Yes, exit code 1 means errors were found.
How do I get the files?
Click Download free. The zip downloads straight away: no checkout, no account.
Do I have to sign up for the newsletter?
No. The form is optional and the download works without it.

Get CSV Data Quality Checker

Free CSV validator and data quality checker: fix list with row numbers for encoding, broken and duplicate rows, mixed types, Excel-mangled IDs, bad emails.

Pairs well with

Download$29

Payroll Register Reconciliation Skill

Payroll register reconciliation from CSV exports: net-pay math, prior-period changes, paid-after-termination, duplicates, register vs ACH file. $29.

View Payroll Register Reconciliation Skill
Download$19

Employee Census Checker Skill

Check an employee census for health insurance quotes: missing fields, swapped dates, lost ZIP zeros, tier vs dependents, children 26+. Clean copy. $19.

View Employee Census Checker Skill
Download$19

SaaS Spend Finder Skill

Find software subscriptions in card or bank exports: monthly and annual cost, double charges, price increases, overlapping tools, renewals. Local, $19.

View SaaS Spend Finder Skill

Related