[okfn-labs] New library: Tabular Validator

[Friedrich Lindenberg]

Good stuff, Paul! I like the "many small modules" approach you're doing
there a lot!

To be honest, the tabular validator reminds me a bit of existing data
validation tools, especially https://github.com/sunlightlabs/validictory.
Just out of interest: why did you opt against using an existing validation
library and wrap it for reporting? That kind of approach worked quite well
for OpenSpending (cf. https://github.com/openspending/osvalidate).

What I'm really interested in is TellMe, that sounds very cool. Is there a
demo application and some example output somewhere that one could look at?

Cheers,

- Friedrich



On Thu, Feb 19, 2015 at 4:53 PM, Paul Walsh <paulywalsh at gmail.com> wrote:

> Hi Labs,
>
> I want to announce a new library I’ve been working on for OK.
>
> Tabular Validator (https://github.com/okfn/tabular-validator) is a Python
> package for validating tabular data through a processing pipeline. It is
> alpha software.
>
> It is built by Open Knowledge, with funding from the Open Data User Group (
> https://www.gov.uk/government/groups/open-data-user-group).
>
> Applications range from simple validation checks on CSV files, to
> integration with a larger ETL pipeline.
>
> The codebase currently ships with two validators that can be used in a
> pipeline:
>
>         • The StructureValidator checks for common structural errors
>         • The SchemaValidator checks for conformance to a JSON Table
> Schema.
>
> There is a hook to add custom validators, and there are plans to include
> more validators in the core library.
>
> There is some documentation (
> http://tabular-validator.readthedocs.org/en/latest/), but it is lacking
> in some areas. You are welcome to check out the code, run the tests (or
> check them on Travis), open an issue, or make a pull request to help us
> iterate to a version one release (here is the backlog).
>
> We’ve also released some packages that are used in Tabular Validator:
> TVWeb (https://github.com/okfn/tabular-validator-web), JTSKit (
> https://github.com/okfn/jtskit-py), and TellMe (
> https://github.com/okfn/tellme). You can read more about each of these by
> following the links. A more complete blog post on the Labs blog will follow
> shortly.
>
> Thanks,
>
> Paul
>
> _______________________________________________
> okfn-labs mailing list
> okfn-labs at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/okfn-labs
> Unsubscribe: https://lists.okfn.org/mailman/options/okfn-labs
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/okfn-labs/attachments/20150219/6d4fb91d/attachment-0004.html>