[okfn-labs] Using Git (and Github) for Data - a Data Pattern

Tue Jul 2 14:20:59 UTC 2013

Hi Rufus,

You might also like the git for triples we're building in our lab at the
university of Ghent: http://rawbase.github.io

Paper from WWW13 can be found here:
https://t.co/FxedWgR13Y

Kind regards,

Pieter

On Tue, Jul 2, 2013 at 4:12 PM, Rufus Pollock <rufus.pollock at okfn.org>wrote:

> Hi folks,
>
> I wanted to give a heads up on a new post I've put out today under the
> title of "Git (and Github) for data":
>
> <http://blog.okfn.org/2013/07/02/git-and-github-for-data/>
>
> <excerpt>
> The ability to do “version control” for data is a big deal. There are
> various options but one of the most attractive is to reuse existing
> tools for doing this with code, like git and mercurial. This post
> describes a simple “data pattern” for storing and versioning data
> using those tools which we’ve been using for some time and found to be
> very effective.
> </excerpt>
>
> The basic pattern is very simple and probably familiar to lots of folks
> here:
>
> 1. Storing data as line-oriented text and specifically as CSV files.
> “Line oriented text” just indicates that individual units of the data
> such as a row of a table (or an individual cell) corresponds to one
> line.
>
> 2. Use best of breed (code) versioning like git mercurial to store and
> manage the data.
>
> As people know, this is exactly the model in use for a while with
> <https://github.com/datasets> and http://data.okfn.org/
>
> Regards,
>
> Rufus
>
> PS: I should also add that the appearance of this post at the same
> time as Max Ogden's recent Dat efforts is entirely fortuitous
> coincidence - the original draft of this post was done a while ago
> (polishing for actual publication always gets put off!), though I have
> sought to add in some additional links in light of recent
> developments!
>
> _______________________________________________
> okfn-labs mailing list
> okfn-labs at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/okfn-labs
> Unsubscribe: http://lists.okfn.org/mailman/options/okfn-labs
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/okfn-labs/attachments/20130702/6dd27f67/attachment-0002.html>