[wdmmg-discuss] Failed to port datastore to RDF, will go Mongo

Wed Dec 1 12:17:07 UTC 2010

Hi, Rufus.

About Mongo vs. SQL vs RDF.

I'have good experience using MongoDB last year. Our project Rosspending (
http://www.rosspending.ru) contains about 5 millon records of public
government contracts, goods records, suppliers and customers records.

Behind this all is MongoDB as main storage and MySQL as raw data storage and
it runs without any trouble.

About Mongo advantages I would like to add it's flexibility and
performance.
For schemaless data - it's probably best choice.

And disadvantages:
 - not space effective - same data in Mongo and SQL, in case of Mongo
allocates more disk space. Thats why we keep raw data outside MongoDB.

Also I think that it's not yet right to provide public access to the Mongo
rest api. I think that better way is to have wrapper using Rails/Django/any
other framework that will provide query results caching.

Best Regards,
   Ivan Begtin

> From: Rufus Pollock <rufus.pollock at okfn.org>
> Subject: Re: [wdmmg-discuss] Failed to port datastore to RDF, will go
>        Mongo
> To: Francis Irving <francis at flourish.org>
> Cc: wdmmg-discuss <wdmmg-discuss at lists.okfn.org>
> Message-ID:
>        <AANLkTimujhPR=iFLJPXPna_nDtYLgP-dD_7UH9wHXuaB at mail.gmail.com>
> Content-Type: text/plain; charset=UTF-8
>
> On 29 November 2010 17:19, Francis Irving <francis at flourish.org> wrote:
> > Thanks for that writeup Friedrich, very interesting.
> >
> > Two things:
> >
> > 1) I'd love to see your long technical pro/con email from before. I
> > can't find it in the mailing list archive, did you send it there?
>
> Friedrich prepared a summary of the different options (SQL, MONGO,
> RDF) on the main wdmmg pad <http://okfnpad.org/wdmmg> and I've inlined
> the summary below (empahsize still in progress)
>
> > 2) I'm wondering if a leightweight linked CVS or linked JSON can help.
> > By this I mean using URLs as attribute values, and even keys, for
> > fields which refer to other types (for which there is an ontology, or
> > you feel like making one). That would provide the forward compatible
> > hook, that William refers to.
>
> This is definitely a possibility and this was something that will
> waites explored back in March when using Mongo as an RDF store:
>
> <http://wwaites.posterous.com/mongo-as-an-rdf-store>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/openspending/attachments/20101201/b44fe8eb/attachment.html>