[openbiblio-dev] New instance: eu11.okfn.org

Rufus Pollock rufus.pollock at okfn.org
Mon Nov 15 11:43:39 UTC 2010


(cc'ing openbiblio-dev)

On 14 November 2010 22:31, William Waites <ww at eris.okfn.org> wrote:
> * [2010-11-14 21:43:03 +0000] Rufus Pollock <rufus.pollock at okfn.org> écrit:
>
> ] As per earlier discussion I have spun up a new m1.large amazon
> ] instance running ubuntu lucid. Machine identity:
>
> Thanks Rufus. It's chugging happily along importing
> records at a rate of about 140/sec (approx 7k
> triples/sec). I'll try to get all the data imported
> before telling the web interface to use it or
> exposing the sparql endpoint...

That's still very slow (i.e. 59h to do the whole lot!). Can one turn
off transactions or the like for bulk uploading to speed it up?

Also are you doing any de-duping (at least on entities)? (Since we're
creating them may be sensible to dedupe as part of upload ...)

Rufus




More information about the openbiblio-dev mailing list