[openbiblio-dev] New instance: eu11.okfn.org

[Rufus Pollock]

(cc'ing openbiblio-dev)

On 14 November 2010 22:31, William Waites <ww at eris.okfn.org> wrote:
> * [2010-11-14 21:43:03 +0000] Rufus Pollock <rufus.pollock at okfn.org> écrit:
>
> ] As per earlier discussion I have spun up a new m1.large amazon
> ] instance running ubuntu lucid. Machine identity:
>
> Thanks Rufus. It's chugging happily along importing
> records at a rate of about 140/sec (approx 7k
> triples/sec). I'll try to get all the data imported
> before telling the web interface to use it or
> exposing the sparql endpoint...

That's still very slow (i.e. 59h to do the whole lot!). Can one turn
off transactions or the like for bulk uploading to speed it up?

Also are you doing any de-duping (at least on entities)? (Since we're
creating them may be sensible to dedupe as part of upload ...)

Rufus