[okfn-help] Adding a new Index to the existing OKFN solr server for bibliographica - queries.

[Ben O'Steen]

Just an FYI that I've setup all the config that I anticipate needs to be
done for the bibliographica.org core, so it should just be a case of
rebooting the tomcat container and making sure it comes up.

When's a good time to reboot it?

Ben


On Tue, 2011-04-26 at 12:29 +0200, Friedrich Lindenberg wrote:
> Hi Ben,
> 
> On Tue, Apr 26, 2011 at 12:13 PM, Ben O'Steen <bosteen at gmail.com> wrote:
> >  - 25 fields, some copies for faceting and combined search
> >  - approx 3 million 'docs', with 200+ chars per doc in total
> >  - needs to be accessible and updatable from the bibliographica.org
> > pylons frontend IP address.
> 
> All of these are pretty characteristic for a solr index and should not
> be a problem.
> 
> > Questions: (VM -> *Java* VM from this point on)
> >
> >  - Is there capacity (RAM/Heap/etc) for this sort of index on the
> > existing solr VM?
> 
> We had a resource-related crash a few days back and that was the first
> sign of trouble but in general the answer should be yes; if we do need
> to split up we should do this for specific services first
> (publicdata.eu has its own server which could run Solr, openspending
> has a lot of records that are frequently updated in the moment, might
> also make sense to move somewhere).
> 
> >  - Single VM (multicore), multiple VM (tomcat-adminned), or combination?
> 
> multicore
> 
> >  - If multicore:
> >        - How is the instance set up for multicore? using SolrCore admin
> > servlet (ie HTTP API for admin)? or is it using a file directory layout
> > system?
> 
> Cores are set up through a directory and config on eu4:
> ~/var/solr/solr.xml lists cores which are in ~/var/solr/CORENAME.
> 
> >  - Which public facing services are supported by this instance and more
> > importantly, who would be the people to let know that a large index will
> > be added to this?
> >         - ie who should be awake and aware while the index is being made, in
> > case it hits Heap/Stack/other OOM errors and an index corruption happens
> > elsewhere in the solr instance VM?
> 
> Nils and me, I guess.
> 
> >  - which server is running this solr instance and what standard backup
> > and maintenance routines are in place for it? eg critical files, /etc
> > and indexes rsync'd to remote machine, etc.
> 
> As mentioned above, the server is eu4 and the whole setup is in
> ~okfn/var/solr. I know that there is backup but its Nils' domain - ?
> 
> - Friedrich