[openspending-dev] The Front Fell Off

Mon Apr 14 16:40:46 UTC 2014

I’m afraid I don’t have access to OS production and thus can’t be of much use in profiling the thing (unless the Nick thinks otherwise). 

Keen to hear about any outcomes, though. 

- Friedrich 

On 14 Apr 2014, at 17:04, Rufus Pollock <rufus.pollock at okfn.org> wrote:

> Hi,
> 
> I thought a first step here might be to draft an analysis of what's causing difficulties and how we plan to solve in classic sysadmin/devops analysis style (and then post it on the blog).
> 
> I've started a draft here if people wanted to jump in:
> 
>  OpenSpending - Recent Performance Challenges + Plans Going Forward
> 
> Rufus
> 
> 
> On 11 April 2014 17:03, Everton Zanella Alvarenga <everton.alvarenga at okfn.org> wrote:
> Let's consider also sysadmin and maintenance work.
> 
> Tom
> 
> 
> 2014-04-11 13:00 GMT-03:00 Friedrich Lindenberg <friedrich at pudo.org>:
> 
> Nick will be able to clarify what the current, AWS-based setup costs. The Hetzner machine I proposed would be 120 EUR a month (170 USD); but that figure is pretty meaningless compared to the cost of hosting, maintenance and user support.  
> - Friedrich 
> 
> 
> On 11 Apr 2014, at 17:57, Everton Zanella Alvarenga <everton.alvarenga at okfn.org> wrote:
> 
>> Can someone, please, give costs estimates for the actual infra-structure?
>> 
>> How can we measure if it's enough?
>> 
>> Tom
>> 
>> 
>> 2014-04-11 12:54 GMT-03:00 Friedrich Lindenberg <friedrich at pudo.org>:
>> Hey Rufus, 
>> 
>> thanks for getting back to me. 
>> 
>> On 11 Apr 2014, at 17:10, Rufus Pollock <rufus.pollock at okfn.org> wrote:
>>> I wonder if we should get a diagnosis of the issue that we have right now before doing a move (which is pretty cumbersome).
>> 
>> I’m sorry for my rash proposal to move the machine, it would obviously be good to further diagnose the problem and to see what leads to the increased number of timeouts. At the same time, I’m not aware of any massive changes in the way that aggregation works, so it’s reasonable to conclude that the issue is resulting from growing dataset numbers and the resources available.
>> 
>>> More substantively, we probably need to think of a plan medium-term for:
>>> 
>>> A. Finding a way to have infrastructure donated or paid for
>> 
>> Fully agreed, but it would be good if we could separate this from the immediate issue of request timeouts. Otherwise, OKFN ends up in a place where you’re holding the users hostage in order to force them to contribute to an as-yet-unwritten agreement on cost sharing. 
>> 
>>> B. Establishing a proper mini devops teams to oversee and maintain the services (it would be great to have enough folks here that we could have someone "on-duty" at a given time)
>> 
>> I believe that’s a function of A, since on-duty doesn’t mean anything without some sort of payment. 
>> 
>> - Friedrich
>> 
>> 
>>> Especially for B people should shout out if they are interested in contributing.
>>> 
>>> Rufus
>>> 
>>> 
>>> On 11 April 2014 12:34, Friedrich Lindenberg <friedrich at pudo.org> wrote:
>>> Hey all,
>>> 
>>> I got up this morning with three different people pinging me about OS not working. It’s quite apparent that - whatever merits the Amazon hosting solution might have - it does not work in practice. To help with that, I would like to offer my support in moving OS to a new dedicated machine [e.g. 1] next week.
>>> 
>>> Cheers,
>>> 
>>> - Friedrich
>>> 
>>> [1] https://www.hetzner.de/hosting/produkte_rootserver/px120
>>> 
>>> 
>>> 
>>> _______________________________________________
>>> openspending-dev mailing list
>>> openspending-dev at lists.okfn.org
>>> https://lists.okfn.org/mailman/listinfo/openspending-dev
>>> Unsubscribe: https://lists.okfn.org/mailman/options/openspending-dev
>>> 
>>> 
>>> 
>>> 
>>> -- 
>>> Rufus Pollock
>>> Founder and CEO  |  skype: rufuspollock  |  @rufuspollock
>>> The Open Knowledge Foundation
>>> Empowering through Open Knowledge
>>> http://okfn.org/  |  @okfn  |  OKF on Facebook  |  Blog  |  Newsletter
>>> 
>>> 
>> 
>> 
>> _______________________________________________
>> openspending-dev mailing list
>> openspending-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/openspending-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/openspending-dev
>> 
>> 
>> 
>> 
>> -- 
>> Everton Zanella Alvarenga (also Tom)
>> Open Knowledge Brasil - Rede pelo Conhecimento Livre
>> http://br.okfn.org
> 
> 
> 
> 
> -- 
> Everton Zanella Alvarenga (also Tom)
> Open Knowledge Brasil - Rede pelo Conhecimento Livre
> http://br.okfn.org
> 
> 
> 
> -- 
> Rufus Pollock
> Founder and CEO  |  skype: rufuspollock  |  @rufuspollock
> The Open Knowledge Foundation
> Empowering through Open Knowledge
> http://okfn.org/  |  @okfn  |  OKF on Facebook  |  Blog  |  Newsletter
> 
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/openspending-dev/attachments/20140414/ee0b81eb/attachment-0002.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 842 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://lists.okfn.org/pipermail/openspending-dev/attachments/20140414/ee0b81eb/attachment-0002.sig>