[openspending-dev] Help please!

Wed Feb 26 17:09:27 UTC 2014

Dropping Seb to bcc to save his inbox.

Afraid I don't know the answer to this personally - but looping you in with
the big guns here.

@Anders, Neil, Tryggvi - something to update in the guide?

Lucy

On 26 February 2014 15:33, Mark Baynes <hello at baynesmedia.com> wrote:

> Hey Lucy
>
> The guide is pretty good but it doesn't specify dataset limits for Google
> Drive uploads until the error message appears. There is also a row / record
> limit. Not a big issue but as a UX geek i tend to pick up on these things.
> A novice might have given up though.
>
> My error was in not splitting up my dataset however. It's spending over
> £500 data I got from the Tower Hamlets Council website. I have been
> processing it all in one big lump so the dataset covers 2010 - 2013
> spending and is around 119k rows. Which is too big. I have spent the
> morning splitting this up into discrete years and will be uploading it
> later this pm. Will do 2010 see how that goes and take it from there.
>
> While I have your undivided attention (assuming you are not driving while
> reading this of course) here is another geeky query.  The only thing I have
> added to my dataset covering 2010-2013 spending is a unique record id value
> for obvious reasons. But now I am splitting the one big file into smaller
> files by year is it OK to keep those same record id values in?
>
> cheers
>
> Mark
>
>
>
>  --
> Mark Baynes
> UX Design | Data Journalism | Open Data | Hyperlocal
> 07876 033 467
> hello at baynesmedia.com
> www.baynesmedia.com
> www.lovewapping.org
> @baynesmedia
> UX portfolio: http://bit.ly/1eBOYGX
>
> On 26 Feb 2014, at 15:18, Lucy Chambers <lucy.chambers at okfn.org> wrote:
>
> Thanks Seb,
>
> Mark - was the guide any good? I saw Anders had tweeted it at you this
> a.m. AFAIK - you shouldn't have to split datasets, so let me know if it's
> still an issue!
>
> Lucy
>
>
> On 26 February 2014 14:29, Mark Baynes <hello at baynesmedia.com> wrote:
>
>> Hi Seb
>>
>> Thanks for that, Lucy helped me out last night.
>>
>> cheers
>>
>> Mark
>>
>>
>>  --
>> Mark Baynes
>> UX Design | Data Journalism | Open Data | Hyperlocal
>> 07876 033 467
>> hello at baynesmedia.com
>> www.baynesmedia.com
>> www.lovewapping.org
>> @baynesmedia
>> UX portfolio: http://bit.ly/1eBOYGX
>>
>> On 26 Feb 2014, at 14:26, Seb Bacon <seb.bacon at opencorporates.com> wrote:
>>
>> Hi Mark,
>>
>> Lucy from OKF (Cc'd) might be able suggest who to talk to.
>>
>> Good luck!
>>
>> Seb
>>
>> -------------------------------------------------------
>> OpenCorporates :: The Open Database of the Corporate World
>> http://opencorporates.com
>> Blog: http://blog.opencorporates.com
>> Twitter: http://twitter.com/OpenCorporates
>>
>> OpenCorporates is published by Chrinon Ltd, a company dedicated to
>> improving and publishing public data under an open licence that allows
>> and encourages reuse, including commercially. Registered in England,
>> number 07444723.
>>
>>
>> On 25 February 2014 20:36, Mark Baynes <hello at baynesmedia.com> wrote:
>>
>> Hey Seb!
>>
>> I am just about to bust open Tower Hamlets and upload a 120k record
>> dataset
>> of all their spending onto openspending - but can't because of stupid
>> upload
>> restrictions! Grrrr.....
>>
>> Don't suppose you could tell me a good person to contact to help me out
>> please? Tried IRC and twitter but no joy so far. Don't want to have to
>> split
>> the set.
>>
>> cheers!
>>
>> Yours, frustrated of Wapping.
>>
>> Mark
>>
>> --
>> Mark Baynes
>> UX Design | Data Journalism | Open Data | Hyperlocal
>> 07876 033 467
>> hello at baynesmedia.com
>> www.baynesmedia.com
>> www.lovewapping.org
>> @baynesmedia
>> UX portfolio: http://bit.ly/1eBOYGX
>>
>>
>>
>
>
> --
> *Lucy Chambers*
>
> Knowledge Director  | Skype: lucyfediachambers  |  tel: +44 7909 330731 |
>  @lucyfedia <http://twitter.com/lucyfedia>
>
>
> The Open Knowledge Foundation <http://okfn.org/>
> Empowering through Open Knowledge
> http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on Facebook<https://www.facebook.com/OKFNetwork> |
> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>
> OpenSpending | http://openspending.org/ | @openspending<http://twitter.com/openspending>|Tracking every government financial transaction across the world
> School of Data | http://schoolofdata.org | @schoolofdata<http://twitter.com/schoolofdata>| Evidence is Power
>
>
>

-- 

*Lucy Chambers*

Knowledge Director  | Skype: lucyfediachambers  |  tel: +44 7909 330731  |
@lucyfedia <http://twitter.com/lucyfedia>

The Open Knowledge Foundation <http://okfn.org/>

Empowering through Open Knowledge

http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
Facebook<https://www.facebook.com/OKFNetwork> |
Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>

OpenSpending | http://openspending.org/ |
@openspending<http://twitter.com/openspending>|Tracking every
government financial transaction across the world

School of Data | http://schoolofdata.org |
@schoolofdata<http://twitter.com/schoolofdata>| Evidence is Power
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/pipermail/openspending-dev/attachments/20140226/14a52344/attachment-0001.html>