[@OKFNau] Community Data Wrangling - Food Data Analysis Project

Tue Jun 24 04:09:53 UTC 2014

Here is what I've done to begin with: This page gives the nutritional breakdown by Food Name http://infoaus.net/food/food.php?food=Flour,%20cornflour,%20from%20maize%20starchThe results are generated by clicking on the link in the list of foods on the right (if you're on mobile it might be on the left and you'll have to scroll down to see the results underneath the list).
I've also done a query to list each nutritional element from the food with the most to least which you can also get by clicking on the link in the page above (relevant to that element) or http://infoaus.net/food/total.php?category=Starch_g
Please ignore the headers/footers as I've not updated anything there. I'm using the ones for BudgetAus.
Rosie Williams BA (Sociology)________________________________________

 NoFibs.com.au - Open Data Reporter InfoAus.net - Founder and Developer  Open Knowledge Foundation Australia - Open Spending Ambassador

From: budgetaus at hotmail.com
To: okfn-au at lists.okfn.org
Subject: RE: [@OKFNau] Community Data Wrangling - Food Data Analysis Project
Date: Tue, 24 Jun 2014 10:31:51 +1030

Hi Simon, 
I've begun mucking around with one of the data sets so I'll see what I come up with today. I'm working on a query that list food by highest-lowest on each nutrient. I'm using PHP and MySQL.
Thankyou for your answers. I think those questions are very important and that this information should probably be made available to prospective participants and users of data in a more permanent format if that is not already the case. 
It sounds like you are imagining an output/product/service suitable for the general public? Use cases are important because they drive what data is needed, how it is treated and what the end product is. 

I have found that the most important aspect in the success of an open data project is the demand from the end users. Technical problems can usually be solved but without a specific audience of end users whether that be a group of people with expert knowledge or the general public then it is difficult to find a rationale to create/continue these projects. 
It's important to know what the selling points are and whether it is a better version of something that already exists or something unique and new. My experience with the budget data suggests to me that building a better mousetrap is actually easier than doing something that has never been done before because despite all the hype around 'innovation' I think people have a good deal of trouble conceptualising something completely new. Having said that, if you can generate the support in terms or interest, funding etc for something new my point is moot. 
To sum up, my personal opinion is that the success of open data projects is more to do with gaining public interest or the interest of specific communities of backers (which can only be based on there being demand from end users), rather than the ability to solve technical problems. 
I'd be interested to hear other people's feedback on this.
Rosie Williams BA (Sociology)________________________________________

 NoFibs.com.au - Open Data Reporter InfoAus.net - Founder and Developer  Open Knowledge Foundation Australia - Open Spending Ambassador

> Date: Mon, 23 Jun 2014 17:34:34 +1000
> From: simoncropper at fossworkflowguides.com
> To: okfn-au at lists.okfn.org
> Subject: Re: [@OKFNau] Community Data Wrangling - Food Data Analysis Project
> 
> Hi Rosie,
> 
>  > Who do you see as the potential end users of sites based on this data?
> 
> Facts regarding food, nutrition and diets are rampant on the Internet. 
> The information created by this project would feed reliable data based 
> on open methodology for anyone interested in the data analysed to use.
> 
>  > Do you know if similar sites already exist?
> 
> Some sites exist that purport to provide high quality information that 
> neglect to state their sources or the methodology used to analyze the 
> data. This project will endevour to collate the actual data sources used 
> and document the methodology used and publish the outcome in easily 
> digested forms for general consumption.
> 
> The GitHub repository already has some Australian data and I am 
> collating some international datasets to complement this data. All are 
> open data that have no constraints on creation and distribution of 
> derivatives.
> 
> The methodology will be published as part of set projects or events. 
> Initially I indent to use pandas+iPython to document how the data is 
> analyzed. These is free to anyone to view, contribute and/or create 
> derivatives with (assuming they meet the CC-BY-SA licencing terms).
> 
> As part of a project or event, people will be utilized to post process 
> data, tables, graphs and present the information in digestible forms -- 
> e.g. a twitter post, Google+ post or an infographic on youtube. I am not 
> sure but I expect that these 'final presentations' may be fixed -- that 
> is to say released under a CC-BY-ND licence, but this will need to be 
> thought through a bit more with anyone else joining the project or event.
> 
> I hope that this answers your questions? If not, post further queries 
> and I will endevour to answer your concerns.
> 
> On 23/06/14 13:16, Rosie Williams wrote:
> > Hi Simon,
> >
> > Who do you see as the potential end users of sites based on this data?
> >
> > Do you know if similar sites already exist?
> >
> > Rosie Williams BA (Sociology)
> > ________________________________________
> >
> > NoFibs.com.au <http://nofibs.com.au> - Open Data Reporter
> > InfoAus.net <http://infoaus.net> - Founder and Developer
> >   Open Knowledge Foundation Australia <http://au.okfn.org/> - Open
> > Spending Ambassador
> >
> >
> >
> > ------------------------------------------------------------------------
> > Date: Sun, 22 Jun 2014 00:35:21 +1000
> > From: simoncropper at fossworkflowguides.com
> > To: school-of-data at lists.okfn.org; okfn-au at lists.okfn.org
> > Subject: [@OKFNau] Community Data Wrangling - Food Data Analysis Project
> >
> > Hello Everyone,
> >
> > Sorry if you are on both lists and receive this post twice.
> >
> > As mentioned in my introduction last week I have created a repository
> > focused on the analysis of food data with the objective of using the
> > data as fodder for a range of community data wrangling projects and events.
> >
> > You can find it on GitHub here...
> > https://github.com/SimonChristopherCropper/Food_Data_Analysis
> >
> > I am currently compiling the initial datasets and supporting documentation.
> >
> > Anyone interested in helping at this initial stage are welcome to
> > connect via my newly created forum...
> > http://www.fossworkflowguides.com/Community/
> >
> > It is hoped to use this forum to coordinate activities among members as
> > various tasks are attempted. Register on the forum to become a member.
> > The user help is reasonably good with MyBB so you should not have too
> > many problems. If you do contact me privately.
> >
> > If anyone in the School of Data would like to promote the startup, I
> > would be happy to correspond via email, if you need more than is
> > currently available on *GitHub* or the *Community Data Wrangling Forum*.
> >
> > As stated, this is a work in progress and more information will be
> > posted via the forum about various tasks, projects and events. Specific
> > projects and events will be announced on these two lists.
> >
> > --
> > Cheers Simon
> >
> >     Simon Cropper - Open Content Creator
> >
> >     Free and Open Source Software Workflow Guides
> >     ------------------------------------------------------------
> >     Introductionhttp://www.fossworkflowguides.com
> >     GIS Packageshttp://www.fossworkflowguides.com/gis
> >     bash / Pythonhttp://www.fossworkflowguides.com/scripting
> >
> >
> > _______________________________________________ okfn-au mailing list
> > okfn-au at lists.okfn.org https://lists.okfn.org/mailman/listinfo/okfn-au
> > Unsubscribe: https://lists.okfn.org/mailman/options/okfn-au
> >
> >
> > _______________________________________________
> > okfn-au mailing list
> > okfn-au at lists.okfn.org
> > https://lists.okfn.org/mailman/listinfo/okfn-au
> > Unsubscribe: https://lists.okfn.org/mailman/options/okfn-au
> >
> 
> 
> -- 
> Cheers Simon
> 
>     Simon Cropper - Open Content Creator
> 
>     Free and Open Source Software Workflow Guides
>     ------------------------------------------------------------
>     Introduction               http://www.fossworkflowguides.com
>     GIS Packages           http://www.fossworkflowguides.com/gis
>     bash / Python    http://www.fossworkflowguides.com/scripting
> _______________________________________________
> okfn-au mailing list
> okfn-au at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/okfn-au
> Unsubscribe: https://lists.okfn.org/mailman/options/okfn-au

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/okfn-au/attachments/20140624/63ac2cb6/attachment-0004.html>