[euopendata] [bigclean] Idea: screen scraping sprint -> 19.3.2011

Fri Mar 11 23:46:26 UTC 2011

Fantastic, really good looking web page!

1) I think it'd be great to have a place that everyone involved chats,
so it feels real time and like an international event. Is a twitter
hash tag enough for this these days? 

I'd quite like something even more interactive - an IRC channel, or
better an amazing web based chat system so everyone involved can just
go to a page on the site and ask questions, say what they're doing.
Is there a service that can do that easily?

2) We'll make sure some people from ScraperWiki are about to answer
questions about writing scrapers / refiners in Python and Ruby.

Anything else particular that you'd like help from us on or ahead
of the day?

Francis

On Fri, Mar 04, 2011 at 10:40:02PM +0100, Daniel Dietrich wrote:
> Dear all,
> 
> www.bigclean.org is online and has now some very very basic content.
> 
> I have added Antti and Jildrich to be Editors of the website. Other volunteers are very welcome.
> 
> I also re-discovered this wiki page
> 
> 	http://wiki.okfn.org/TheBigClean
> 
> and I think we should communicate it as the main site for coordination of the cities since it's much easier to access and edit for everyone.
> 
> So, let's move ahead and quickly add content to the wiki / wp site and make this a real great event!
> 
> Regards
> Daniel
> 
> 
> 
> --
> Daniel Dietrich
> 
> The Open Knowledge Foundation
> Promoting Open Knowledge in a Digital Age
> www.okfn.org  -  www.opendefinition.org
> 
> Project Coordinator of the Open Definition
> Coordinator of the Working Groups:
> Open Government Data & Open Data in the EU
> 
> Open Knowledge Foundation Deutschland
> www.okfn.de
> 
> Mail: daniel.dietrich at okfn.org
> Mobil: +49 171 780 870 3
> Skype: ddie22
> Twitter: @ddie
> 
> On 04.03.2011, at 10:09, Daniel Dietrich wrote:
> 
> > Dear Antti and others,
> > 
> > www.bigclean.org is part of the Word Press multisite of the OKFN. If you would like contribute with content, etc you will need to register as a "community member" at the OKFN
> > 
> > 	http://okfn.org/register/
> > 
> > I will then add you as a editor to the Big Clean. Please ping me of list once you have registered or if you need any assistance.
> > 
> > I have started with a theme (I hope you like it) but encounter a problem with the images. More precisely with timthumb.php that makes tumbnails and rezises images. I had to change :
> > 
> > 	$src = preg_replace("/\.\.+\//", "", $src);
> > 	to
> > 	$src = preg_replace("/files/", "/wp-content/blogs.dir/26/files/", $src);
> > 
> > Just in case that someone has similar problems. Now it works and we can start adding content.
> > 
> > Regards
> > Daniel
> > 
> > On 03.03.2011, at 19:55, Antti Poikola wrote:
> > 
> >> Cool Daniel!
> >> 
> >> Could I get rights to create content:
> >> 
> >> username: apoikola
> >> 
> >> -Jogi
> >> 
> >> On 03/03/2011 04:37 PM, Daniel Dietrich wrote:
> >>> Hi all
> >>> 
> >>> website is online: http://bigclean.org/
> >>> 
> >>> I am now working on design / themeing
> >>> 
> >>> And adding some structure and content to the side. More later today...
> >>> 
> >>> Daniel
> >>> 
> >>> 
> >>> 
> >>> 
> >>> On 03.03.2011, at 12:29, Rufus Pollock wrote:
> >>> 
> >>>> On 2 March 2011 19:46, Antti Poikola<antti.poikola at gmail.com>  wrote:
> >>>>> Really great response from so many people and special thanks to Daniel for
> >>>>> volunteering to halp with the site!
> >>>>> 
> >>>>> About the general categories of data "what to scrape", I think we can take
> >>>>> the list from below and give it as inspiration for the participants.
> >>>> Can I make a suggestion: use http://ckan.net/ :)
> >>>> 
> >>>> Specifically let's agree the tag: bigclean (or thebigclean) and then
> >>>> just tag (and register) relevant datasets on ckan. Remember you can
> >>>> register datasets on CKAN which don't yet have any downloadable
> >>>> resources (but would after the big clean ;) )
> >>>> 
> >>>> Rufus
> >>>> 
> >>>>> -Jogi
> >>>>> 
> >>>>> PS:
> >>>>> 
> >>>>> I allready invited some of you in person to subscribe to the list where we
> >>>>> organize the Big Clean - bigclean at lists.okfn.org. But here the subscription
> >>>>> link for all: http://lists.okfn.org/mailman/listinfo/bigclean
> >>>>> 
> >>>>> 
> >>>>> On 03/02/2011 06:36 PM, Chris Taggart wrote:
> >>>>> 
> >>>>> Off the top of my head, I'd say (and some of them overlap):
> >>>>> 
> >>>>> 1) Democratic data: elected members, committee membership, meetings,
> >>>>> minutes, agendas, electoral districts
> >>>>> 2) Financial data: spending, accounts, budgets, contracts
> >>>>> 3) Geographic data: boundaries (inc electoral districts), buildings,
> >>>>> assets (e.g. schools, hospital, depots)
> >>>>> 4) Demographic data (often held by national statistics bodies)
> >>>>> 5) Performance data - education, social care, road maintenance, etc,
> >>>>> which is often delivered at the local level.
> >>>>> 6) Policy data: forward plans, zoning/planning approvals
> >>>>> 7) Transport data
> >>>>> 
> >>>>> I'd love to see OpenlyLocal be the focus of some of this, in part
> >>>>> because it makes sense, in part because we've done a lot of the work
> >>>>> and could avoid reinventing the wheel, in part because it would be
> >>>>> nice to get other countries' data in there, and in part it would be
> >>>>> nice to get some EU funding for what up to now has been entirely
> >>>>> self-funded ;-)
> >>>>> 
> >>>>> We've also been pretty successful at doing scoreboards that make a
> >>>>> difference (over 70 UK councils now with open data sections).
> >>>>> 
> >>>>> Chris
> >>>>> 
> >>>>> 
> >>>>> 
> >>>>> _______________________________________________
> >>>>> euopendata mailing list
> >>>>> euopendata at lists.okfn.org
> >>>>> http://lists.okfn.org/mailman/listinfo/euopendata
> >>>>> 
> >>>>> 
> >>>> 
> >>>> 
> >>>> -- 
> >>>> Co-Founder, Open Knowledge Foundation
> >>>> Promoting Open Knowledge in a Digital Age
> >>>> http://www.okfn.org/ - http://blog.okfn.org/
> >>>> 
> >>>> _______________________________________________
> >>>> bigclean mailing list
> >>>> bigclean at lists.okfn.org
> >>>> http://lists.okfn.org/mailman/listinfo/bigclean
> >> 
> > 
> 
> 