[okfn-discuss] A map of the global civic tech community on GitHub - groups connected via Poplus.org network

Sun Dec 13 16:55:09 UTC 2015

Check out this "map" of organizations and their open gov/civic tech
code on GitHub:

   http://sbaack.com/2015/11/19/scraping-the-global-civic-tech-community-on-github-part-2.html

This is what was recruited first via the Poplus.org unconference in
Chile in May 2014 and then the big 3 month push I led to build
membership on the Poplus Google Group: http://bit.ly/poplusgroup

Imagine what we could do with this network if further networking and
connecting gained sustained support? Funding the silos is great, but I
think this map show an opportunity to dramatically boost code sharing,
knowledge exchange and more. Steve

From: Steven Clift <clift at e-democracy.org>
Date: Sun, Dec 13, 2015 at 10:47 AM
Subject: Re: [Poplus] Scraping the global civic tech community on GitHub
To: Stefan Baack <s.baack at gmail.com>
Cc: Poplus - Collaborative Civic Coding <poplus at googlegroups.com>

If you haven't checked out the image of OUR org connections on GitHub
among those who joined the Poplus.org Google Group, see it here:

http://sbaack.com/2015/11/19/scraping-the-global-civic-tech-community-on-github-part-2.html

The Follower network:
http://sbaack.com/downloads/follower-network_2015-11-19.png

The Contributer network:
http://sbaack.com/downloads/contributor-network_2015-11-19.png

So what do you "see" looking at these images?

What opportunities for greater connections and collaboration among
orgs/code might exist?

Who is still MISSING from your GitHub experience with civic code from
the Poplus network?

Steve
Steven Clift  -  Executive Director, E-Democracy.org
   clift at e-democracy.org  -  +1 612 234 7072
   @democracy  -  http://linkedin.com/in/netclift
   http://1radionews.com - My radio app

On Thu, Nov 19, 2015 at 4:58 PM, Stefan Baack <s.baack at gmail.com> wrote:
> Thank you James, this is great! Never thought about filtering out home
> organizations :-)
>
> You're right, the graph is a bit off. I think the problem is that my scraper
> does not check whether a repo is forked. I had a similar problem with users
> because users can be part of more than one organization of course, but I
> wasn't sure how to reflect this in the graph. I decided that this is
> tolerable because the colors should only give a rough sense of where an
> organization located in the graph. I think a CSV file would be better for
> the kind of analysis you did. Maybe I try scraping a bit more tomorrow,
> GitHub doesn't like me right now :-)
>
>
> On Thursday, November 19, 2015 at 11:26:51 PM UTC+1, James McKinney wrote:
>>
>> Note that there is some overcounting when counting the distinct
>> organizations to which a user contributed, because the organization of some
>> repositories is incorrect (e.g. alaveteli is mysociety, not Sobanukirwa).
>> However, the graph has only one alaveteli, so there is no overcounting of
>> repositories - as far as I can tell.
>>
>> On Thursday, November 19, 2015 at 5:18:13 PM UTC-5, James McKinney wrote:
>>>
>>> Nice! I have been curious to know who contributes the most *outside*
>>> their home organizations. rgrp is indeed prolific, but 115 of his 133
>>> repositories are within the okfn organization. If we remove people’s home
>>> organizations, we get this list:
>>>
>>>  47 jpmckinney
>>>  22 dracos
>>>  21 mhl
>>>  19 zarino
>>>  18 konklone
>>>  17 duncanparkes
>>>  16 invalid-email-address
>>>  16 rgrp
>>>  16 andylolz
>>>  16 evdb
>>>
>>> I see I’m in good company! :)
>>>
>>> The code for this is at
>>> https://gist.github.com/jpmckinney/56632f96808ef1ee326d
>>>
>>> The script can also print out the top organizations to which those users
>>> contributed, as follows:
>>>
>>>  47 jpmckinney
>>>    10 mysociety
>>>     8 datamade
>>>     6 sunlightlabs
>>>  22 dracos
>>>     3 datauy
>>>     3 ciudadanointeligente
>>>     3 openpolis
>>>  21 mhl
>>>     3 ciudadanointeligente
>>>     3 datauy
>>>     3 Sobanukirwa
>>>  19 zarino
>>>     2 openpolis
>>>     2 openaustralia
>>>     2 openstate
>>>  18 konklone
>>>     4 codeforamerica
>>>     3 datamade
>>>     2 civio
>>>  17 duncanparkes
>>>     2 Code4SA
>>>     2 TEDICpy
>>>     2 Sobanukirwa
>>>  16 invalid-email-address
>>>     3 ushahidi
>>>     3 appsembler
>>>     3 hasadna
>>>  16 rgrp
>>>     2 codeforamerica
>>>     2 opengovfoundation
>>>     2 g0v
>>>  16 andylolz
>>>     3 everypolitician
>>>     2 g0v
>>>     2 datauy
>>>  16 evdb
>>>     3 ciudadanointeligente
>>>     2 Sobanukirwa
>>>     2 openstate
>>>
>>> If you instead look for the number of organizations to which users
>>> contributed outside their home organization(s) (regardless of the number of
>>> repositories contributed to within those organizations), the list is a
>>> little different:
>>>
>>>  17 jpmckinney
>>>  13 rgrp
>>>  13 pudo
>>>  13 zarino
>>>  12 duncanparkes
>>>  12 nickstenning
>>>  12 dracos
>>>  12 mhl
>>>  11 andylolz
>>>  10 henare
>>>
>>> Thanks for getting this data together!
>>>
>>> James
>>>
>>> > On Nov 19, 2015, at 3:19 PM, Stefan Baack <s.b... at gmail.com> wrote:
>>> >
>>> > Hi everyone,
>>> >
>>> > I’m a PhD student from the Netherlands and I’m currently working on a
>>> > research project about civic hacking at mySociety. In connection with this
>>> > research, I started a little experiment: scraping information about civic
>>> > tech organizations on GitHub to get a grasp of the global community. After I
>>> > posted a first draft on mySociety's community mailing list I got a lot of
>>> > feedback and help to compile a bigger, more complete dataset. As a result,
>>> > here is an update version of the article:
>>> >
>>> >
>>> >
>>> > http://sbaack.com/2015/11/19/scraping-the-global-civic-tech-community-on-github-part-2.html
>>> >
>>> > I hope it's interesting for you and I would love to hear your thoughts
>>> > about this :-)
>>> > Best,
>>> > Stefan
>>> >
>>> >
>>> > --
>>> > Poplus.org - Get involved: http://poplus.org/get-involved
>>> > IRC: #poplus https://webchat.freenode.net
>>> > Docs: http://bit.ly/poplusdrive
>>> > ---
>>> > You received this message because you are subscribed to the Google
>>> > Groups "Poplus - Collaborative Civic Coding" group.
>>> > To unsubscribe from this group and stop receiving emails from it, send
>>> > an email to poplus+un... at googlegroups.com.
>>> > To post to this group, send email to pop... at googlegroups.com.
>>> > Visit this group at http://groups.google.com/group/poplus.
>>> > To view this discussion on the web, visit
>>> > https://groups.google.com/d/msgid/poplus/3e3eb88d-5278-4063-9916-342ecaacccc8%40googlegroups.com.
>>> > For more options, visit https://groups.google.com/d/optout.
>>>
> --
> Poplus.org - Get involved: http://poplus.org/get-involved
> IRC: #poplus https://webchat.freenode.net
> Docs: http://bit.ly/poplusdrive
> ---
> You received this message because you are subscribed to the Google Groups
> "Poplus - Collaborative Civic Coding" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to poplus+unsubscribe at googlegroups.com.
> To post to this group, send email to poplus at googlegroups.com.
> Visit this group at http://groups.google.com/group/poplus.
> To view this discussion on the web, visit
> https://groups.google.com/d/msgid/poplus/7e6ff44b-56e4-45b4-ba00-4afa23b24f35%40googlegroups.com.
>
> For more options, visit https://groups.google.com/d/optout.