[ckan-changes] commit/ckanext-pdeu: 3 new changesets
Bitbucket
commits-noreply at bitbucket.org
Tue Jun 14 14:41:24 UTC 2011
3 new changesets in ckanext-pdeu:
http://bitbucket.org/okfn/ckanext-pdeu/changeset/850eb4e87719/
changeset: 850eb4e87719
user: amercader
date: 2011-06-14 13:24:36
summary: [ckan harvester] Don't add the extras if the package was not created
affected #: 1 file (110 bytes)
--- a/ckanext/pdeu/harvesters/pdeuckan.py Mon Jun 13 16:31:09 2011 +0100
+++ b/ckanext/pdeu/harvesters/pdeuckan.py Tue Jun 14 12:24:36 2011 +0100
@@ -23,25 +23,26 @@
super(PDEUCKANHarvester, self).import_stage(harvest_object)
- # Add some extras to the newly created package
- new_extras = {
- 'eu_country': self.config.get('eu_country',''),
- 'harvest_catalogue_name': self.config.get('harvest_catalogue_name',''),
- 'harvest_catalogue_url': harvest_object.job.source.url,
- 'harvest_dataset_url': harvest_object.job.source.url.strip('/') + '/package/' + harvest_object.package_id
- }
+ if harvest_object.package_id:
+ # Add some extras to the newly created package
+ new_extras = {
+ 'eu_country': self.config.get('eu_country',''),
+ 'harvest_catalogue_name': self.config.get('harvest_catalogue_name',''),
+ 'harvest_catalogue_url': harvest_object.job.source.url,
+ 'harvest_dataset_url': harvest_object.job.source.url.strip('/') + '/package/' + harvest_object.package_id
+ }
- for extra in ['eu_nuts1','eu_nuts2','eu_nuts3']:
- if self.config.get(extra,''):
- new_extras[extra] = self.config[extra]
+ for extra in ['eu_nuts1','eu_nuts2','eu_nuts3']:
+ if self.config.get(extra,''):
+ new_extras[extra] = self.config[extra]
- context = {
- 'model': model,
- 'session': Session,
- 'user': u'harvest',
- 'id': harvest_object.package_id
- }
+ context = {
+ 'model': model,
+ 'session': Session,
+ 'user': u'harvest',
+ 'id': harvest_object.package_id
+ }
- data_dict = {'extras':new_extras}
- package_update_rest(data_dict,context)
+ data_dict = {'extras':new_extras}
+ package_update_rest(data_dict,context)
http://bitbucket.org/okfn/ckanext-pdeu/changeset/1c37dd4bc5d1/
changeset: 1c37dd4bc5d1
user: amercader
date: 2011-06-14 16:10:12
summary: [merge]
affected #: 2 files (5.9 KB)
--- a/ckanext/pdeu/theme/templates/home/about.html Tue Jun 14 12:24:36 2011 +0100
+++ b/ckanext/pdeu/theme/templates/home/about.html Tue Jun 14 15:10:12 2011 +0100
@@ -6,43 +6,83 @@
<py:def function="page_title">About</py:def><py:def function="page_heading">About ${g.site_title}</py:def>
+ <py:match path="minornavigation">
+ <ul class="tabbed">
+ <li><a href="http://lod2.okfn.org">${h.icon('atom_feed')} Project
+ Blog</a></li>
+ <li><a href="/rdf/sparql">SPARQL Endpoint</a></li>
+ <li><a href="http://bitbucket.org/okfn/ckanext-pdeu">Source Code</a></li>
+ </ul>
+ </py:match>
+
+
+ <py:match path="primarysidebar">
+ <a href="http://okfn.org"><img
+ src="http://m.okfn.org/images/logo/logo_fullname_medium.png" /></a>
+
+ <br/><br/>
+ publicdata.eu is developed by the <a
+ href="http://okfn.org">Open Knowledge Foundation</a>, a UK-based non-profit as part of the
+ <a href="http://lod2.eu">LOD2 ("Creating knowledge out of interlinked
+ data")</a> project. LOD2 is an ICT research project
+ <a
+ href="http://cordis.europa.eu/fetch?CALLER=PROJ_ICT&ACTION=D&CAT=PROJ&RCN=95562">financed under</a>
+ the European Commission's 7th Framework Programme.
+ <br/><br/><br/>
+ <a href="http://lod2.eu"><img src="http://localhost:5000/img/lod2.png"
+ alt="LOD2" style="margin-right: 2em;"/></a>
+ <img src="http://lod2.eu/extensions/site/sites/lod2/img/logo-7fp.png"
+ alt="7FP" />
+ <br/><br/><br/>
+
+ <p>
+ publicdata.eu is powered by <a href="http://ckan.org">CKAN</a>, a data
+ catalogue system used by various institutions and communities to
+ manage open data. CKAN and all its components are open source software
+ and used by a wide community of catalogue operators from across Europe,
+ including the UK Government's data.gov.uk portal.
+ </p>
+ <a href="http://ckan.org"><img
+ src="http://assets.okfn.org/p/ckan/img/ckan_logo_shortname.png" /></a>
+ </py:match>
+
<div py:match="content">
-
- <p i18n:msg="">CKAN is the Comprehensive Knowledge Archive Network, a <strong>registry</strong> of <a
- href="http://opendefinition.org/">open knowledge</a> packages and projects
- (and a few closed ones).</p>
-
- <p i18n:msg="">CKAN makes it easy to <strong>find, share and reuse open
- content and data</strong>, especially in ways that are machine
- automatable.
- </p>
-
- <p>As a system CKAN functions as a synthesis of several different services:</p>
-
- <img src="${g.site_url}/images/ckan-features.png" alt="CKAN Features Overview" style="margin-left: 4em; margin-bottom: 2em;" />
-
- <p i18n:msg="">As the diagram shows, CKAN combines the features of a listing/registry,
- a package index and a wiki. As a registry it acts like <a
- href="http://www.freshmeat.net/">freshmeat</a> but for open data and
- content resources. However it adds to a simple registry in key ways.</p>
-
- <p i18n:msg="">First, thanks to its underlying <a
- href="http://www.okfn.org/vdm/">versioned domain model</a> CKAN has a
- wiki-like interface that lets anyone add and material held in it. Second,
- and unlike a wiki, CKAN can store 'structured' information, which allows it
- to provide 'index'-like features such as automated registration, discovery
- and installation of material. In this respect it behaves like <a
- href="http://www.cpan.org/">CPAN</a> or <a
- href="http://pypi.python.org">PyPI</a> in the software world -- though
- again for <a href="http://opendefinition.org/">open data and content</a>
- not code.</p>
+<h2>What is the vision behind PublicData.eu?</h2>
+
+ <p>Over the past 18 months there has been an explosion of interest in opening up official information for the public to reuse. At a national level, numerous member states now have national data catalogues, from the <a href="http://bit.ly/dk-cat">Digitalisér.dk data portal run by the Danish National IT and Telecom Agency</a> to the UK’s <a href="http://www.data.gov.uk">data.gov.uk</a> site, launched under the direction of the founder of the World Wide Web, Sir Tim Berners-Lee.</p>
+
+ <p>There are countless city level initiatives across Europe as well – from Helsinki to Munich, Paris to Zaragoza. As many open data city as exist now, still even more initiatives exist in the pipeline with plans to launch in the next 6 to 12 months. This deluge of open, freely reusable data creates significant social and economic opportunities for European citizens.</p>
+
+ <p>New digital services enable users to have information they are interested in delivered directly to them via email, web or mobile updates. For example, in the UK, <a href="http://www.theyworkforyou.com/">TheyWorkForYou</a> lets users know every time their elected representative speaks or when a topic of interest to them is discussed in the British Parliament. Large complex datasets can be broken down and presented in more intuitive ways. For example the <a href="http://wheredoesmymoneygo.org/">WhereDoesMyMoneyGo</a> project allows users to see where their taxes go using simple and intuitive data visualisation technologies in order to demystify a complex subject.</p>
+
+ <p>Efforts are underway to <a href="http://linkeddata.org/">link and combine a large number of datasets from a large number of different sources</a>. This newfound data integration will ultimately allow developers to create new digital services capable of dealing with increasingly sophisticated questions and queries.</p>
+
+ <p>In addition to increasing transparency and improving public service delivery, open data creates opportunities for businesses to build new kinds of commercial services around this new data. This is because the data is published in a way which makes it legally and technically easy for anyone to reuse for any purpose. A recent study estimates the market based on European public sector information could be worth as much as €27 billion (see the 2006 <a href="http://bit.ly/mepsir">MEPSIR study</a>).</p>
+
+ <p>In order to unlock the potential of digital public sector information, developers and other prospective users must be able to find datasets they are interested in reusing. PublicData.eu will provide a single point of access to open, freely reusable datasets from numerous national, regional and local public bodies throughout Europe.</p>
+
+ <p>Information about European public datasets is currently scattered across many different data catalogues, portals and websites in many different languages, implemented using many different technologies. The kinds of information stored about public datasets may vary from country to country, and from registry to registry. PublicData.eu will harvest and federate this information to enable users to search, query, process, cache and perform other automated tasks on the data from a single place. This helps to solve the “discoverability problem” of finding interesting data across many different government websites, at many different levels of government, and across the many governments in Europe.</p>
+
+ <p>In addition to providing access to official information about datasets from public bodies, PublicData.eu will capture (proposed) edits, annotations, comments and uploads from the broader community of public data users. In this way, PublicData.eu will harness the social aspect of working with data to create opportunities for mass collaboration. For example, a web developer might download a dataset, convert it into a new format, upload it and add a link to the new version of the dataset for others to use. From fixing broken URLs or typos in descriptions to substantive comments or supplementary documentation about using the datasets, PublicData.eu will provide up to date information for data users, by data users.</p>
+
+ <p>Non-technical users, including researchers, journalists, ordinary citizens, will be able to use PublicData.eu to browse data and be able to find answers to questions. This will be accomplished through providing basic data analysis and visualisation tools together with more in-depth resources for those looking to dig deeper into the data. Users will be able to personalise their data browsing experience by being able to save links and create notes and comments on datasets.</p>
+
+<h2>What problems is PublicData.eu responding to?</h2>
+
+ <p>Following are some problems and scenarios that PublicData.eu could help to respond to:</p>
+
+ <ul>
+ <li>It can be difficult to find datasets on official websites (e.g. often datasets are buried deep in websites, little or no relevant metadata for search engines, etc)</li>
+ <li>Links may be broken (cf. <a href="http://www.ijdc.net/index.php/ijdc/article/viewFile/106/81">John Sheridan et al’s 2009 study on broken links in Hansard</a>)</li>
+ <li>Those looking for public datasets may have to trawl many different government websites (local, regional, national, …).</li>
+ <li>There may be language barriers to finding datasets on the websites of public bodies in different countries.</li>
+ <li>Licensing of government data is not clear so its not clear what users can and can’t do with it</li>
+ <li>Lots of material is only available via a web interface, not available for download in bulk</li>
+ <li>For some types of information it is desirable to aggregate/compare data from many different member states, which is currently very difficult.</li>
+ <li>Currently most official EU data catalogues do not have any mechanism to capture value added to the datasets (or metadata about datasets) by users.</li>
+ </ul>
- <p i18n:msg="">More about CKAN, and the background to its creation can
- be found in <a
- href="http://m.okfn.org/files/talks/opentech_20080705/">these
- slides</a>.</p>
-
- </div>
+ </div><xi:include href="layout.html" /></html>
--- a/ckanext/pdeu/theme/templates/home/index.html Tue Jun 14 12:24:36 2011 +0100
+++ b/ckanext/pdeu/theme/templates/home/index.html Tue Jun 14 15:10:12 2011 +0100
@@ -62,6 +62,11 @@
padding: 0.5em;
}
+ .banner ul {
+ list-style-type: none;
+ padding: 0;
+ }
+
.below {
margin-top: 3em;
}
@@ -83,14 +88,12 @@
<div class="banner"><div class="container"><div class="clearfix"></div>
- <div id="map" class="span-24 last"></div>
+ <div id="map" class=""></div><h1>europe's public data</h1><form action="/package" method="GET"><input name="q" placeholder="Find datasets" /></form>
- <div class="clearfix"></div>
- <div id="map-link" style="float:right;margin-right:40px;margin-bottom: 5px"><a href="/map">View larger map [+]</a></div><div class="span-6"><ul class="facet-options"><li py:for="name, count in h.facet_items(c, 'groups', limit=9)[0::2]">
@@ -105,7 +108,8 @@
</li></ul></div>
-
+ <div class="clearfix"></div>
+ <div id="map-link" style="float:right;margin-right:40px;margin-bottom: 5px"><a href="/map">View larger map [+]</a></div></div></div>
http://bitbucket.org/okfn/ckanext-pdeu/changeset/60313dd60099/
changeset: 60313dd60099
user: amercader
date: 2011-06-14 16:41:10
summary: Remove hardcoded local server
affected #: 1 file (21 bytes)
--- a/ckanext/pdeu/theme/public/js/map.js Tue Jun 14 15:10:12 2011 +0100
+++ b/ckanext/pdeu/theme/public/js/map.js Tue Jun 14 15:41:10 2011 +0100
@@ -40,7 +40,7 @@
html += "<div class=\"local_name\">" + feature.attributes.NAME_LOCAL+"</div>"
html += "<div class=\"packages\">";
if (feature.attributes.packages){
- html += "<a href=\"http://localhost:5000/package?extras_eu_country=" + feature.attributes.NUTS + "\">" +
+ html += "<a href=\"/package?extras_eu_country=" + feature.attributes.NUTS + "\">" +
feature.attributes.packages+" packages";
} else {
html += "No packages yet";
Repository URL: https://bitbucket.org/okfn/ckanext-pdeu/
--
This is a commit notification from bitbucket.org. You are receiving
this because you have the service enabled, addressing the recipient of
this email.
More information about the ckan-changes
mailing list