[ECODP-dev] application/json header
John Glover
john.glover at okfn.org
Wed Nov 13 09:39:12 UTC 2013
Hi Bert,
I have just tried doing a package update on the JSON file
"ESTAT_20131020230103_spr_exp_fsu.json" that you sent on. The status and
type_of_dataset controlled vocabularies were still using the old XML
namespace, but after I updated that the request worked as expected (I
changed the RDF so that the xmlns:ecodp attribute at the top has
test.ec.europa.eu..., which you can see if you query it now).
So, if this file is still failing for you then I can only conclude that it
is something to do with the request that is being made.
Could you make a request to something like with just this file to
http://httpbin.org/post instead of our API and double check what is being
sent? (httpbin is a service for debugging requests, /post will just return
whatever you send it). For reference, here is what I get for that file:
{
"headers": {
"Authorization": "1234",
"Content-Type": "application/json",
"Host": "httpbin.org",
"Connection": "close",
"Content-Length": "8182",
"Accept": "*/*",
"Accept-Encoding": "gzip, deflate, compress",
"User-Agent": "python-requests/1.2.3 CPython/2.7.3 Darwin/10.8.0"
},
"args": {},
"files": {},
"json": {
"contact_telephone": "tel: +352 430136789",
"description": "Tables by benefits - survivors function",
"geographical_coverage": [],
"published_by": "estat",
"modified_date": "2012-11-09",
"title": "Tables by benefits - survivors function",
"url": "http://ec.europa.eu/eurostat/product?code=spr_exp_fsu",
"contact_address": "Joseph Bech building, 5 Rue Alphonse Weicker,
L-2721 Luxembourg",
"rdf": "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<rdf:RDF
xmlns:dcat=\"http://www.w3.org/ns/dcat#\"\n xmlns:dct=\"
http://purl.org/dc/terms/\"\n xmlns:ecodp=\"
http://test.ec.europa.eu/open-data/ontologies/ec-odp#\"\n xmlns:foaf=\"
http://xmlns.com/foaf/0.1/\"\n xmlns:rdf=\"
http://www.w3.org/1999/02/22-rdf-syntax-ns#\" xmlns:skos=\"
http://www.w3.org/2004/02/skos/core#\">\n <dcat:Dataset rdf:about=\"
http://ec.europa.eu/eurostat/product?code=spr_exp_fsu\">\n <dct:title
xml:lang=\"en\">Tables by benefits - survivors function</dct:title>\n
<dct:title xml:lang=\"fr\">Tableaux par prestations - fonction
survie</dct:title>\n <dct:title xml:lang=\"de\">Tabellen pro Leistungen
- Funktion Hinterbliebene</dct:title>\n
<dct:identifier>spr_exp_fsu</dct:identifier>\n <dct:description
xml:lang=\"en\">Tables by benefits - survivors function</dct:description>\n
<dct:description xml:lang=\"fr\">Tableaux par prestations - fonction
survie</dct:description>\n <dct:description xml:lang=\"de\">Tabellen pro
Leistungen - Funktion Hinterbliebene</dct:description>\n
<ecodp:datasetType>\n <skos:Concept rdf:about=\"
http://ec.europa.eu/open-data/kos/dataset-type/Statistical\"/>\n
</ecodp:datasetType>\n <ecodp:isDocumentedBy
rdf:parseType=\"Resource\">\n <ecodp:documentationType>\n
<skos:Concept rdf:about=\"
http://ec.europa.eu/open-data/kos/documentation-type/MainDocumentation\"/>\n
</ecodp:documentationType>\n <dct:title xml:lang=\"en\">ESMS
metadata (Euro-SDMX Metadata structure) HTML</dct:title>\n
<ecodp:accessURL rdf:datatype=\"http://www.w3.org/2001/XMLSchema#anyURI\">
http://epp.eurostat.ec.europa.eu/cache/ITY_SDDS/en/spr_esms.htm</ecodp:accessURL>\n
</ecodp:isDocumentedBy>\n <ecodp:isDocumentedBy
rdf:parseType=\"Resource\">\n <ecodp:documentationType>\n
<skos:Concept rdf:about=\"
http://ec.europa.eu/open-data/kos/documentation-type/RelatedWebPage\"/>\n
</ecodp:documentationType>\n <dct:title xml:lang=\"en\">ESMS
metadata (Euro-SDMX Metadata structure) SDMX</dct:title>\n
<ecodp:accessURL rdf:datatype=\"http://www.w3.org/2001/XMLSchema#anyURI\">
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=metadata/en/spr_esms.sdmx.zip</ecodp:accessURL>\n
</ecodp:isDocumentedBy>\n <ecodp:isDocumentedBy
rdf:parseType=\"Resource\">\n <ecodp:documentationType>\n
<skos:Concept rdf:about=\"
http://ec.europa.eu/open-data/kos/documentation-type/RelatedWebPage\"/>\n
</ecodp:documentationType>\n <dct:title xml:lang=\"en\">More
information on Eurostat Website</dct:title>\n <dct:title
xml:lang=\"fr\">Plus dinformation sur le site web dEurostat</dct:title>\n
<dct:title xml:lang=\"de\">Mehr Informationen auf der Eurostat
Website</dct:title>\n <ecodp:accessURL rdf:datatype=\"
http://www.w3.org/2001/XMLSchema#anyURI\">
http://ec.europa.eu/eurostat/product?code=spr_exp_fsu&language=en</ecodp:accessURL>\n
</ecodp:isDocumentedBy>\n <dcat:distribution
rdf:parseType=\"Resource\">\n <dcat:accessURL rdf:datatype=\"
http://www.w3.org/2001/XMLSchema#anyURI\">
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.tsv.gz</dcat:accessURL>\n
<rdf:type rdf:resource=\"http://www.w3.org/TR/vocab-dcat#Download\"/>\n
<dct:description xml:lang=\"en\">Download dataset in TSV
format</dct:description>\n
<ecodp:distributionFormat>application/x-gzip</ecodp:distributionFormat>\n
</dcat:distribution>\n <dcat:distribution
rdf:parseType=\"Resource\">\n <dcat:accessURL rdf:datatype=\"
http://www.w3.org/2001/XMLSchema#anyURI\">
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.dft.gz</dcat:accessURL>\n
<rdf:type rdf:resource=\"http://www.w3.org/TR/vocab-dcat#Download\"/>\n
<dct:description xml:lang=\"en\">Download dataset in DFT
format</dct:description>\n
<ecodp:distributionFormat>application/x-gzip</ecodp:distributionFormat>\n
</dcat:distribution>\n <dcat:distribution
rdf:parseType=\"Resource\">\n <dcat:accessURL rdf:datatype=\"
http://www.w3.org/2001/XMLSchema#anyURI\">
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.sdmx.zip</dcat:accessURL>\n
<rdf:type rdf:resource=\"http://www.w3.org/TR/vocab-dcat#Download\"/>\n
<dct:description xml:lang=\"en\">Download dataset in SDMX-ML
format</dct:description>\n
<ecodp:distributionFormat>application/zip</ecodp:distributionFormat>\n
</dcat:distribution>\n <dct:modified>2012-11-09</dct:modified>\n
<dct:publisher>\n <skos:Concept rdf:about=\"
http://publications.europa.eu/resource/authority/corporate-body/ESTAT\"/>\n
</dct:publisher>\n <ecodp:contactPoint>\n <foaf:Agent
rdf:about=\"http://ec.europa.eu/dgs/information_society\">\n
<foaf:phone rdf:resource=\"tel: +352 430136789\"/>\n
<foaf:workplaceHomepage rdf:resource=\"
http://epp.eurostat.ec.europa.eu/portal/page/portal/help/user_support\"/>\n
<ecodp:contactAddress xml:lang=\"en\">Joseph Bech building, 5 Rue
Alphonse Weicker, L-2721 Luxembourg</ecodp:contactAddress>\n
<foaf:name xml:lang=\"en\">Eurostat, the statistical office of the
European Union</foaf:name>\n </foaf:Agent>\n
</ecodp:contactPoint>\n <dct:license>\n <skos:Concept rdf:about=\"
http://ec.europa.eu/open-data/kos/licence/EuropeanCommission\"/>\n
</dct:license>\n <ecodp:datasetStatus>\n <skos:Concept rdf:about=\"
http://ec.europa.eu/open-data/kos/dataset-status/Completed\"/>\n
</ecodp:datasetStatus>\n <dct:temporal>\n <dct:PeriodOfTime>\n
<ecodp:periodStart>1990</ecodp:periodStart>\n
<ecodp:periodEnd>2010</ecodp:periodEnd>\n </dct:PeriodOfTime>\n
</dct:temporal>\n </dcat:Dataset>\n</rdf:RDF>\n",
"name": "ZzY41z7IswzHKTnxEaMjA",
"license_id": [
"http://ec.europa.eu/open-data/kos/licence/EuropeanCommission"
],
"resources": [
{
"type": "
http://ec.europa.eu/open-data/kos/documentation-type/MainDocumentation",
"url": "
http://epp.eurostat.ec.europa.eu/cache/ITY_SDDS/en/spr_esms.htm",
"name": "ESMS metadata (Euro-SDMX Metadata structure) HTML"
},
{
"type": "
http://ec.europa.eu/open-data/kos/documentation-type/RelatedWebPage",
"url": "
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=metadata/en/spr_esms.sdmx.zip
",
"name": "ESMS metadata (Euro-SDMX Metadata structure) SDMX"
},
{
"type": "
http://ec.europa.eu/open-data/kos/documentation-type/RelatedWebPage",
"url": "
http://ec.europa.eu/eurostat/product?code=spr_exp_fsu&language=en",
"name": "More information on Eurostat Website"
},
{
"type": "http://www.w3.org/TR/vocab-dcat#Download",
"format": "application/x-gzip",
"url": "
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.tsv.gz
",
"description": "Download dataset in TSV format"
},
{
"type": "http://www.w3.org/TR/vocab-dcat#Download",
"format": "application/x-gzip",
"url": "
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.dft.gz
",
"description": "Download dataset in DFT format"
},
{
"type": "http://www.w3.org/TR/vocab-dcat#Download",
"format": "application/zip",
"url": "
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.sdmx.zip
",
"description": "Download dataset in SDMX-ML format"
}
],
"capacity": "public",
"type_of_dataset": [
"http://open-data.europa.eu/kos/dataset-type/Statistical"
],
"language": [],
"keyword_string": [],
"contact_name": "Eurostat, the statistical office of the European
Union",
"identifier": "spr_exp_fsu",
"status": "http://open-data.europa.eu/kos/dataset-status/Completed",
"state": "active",
"interoperability_level": []
},
"form": {},
"data": "{\"status\": \"
http://open-data.europa.eu/kos/dataset-status/Completed\",
\"modified_date\": \"2012-11-09\", \"contact_address\": \"Joseph Bech
building, 5 Rue Alphonse Weicker, L-2721 Luxembourg\", \"capacity\":
\"public\", \"description\": \"Tables by benefits - survivors function\",
\"language\": [], \"state\": \"active\", \"url\": \"
http://ec.europa.eu/eurostat/product?code=spr_exp_fsu\",
\"keyword_string\": [], \"title\": \"Tables by benefits - survivors
function\", \"published_by\": \"estat\", \"type_of_dataset\": [\"
http://open-data.europa.eu/kos/dataset-type/Statistical\"],
\"contact_telephone\": \"tel: +352 430136789\", \"geographical_coverage\":
[], \"rdf\": \"<?xml version=\\\"1.0\\\"
encoding=\\\"UTF-8\\\"?>\\n<rdf:RDF xmlns:dcat=\\\"
http://www.w3.org/ns/dcat#\\\"\\n xmlns:dct=\\\"
http://purl.org/dc/terms/\\\"\\n xmlns:ecodp=\\\"
http://test.ec.europa.eu/open-data/ontologies/ec-odp#\\\"\\n
xmlns:foaf=\\\"http://xmlns.com/foaf/0.1/\\\"\\n xmlns:rdf=\\\"
http://www.w3.org/1999/02/22-rdf-syntax-ns#\\\" xmlns:skos=\\\"
http://www.w3.org/2004/02/skos/core#\\\">\\n <dcat:Dataset rdf:about=\\\"
http://ec.europa.eu/eurostat/product?code=spr_exp_fsu\\\">\\n <dct:title
xml:lang=\\\"en\\\">Tables by benefits - survivors function</dct:title>\\n
<dct:title xml:lang=\\\"fr\\\">Tableaux par prestations - fonction
survie</dct:title>\\n <dct:title xml:lang=\\\"de\\\">Tabellen pro
Leistungen - Funktion Hinterbliebene</dct:title>\\n
<dct:identifier>spr_exp_fsu</dct:identifier>\\n <dct:description
xml:lang=\\\"en\\\">Tables by benefits - survivors
function</dct:description>\\n <dct:description
xml:lang=\\\"fr\\\">Tableaux par prestations - fonction
survie</dct:description>\\n <dct:description
xml:lang=\\\"de\\\">Tabellen pro Leistungen - Funktion
Hinterbliebene</dct:description>\\n <ecodp:datasetType>\\n
<skos:Concept rdf:about=\\\"
http://ec.europa.eu/open-data/kos/dataset-type/Statistical\\\"/>\\n
</ecodp:datasetType>\\n <ecodp:isDocumentedBy
rdf:parseType=\\\"Resource\\\">\\n <ecodp:documentationType>\\n
<skos:Concept rdf:about=\\\"
http://ec.europa.eu/open-data/kos/documentation-type/MainDocumentation\\\"/>\\n
</ecodp:documentationType>\\n <dct:title xml:lang=\\\"en\\\">ESMS
metadata (Euro-SDMX Metadata structure) HTML</dct:title>\\n
<ecodp:accessURL rdf:datatype=\\\"
http://www.w3.org/2001/XMLSchema#anyURI\\\">
http://epp.eurostat.ec.europa.eu/cache/ITY_SDDS/en/spr_esms.htm</ecodp:accessURL>\\n
</ecodp:isDocumentedBy>\\n <ecodp:isDocumentedBy
rdf:parseType=\\\"Resource\\\">\\n <ecodp:documentationType>\\n
<skos:Concept rdf:about=\\\"
http://ec.europa.eu/open-data/kos/documentation-type/RelatedWebPage\\\"/>\\n
</ecodp:documentationType>\\n <dct:title xml:lang=\\\"en\\\">ESMS
metadata (Euro-SDMX Metadata structure) SDMX</dct:title>\\n
<ecodp:accessURL rdf:datatype=\\\"
http://www.w3.org/2001/XMLSchema#anyURI\\\">
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=metadata/en/spr_esms.sdmx.zip</ecodp:accessURL>\\n
</ecodp:isDocumentedBy>\\n <ecodp:isDocumentedBy
rdf:parseType=\\\"Resource\\\">\\n <ecodp:documentationType>\\n
<skos:Concept rdf:about=\\\"
http://ec.europa.eu/open-data/kos/documentation-type/RelatedWebPage\\\"/>\\n
</ecodp:documentationType>\\n <dct:title xml:lang=\\\"en\\\">More
information on Eurostat Website</dct:title>\\n <dct:title
xml:lang=\\\"fr\\\">Plus dinformation sur le site web
dEurostat</dct:title>\\n <dct:title xml:lang=\\\"de\\\">Mehr
Informationen auf der Eurostat Website</dct:title>\\n <ecodp:accessURL
rdf:datatype=\\\"http://www.w3.org/2001/XMLSchema#anyURI\\\">
http://ec.europa.eu/eurostat/product?code=spr_exp_fsu&language=en</ecodp:accessURL>\\n
</ecodp:isDocumentedBy>\\n <dcat:distribution
rdf:parseType=\\\"Resource\\\">\\n <dcat:accessURL rdf:datatype=\\\"
http://www.w3.org/20\\\">\\n <dcat:accessURL rdf:datatype=\\\"
http://www.w3.org/2001/XMLSchema#anyURI\\\">
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.dft.gz</dcat:accessURL>\\n
<rdf:type rdf:resource=\\\"http://www.w3.org/TR/vocab-dcat#Download\\\"/>\\n
<dct:description xml:lang=\\\"en\\\">Download dataset in DFT
format</dct:description>\\n
<ecodp:distributionFormat>application/x-gzip</ecodp:distributionFormat>\\n
</dcat:distribution>\\n <dcat:distribution
rdf:parseType=\\\"Resource\\\">\\n <dcat:accessURL rdf:datatype=\\\"
http://www.w3.org/2001/XMLSchema#anyURI\\\">
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.sdmx.zip</dcat:accessURL>\\n
<rdf:type rdf:resource=\\\"http://www.w3.org/TR/vocab-dcat#Download\\\"/>\\n
<dct:description xml:lang=\\\"en\\\">Download dataset in SDMX-ML
format</dct:description>\\n
<ecodp:distributionFormat>application/zip</ecodp:distributionFormat>\\n
</dcat:distribution>\\n <dct:modified>2012-11-09</dct:modified>\\n
<dct:publisher>\\n <skos:Concept rdf:about=\\\"
http://publications.europa.eu/resource/authority/corporate-body/ESTAT\\\"/>\\n
</dct:publisher>\\n <ecodp:contactPoint>\\n <foaf:Agent
rdf:about=\\\"http://ec.europa.eu/dgs/information_society\\\">\\n
<foaf:phone rdf:resource=\\\"tel: +352 430136789\\\"/>\\n
<foaf:workplaceHomepage rdf:resource=\\\"
http://epp.eurostat.ec.europa.eu/portal/page/portal/help/user_support\\\"/>\\n
<ecodp:contactAddress xml:lang=\\\"en\\\">Joseph Bech building, 5
Rue Alphonse Weicker, L-2721 Luxembourg</ecodp:contactAddress>\\n
<foaf:name xml:lang=\\\"en\\\">Eurostat, the statistical office of the
European Union</foaf:name>\\n </foaf:Agent>\\n
</ecodp:contactPoint>\\n <dct:license>\\n <skos:Concept
rdf:about=\\\"
http://ec.europa.eu/open-data/kos/licence/EuropeanCommission\\\"/>\\n
</dct:license>\\n <ecodp:datasetStatus>\\n <skos:Concept
rdf:about=\\\"http://ec.europa.eu/open-data/kos/dataset-status/Completed\\\"/>\\n
</ecodp:datasetStatus>\\n <dct:temporal>\\n
<dct:PeriodOfTime>\\n
<ecodp:periodStart>1990</ecodp:periodStart>\\n
<ecodp:periodEnd>2010</ecodp:periodEnd>\\n </dct:PeriodOfTime>\\n
</dct:temporal>\\n </dcat:Dataset>\\n</rdf:RDF>\\n\", \"license_id\": [\"
http://ec.europa.eu/open-data/kos/licence/EuropeanCommission\"],
\"contact_name\": \"Eurostat, the statistical office of the European
Union\", \"identifier\": \"spr_exp_fsu\", \"interoperability_level\": [],
\"resources\": [{\"url\": \"
http://epp.eurostat.ec.europa.eu/cache/ITY_SDDS/en/spr_esms.htm\",
\"type\": \"
http://ec.europa.eu/open-data/kos/documentation-type/MainDocumentation\",
\"name\": \"ESMS metadata (Euro-SDMX Metadata structure) HTML\"}, {\"url\":
\"
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=metadata/en/spr_esms.sdmx.zip\",
\"type\": \"
http://ec.europa.eu/open-data/kos/documentation-type/RelatedWebPage\",
\"name\": \"ESMS metadata (Euro-SDMX Metadata structure) SDMX\"}, {\"url\":
\"http://ec.europa.eu/eurostat/product?code=spr_exp_fsu&language=en\",
\"type\": \"
http://ec.europa.eu/open-data/kos/documentation-type/RelatedWebPage\",
\"name\": \"More information on Eurostat Website\"}, {\"url\": \"
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.tsv.gz\",
\"type\": \"http://www.w3.org/TR/vocab-dcat#Download\", \"description\":
\"Download dataset in TSV format\", \"format\": \"application/x-gzip\"},
{\"url\": \"
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.dft.gz\",
\"type\": \"http://www.w3.org/TR/vocab-dcat#Download\", \"description\":
\"Download dataset in DFT format\", \"format\": \"application/x-gzip\"},
{\"url\": \"
http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?file=data/spr_exp_fsu.sdmx.zip\",
\"type\": \"http://www.w3.org/TR/vocab-dcat#Download\", \"description\":
\"Download dataset in SDMX-ML format\", \"format\": \"application/zip\"}],
\"name\": \"ZzY41z7IswzHKTnxEaMjA\"}", "origin": "xx.xx.xx.xx", "url": "
http://httpbin.org/post"}
Regards,
John
On 13 November 2013 09:36, Bert Van Nuffelen <bert.van.nuffelen at tenforce.com
> wrote:
> Hi John,
>
> I retested this morning on the test server with the latest CKAN build the
> situation.
> We get the feedback from CKAN now that there is a parsing problem. That is
> fine now.
> But we do now sent also in the header the application/json. See the logs
> in the directory
> /applications/ecodp/users/ecodp/John/rdf2ckanlogs/20131113_102938
>
> It seems as if CKAN is ignoring the flag at all.
>
> Can you investigate?
>
> best,
>
> Bert
>
> --
> Bert Van Nuffelen
>
> Semantic Technologies Software Architect at TenForce
> www.tenforce.be
>
> Bert.Van.Nuffelen at tenforce.com
> Office: +32 (0)16 31 48 60
> Mobile:+32 479 06 24 26
> skype: bert.van.nuffelen
>
> _______________________________________________
> Ecodp-dev mailing list
> Ecodp-dev at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20131113/249123d6/attachment.html>
More information about the ecodp-dev
mailing list