[ckan-dev] ckanext-validation validation problems

Fri Apr 6 07:46:31 UTC 2018

Hi Adria!

I think file has large fields (in the example above, there is a large field
called SDOGEOMETRIA).

For example, this resource [1] returns "bad adrress" error[2] and this file
has 1.521 rows.

json validation is public, you can see it in [3].

[1]:
http://datosabiertos.malaga.eu/dataset/sistema-de-informacion-cartografica-hidrografia/resource/62e9cfc5-f6eb-46bb-b8b2-19c2fa3dc157
[2]:

El formulario contiene entradas no válidas:

   - validation: {u'tables': [{u'error-count': 1, u'format': u'csv',
   u'row-count': 0, u'encoding': None, u'headers': [], u'errors':
   [{u'message': u'("Connection broken: error(14, \'Bad address\')", error(14,
   \'Bad address\'))', u'code': u'source-error', u'row-number': None,
   u'column-number': None, u'row': None}], u'source': u'
   http://datosabiertos.malaga.eu/recursos/urbanismoEInfraestructura/planimetria/callejero/da_cartografiaHidrografia-25830.csv',
   u'time': 0.042, u'scheme': None, u'valid': False, u'schema':
   u'table-schema'}], u'error-count': 1, u'table-count': 1, u'warnings': [],
   u'valid': False, u'time': 0.048, u'preset': u'table'}

[3]:
http://datosabiertos.malaga.eu/jsonvalid/urbanismoEInfraestructura/planimetria/callejero/da_cartografiaHidrografia-csv.json

Thanks in advance.

On Thu, Apr 5, 2018 at 2:59 PM, Adrià Mercader <adria.mercader at okfn.org>
wrote:

> Hi Isabel,
>
> Can you paste a link to the file that is failing? When you say that the
> field is large, do you mean the contents, the name?
>
> Regarding 3 there is currently no way to skip the validation for a
> particular resource, although it sounds like a useful feature. I've created
> an issue to track it:
>
> https://github.com/frictionlessdata/ckanext-validation/issues/33
>
> Thanks,
>
> Adrià
>
> On 5 April 2018 at 14:08, Isabel M Ruiz Mellado <isaruizmellado at gmail.com>
> wrote:
>
>> Hi all,
>>
>> I have installed and configure ckanext-validation (and ckanext-scheming)
>> plugin and I have some problems with it... maybe someone can solve them:
>>
>> 1- If I load a CSV with a large field, validation returns *"message':
>> u'field larger than field limit (131072)'*, I configure JSON field as
>> "type": "string", "type": "object" and "any"...but it doesnt work (This
>> file was loaded in datastore correctly). Is there any type to load large
>> field?
>>
>> 2- validation returns *message': u'("Connection broken: error(14, \'Bad
>> address\')", error(14, \'Bad address\'))* but URL file is correct, if I
>> split it, validation returns ok, it seems a very long files breaks
>> validation.... Can you confirm this?
>>
>> 3- After point 1 and 2, my CKAN shows "data|invalid" on these CSV files.
>> I want these messages to desappear, so I edit resource and clear "Data
>> Schema" field, but after "Update Resource" button, validation is executed
>> again and "data|invalid" is shown. How can it desappear ?
>>
>> Thanks !!!!!
>>
>> --
>> Isabel M. Ruiz Mellado
>> http://about.me/isabelruiz
>>
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>

-- 
Isabel M. Ruiz Mellado
http://about.me/isabelruiz
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20180406/ffa71829/attachment-0003.html>