[ckan-dev] How to install ckanext-scheming

Forum forum at hello-web.net
Thu Sep 22 15:20:45 UTC 2016


Thak Tim,

Your helped me. I discovered my error. I modified the datset.json and I 
changed the preset field name.

It generate an error, because it could not match it with the data in 
preset.json

I finally could add a new fiels.


I am still discovering CKAN, but it look very interresting.


On 9/22/16 3:19 PM, Forum wrote:
>
> We are also agree that the following command must lunch from the folder
>
> /
> /
>
> //usr/lib/ckan/default/src/ckanext-scheming/
>
>
> and not form
>
> /
> /
>
> //usr/lib/ckan/default/src//
>
>
> Because the steup.py is in ckanext-scheming folder?
>
> Cheers
>
> On 9/22/16 3:07 PM, Forum wrote:
>>
>> Dear Tim,
>>
>> Thank again for helping.
>>
>>
>> Just to make sure I understand before entering command.
>>
>>
>>  1. Could you tell me that does python setup.py develop
>>  2. Your wrote "Addition I make to xxxx.ini", do you mean, I have to
>>     add your recommandation in /etc/ckan/default/production.ini ? (I
>>     suppose yes)
>>  3. .. you restart webserver, do you means sudo service apache2
>>     reload (sorry for that stupid question :o)
>>
>>
>> Thank again
>> Cheers
>>
>> On 9/22/16 2:58 PM, Timothy Giles wrote:
>>>
>>> OK,
>>>
>>> After 6, do
>>>
>>>                       7. python setup.py develop
>>>
>>> Additions I make to xxxxx.ini
>>>
>>> scheming.dataset_schemas = ckanext.scheming:dataset.json
>>>
>>> scheming.presets = ckanext.scheming:presets.json
>>>
>>> scheming.dataset_fallback = false
>>>
>>> You must then make a json file at: 
>>> /usr/lib/ckan/default/src/ckanext-scheming/ckanext/scheming/dataset.json
>>>
>>> I would suggest you fist copy the file ………../ckan_dataset.json  to   
>>> ……./dataset.json.
>>>
>>> When you restart the webserver (production) or redo paster serve….   
>>> Then the new schema is used when you click on the new dataset button.
>>>
>>> You can then make a change to the dataset.json, restart the 
>>> webserver or paster serve….. and you will see the changes
>>>
>>> Hope that helps
>>>
>>> Tim
>>>
>>> *From:*ckan-dev [mailto:ckan-dev-bounces at lists.okfn.org] *On Behalf 
>>> Of *Forum
>>> *Sent:* den 22 september 2016 14:53
>>> *To:* CKAN Development Discussions <ckan-dev at lists.okfn.org>
>>> *Subject:* Re: [ckan-dev] How to install ckanext-scheming
>>>
>>> Dear Tim,
>>>
>>> I am sorry to annoy but I have pain to setup chanext-scheming.
>>>
>>> I successfully perform those operation:
>>>
>>> 1./#sudo chown -R `whoami` /usr/lib/ckan/default/
>>>
>>> 2.#. /usr/lib/ckan/default/bin/activate
>>>
>>> 3./#/cd /usr/lib/ckan/default/src
>>>
>>> 4./#/pip install -e 
>>> ‘git+https://github.com/ckan/ckanext-scheming.git#egg=ckanext-scheming’
>>>
>>> 5.#cd ./ckanext-scheming
>>>
>>> 6.#pip install -r 
>>> /usr/lib/ckan/default/src/ckanext-scheming/requirements.txt
>>>
>>> But I really do not understand how to configure it following this page
>>>
>>> https://github.com/ckan/ckanext-scheming
>>>
>>> I do not understand how to modify the configuration. Is the file 
>>> /etc/lib/ckan/default/production.ini?
>>>
>>> I try to modifiy the following (In green, it what I added):
>>>
>>> ckan.plugins = stats text_view image_view 
>>> recline_view*scheming_datasets*
>>>
>>> #   module-path:file to schemas being used
>>> *scheming.dataset_schemas**= ckanext.spatialx:spatialx_schema.json*
>>> *                           ckanext.spatialx:spatialxy_schema.json*
>>> #   will try to load "spatialx_schema.json" and "spatialxy_schema.json"
>>> #   as dataset schemas
>>> #
>>> #   URLs may also be used, e.g:
>>> #
>>> # scheming.dataset_schemas = http://example.com/spatialx_schema.json
>>> #   Preset files may be included as well. The default preset setting is:
>>> *scheming.presets**= ckanext.scheming:presets.json*
>>> #   The is_fallback setting may be changed as well. Defaults to false:
>>> *scheming.dataset_fallback**= false*
>>> **
>>>
>>> After adding those line, I reload apache2 and the web page display 
>>> an Internal Server Error. I also tried
>>>
>>> *scheming.dataset_schemas**= ckanext.spatialx:spatialx_schema.json*
>>>
>>> *or*
>>>
>>> *scheming.dataset_schemas**= ckanext.spatialx:spatialxy_schema.json*
>>>
>>>
>>> But none works
>>>
>>> I also edited the file 
>>> */usr/lib/ckan/default/src/ckanext-scheming/ckanext/scheming/ckan_dataset.json* 
>>> and modified a field name, a label but I could not see a change on 
>>> the web interface.
>>>
>>> I am new with CKAN, could tell me a bit more about the configuration 
>>> and how to add new field?
>>>
>>> Many thank
>>> Cheers
>>>
>>> Pierre
>>>
>>> On 9/22/16 1:17 PM, Forum wrote:
>>>
>>>     Ok, I think I solved the problem.
>>>
>>>     As I said, I install CKAN from package.
>>>
>>>     Because of my issue, I red the doc and I compare the instruction
>>>     to install CKAN from source. I also compare the file permissions
>>>     of /usr/lib/ckan/default
>>>
>>>     http://docs.ckan.org/en/latest/maintaining/installing/install-from-source.html
>>>
>>>     The instruction to install from source said:
>>>
>>>     1.Create a Python virtual environment
>>>     <http://www.virtualenv.org> (virtualenv) to install CKAN into,
>>>     and activate it:
>>>
>>>     2.sudo mkdir -p /usr/lib/ckan/default
>>>
>>>     3.sudo chown `whoami` /usr/lib/ckan/default
>>>
>>>     4.virtualenv --no-site-packages /usr/lib/ckan/default
>>>
>>>     5.. /usr/lib/ckan/default/bin/activate
>>>
>>>     In red, I could understand thta my file permission was not
>>>     correct. I ran the following command
>>>
>>>     sudo chown -R `whoami` /usr/lib/ckan/default
>>>
>>>     and then I try to install again ckanext-scheming and it work
>>>     (see below).
>>>
>>>     *But why the installation from package do not set the correct
>>>     permission?*
>>>
>>>     /(default)cry at crypc11:/usr/lib/ckan/default/src/ckan$ pip
>>>     install -e
>>>     'git+https://github.com/ckan/ckanext-scheming.git#egg=ckanext-scheming'
>>>     Obtaining ckanext-scheming from
>>>     git+https://github.com/ckan/ckanext-scheming.git#egg=ckanext-scheming
>>>       Directory /usr/lib/ckan/default/src/ckanext-scheming already
>>>     exists, and is not a git clone.
>>>       The plan is to install the git repository
>>>     https://github.com/ckan/ckanext-scheming.git
>>>     <https://github.com/ckan/ckanext-scheming.git>
>>>     //What to do? (i)gnore, (w)ipe, (b)ackup w
>>>       Deleting /usr/lib/ckan/default/src/ckanext-scheming
>>>       Cloning https://github.com/ckan/ckanext-scheming.git to
>>>     /usr/lib/ckan/default/src/ckanext-scheming
>>>     Installing collected packages: ckanext-scheming
>>>       Running setup.py develop for ckanext-scheming
>>>     Successfully installed ckanext-scheming
>>>     You are using pip version 7.1.2, however version 8.1.2 is available.
>>>     You should consider upgrading via the 'pip install --upgrade
>>>     pip' command./
>>>
>>>     /
>>>     (default)cry at crypc11:/usr/lib/ckan/default/src/ckan$ pip install
>>>     --upgrade pip
>>>     /usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90:
>>>     InsecurePlatformWarning: A true SSLContext object is not
>>>     available. This prevents urllib3 from configuring SSL
>>>     appropriately and may cause certain SSL connections to fail. For
>>>     more information, see
>>>     https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
>>>       InsecurePlatformWarning
>>>     Collecting pip
>>>       Downloading pip-8.1.2-py2.py3-none-any.whl (1.2MB)
>>>         100% |████████████████████████████████| 1.2MB 510kB/s
>>>     Installing collected packages: pip
>>>       Found existing installation: pip 7.1.2
>>>         Uninstalling pip-7.1.2:
>>>           Successfully uninstalled pip-7.1.2
>>>     Successfully installed pip-8.1.2/
>>>
>>>     /(default)cry at crypc11:/usr/lib/ckan/default/src/ckan$ /
>>>
>>>     On 9/22/16 12:59 PM, Forum wrote:
>>>
>>>         Dear Tim
>>>
>>>         Unfortunately, it does not work. Here is the error messages:
>>>
>>>         I manually created
>>>         //usr/lib/ckan/default/src/ckanext-scheming/ because it
>>>         could not/
>>>
>>>         /(default)cry at crypc:/usr/lib/ckan/default/src$ pip install
>>>         -e
>>>         'git+https://github.com/ckan/ckanext-scheming.git#egg=ckanext-scheming'
>>>         Obtaining ckanext-scheming from
>>>         git+https://github.com/ckan/ckanext-scheming.git#egg=ckanext-scheming
>>>         //  Directory /usr/lib/ckan/default/src/ckanext-scheming
>>>         already exists, and is not a git clone.
>>>           The plan is to install the git repository
>>>         https://github.com/ckan/ckanext-scheming.git
>>>         <https://github.com/ckan/ckanext-scheming.git>
>>>         What to do?  (i)gnore, (w)ipe, (b)ackup i
>>>         //    Complete output from command python setup.py egg_info:
>>>             Traceback (most recent call last):
>>>               File "<string>", line 18, in <module>
>>>             IOError: [Errno 2] No such file or directory:
>>>         '/usr/lib/ckan/default/src/ckanext-scheming/setup.py'
>>>
>>>             ----------------------------------------
>>>         Command "python setup.py egg_info" failed with error code 1
>>>         in /usr/lib/ckan/default/src/ckanext-scheming/
>>>
>>>         /(default)cry at crypc:/usr/lib/ckan/default/src$ ll
>>>         ckanext-scheming/
>>>         total 8
>>>         drwxr-xr-x 2 cry cry 4096 Sep 22 12:45 ./
>>>         drwxr-xr-x 4 root  root  4096 Sep 22 12:51 ..//
>>>
>>>         /(default)cry at crypc11:/usr/lib/ckan/default/src$ pip install
>>>         -e
>>>         'git+https://github.com/ckan/ckanext-scheming.git#egg=ckanext-scheming'
>>>         Obtaining ckanext-scheming from
>>>         git+https://github.com/ckan/ckanext-scheming.git#egg=ckanext-scheming
>>>           Directory /usr/lib/ckan/default/src/ckanext-scheming
>>>         already exists, and is not a git clone.
>>>           The plan is to install the git repository
>>>         https://github.com/ckan/ckanext-scheming.git
>>>         <https://github.com/ckan/ckanext-scheming.git>
>>>         What to do?  (i)gnore, (w)ipe, (b)ackup w
>>>         //Deleting ./ckanext-scheming
>>>         Exception:
>>>         Traceback (most recent call last):
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/basecommand.py",
>>>         line 211, in main
>>>             status = self.run(options, args)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/commands/install.py",
>>>         line 305, in run
>>>             wb.build(autobuilding=True)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/wheel.py",
>>>         line 705, in build
>>>         self.requirement_set.prepare_files(self.finder)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/req/req_set.py",
>>>         line 334, in prepare_files
>>>             functools.partial(self._prepare_file, finder))
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/req/req_set.py",
>>>         line 321, in _walk_req_to_install
>>>             more_reqs = handler(req_to_install)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/req/req_set.py",
>>>         line 433, in _prepare_file
>>>             req_to_install.update_editable(not self.is_download)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/req/req_install.py",
>>>         line 573, in update_editable
>>>             vcs_backend.obtain(self.source_dir)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/vcs/git.py",
>>>         line 109, in obtain
>>>             if self.check_destination(dest, url, rev_options,
>>>         rev_display):
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/vcs/__init__.py",
>>>         line 257, in check_destination
>>>             rmtree(dest)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/_vendor/retrying.py",
>>>         line 49, in wrapped_f
>>>             return Retrying(*dargs, **dkw).call(f, *args, **kw)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/_vendor/retrying.py",
>>>         line 212, in call
>>>             raise attempt.get()
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/_vendor/retrying.py",
>>>         line 247, in get
>>>             six.reraise(self.value[0], self.value[1], self.value[2])
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/_vendor/retrying.py",
>>>         line 200, in call
>>>             attempt = Attempt(fn(*args, **kwargs), attempt_number,
>>>         False)
>>>           File
>>>         "/usr/lib/ckan/default/local/lib/python2.7/site-packages/pip/utils/__init__.py",
>>>         line 90, in rmtree
>>>             onerror=rmtree_errorhandler)
>>>           File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
>>>             onerror(os.listdir, path, sys.exc_info())
>>>           File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
>>>             names = os.listdir(path)
>>>         OSError: [Errno 13] Permission denied:
>>>         '/usr/lib/ckan/default/src/ckanext-scheming'/
>>>
>>>         /(default)cry at crypc11:/usr/lib/ckan/default/src$ /
>>>
>>>         Is not a permission problem?
>>>
>>>         Thank for your help
>>>
>>>         Cheers
>>>
>>>         On 9/21/16 5:34 PM, Timothy Giles wrote:
>>>
>>>             The .activate just ensures you are in the virtual
>>>             environment that ckan dev is installed in.
>>>
>>>             You follow a very similar install process for almost all
>>>             ckan extensions. Some have requirements.txt and/or
>>>             dev-requirements.txt that need installing. Some
>>>             extensions require supporting DB tables to be created
>>>             (QA for example). Generally though, if you learn the
>>>             procedure below, you can install almost all extensions
>>>             without issue.
>>>
>>>
>>>
>>>             Regards Timothy
>>>
>>>
>>>
>>>             *From:*ckan-dev [mailto:ckan-dev-bounces at lists.okfn.org]
>>>             *On Behalf Of *Forum
>>>             *Sent:* den 21 september 2016 15:53
>>>             *To:* CKAN Development Discussions
>>>             <ckan-dev at lists.okfn.org> <mailto:ckan-dev at lists.okfn.org>
>>>             *Subject:* Re: [ckan-dev] How to install ckanext-scheming
>>>
>>>             Dear Tim,
>>>
>>>             Thank for your help.
>>>
>>>             When I firstly install ckan, I installed it from source
>>>             and I used that command during the process
>>>
>>>             . /usr/lib/ckan/default/bin/activate
>>>
>>>             I reinstalled my PC with a new Ubuntu 14.04 installation
>>>             and I installed successfuly CKAN from the package. I did
>>>             not needed to use the above command.
>>>
>>>             I supposed, even if I installed CKAN from package, I can
>>>             use the above command and use pip?
>>>             I will try to install ckanext-scheming later or tomorrow.
>>>
>>>             Cheers
>>>             Pierre
>>>
>>>             On 9/21/16 3:38 PM, Timothy Giles wrote:
>>>
>>>                 Pierre,
>>>
>>>                 . /usr/lib/ckan/default/bin/activate
>>>
>>>                 cd /usr/lib/ckan/default/src
>>>
>>>                 pip install -e
>>>                 ”git+https://github.com/ckan/ckanext-scheming.git#egg=ckanext-scheming”
>>>
>>>                 cd ./ckanext-scheming
>>>
>>>                 pip install -r
>>>                 /usr/lib/ckan/default/src/ckanext-scheming/requirements.txt
>>>
>>>                 1.Any issues, sudo the previous command *
>>>
>>>                 As the rest of the instructions say, insert
>>>                 scheming_datasets in to your plugins line
>>>
>>>                 Add in the scheming.presets section in to your
>>>                 config, just under the plugins section
>>>
>>>                 Add in a scheming.dataset_fallback = false
>>>
>>>                 Add in a scheming.dataset_schemas =
>>>                 ckanext.scheming:schemaname.json
>>>
>>>                 Where schemaname.json is the JSON file that
>>>                 describes your schema (ie. list of metadata
>>>                 elements). As an example, I think there is
>>>                 camel.json and ckan_dataset.json
>>>
>>>                 Create a similar template file called dataset.json
>>>                 and it will load as the default ‘new dataset’
>>>                 schema/template.
>>>
>>>                 Sorry – the json files are stored in
>>>                 ./ckanext-scheming/ckanext/scheming/…….
>>>
>>>                 Hope the above helps
>>>
>>>                 Tim
>>>
>>>
>>>
>>>
>>>                 _______________________________________________
>>>
>>>                 ckan-dev mailing list
>>>
>>>                 ckan-dev at lists.okfn.org <mailto:ckan-dev at lists.okfn.org>
>>>
>>>                 https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>
>>>                 Unsubscribe:https://lists.okfn.org/mailman/options/ckan-dev
>>>
>>>
>>>
>>>
>>>             _______________________________________________
>>>
>>>             ckan-dev mailing list
>>>
>>>             ckan-dev at lists.okfn.org <mailto:ckan-dev at lists.okfn.org>
>>>
>>>             https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>
>>>             Unsubscribe:https://lists.okfn.org/mailman/options/ckan-dev
>>>
>>>
>>>
>>>
>>>
>>>     _______________________________________________
>>>
>>>     ckan-dev mailing list
>>>
>>>     ckan-dev at lists.okfn.org <mailto:ckan-dev at lists.okfn.org>
>>>
>>>     https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>
>>>     Unsubscribe:https://lists.okfn.org/mailman/options/ckan-dev
>>>
>>>
>>>
>>> _______________________________________________
>>> ckan-dev mailing list
>>> ckan-dev at lists.okfn.org
>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>> Unsubscribe:https://lists.okfn.org/mailman/options/ckan-dev
>>
>>
>>
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe:https://lists.okfn.org/mailman/options/ckan-dev
>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20160922/82ee6900/attachment-0003.html>


More information about the ckan-dev mailing list