[ckan-dev] DataStorer extension location question

Thu Jun 14 16:59:19 UTC 2012

The log file suggests that the extension has not been properly installed.

Does the following file exist?

YOURCKANHOME/pyenv/lib/python2.6/site-packages/ckanext-datasource.egg-link

And if does exist, what is the output of `cat`ting it?

Salman

On 6/14/12 12:21 PM, "Jim Craner" <jim at codeforamerica.org> wrote:

>Hi Adrià,
>
>Here is a pastebin of the /var/log/apache/MYCKAN.error.ini when I try
>to load the home page and get the 500 error:
>
>http://pastebin.com/h6a6jjVM
>
>The datastorer extension installation procedure you suggested
>yesterday resulted in this path:
>
>/home/backadmin/pyenv/src/ckanext-datastorer/ckanext/datastorer
>
>I also pasted my datastorer nosetests results to the list yesterday;
>not sure if that helps at all either.
>
>Please let me know if there is any other info I can provide that might
>help you or other list members suggest troubleshooting steps.
>
>Thanks again!
>Jim
>
>On Thu, Jun 14, 2012 at 2:00 AM, Adrià Mercader <amercadero at gmail.com>
>wrote:
>> Hi Jim,
>>
>> Yes, the traceback would be great to have, can you post it somewhere?
>>
>> Thanks,
>>
>> Adrià
>>
>> On 14 June 2012 00:02, Jim Craner <jim at codeforamerica.org> wrote:
>>> Hi Adrià,
>>>
>>> Thanks for the suggestions -- every command ran successfully until I
>>> restarted Apache.  I'm still getting a 500 error when I try to access
>>> CKAN, and the "PluginNotFoundException: datastorer" in the error logs.
>>>
>>> Would the rest of the Traceback help you troubleshoot?  Any other
>>>suggestions?
>>>
>>> Thanks again,
>>> Jim
>>>
>>> [Wed Jun 13 00:20:54 2012] [error] [client 127.0.0.1]
>>> PluginNotFoundException: datastorer
>>>
>>>
>>> On Wed, Jun 13, 2012 at 8:53 AM, Adrià Mercader <amercadero at gmail.com>
>>>wrote:
>>>> Hi Jim,
>>>>
>>>> Sorry to hear that you are having trouble with the datastorer. Trust
>>>> me, it definitely works on different projects :)
>>>>
>>>> I've improved the install instructions on the README [1], which I
>>>> agree could be confusing, so I suggest we start all over again.
>>>>
>>>> 1. Remove any datastorer folder that you have right now
>>>> 2. Activate your virtualenv
>>>> 3. Run pip install -e
>>>> 
>>>>git+git://github.com/okfn/ckanext-datastorer.git#egg=ckanext-datastorer
>>>> 4. Run pip install -r ckanext-datastorer/requires.txt
>>>>
>>>> At this point you should have a ~/pyenv/src/ckanext-datastorer folder
>>>> and running this command should not return any errors or prompts:
>>>>
>>>> python -c "import ckanext.datastorer"
>>>>
>>>> After this point you need to add this to your ini file:
>>>>
>>>> ckan.plugins = datastorer <rest of plugins>...
>>>>
>>>>
>>>> Let me know if this works for you.
>>>>
>>>> Adrià
>>>>
>>>>
>>>> [1] https://github.com/okfn/ckanext-datastorer/blob/master/README.rst
>>>>
>>>>
>>>> On 13 June 2012 16:30, Jim Craner <jim at codeforamerica.org> wrote:
>>>>> Hi Sean,
>>>>>
>>>>> I really appreciate the suggestions, but I think at this point I need
>>>>> explicit "You should do X, Y, and Z" instructions.
>>>>>
>>>>> I'm pretty sure I've tried a hundred variations on everything you
>>>>> suggested over the past couple of weeks, I *have* been referring to
>>>>> that "how to install an extension" doc, I've tried every combination
>>>>> of file structure for the extensions folder and I'm still getting
>>>>> nothing.
>>>>>
>>>>> Since this (allegedly :-) works on the Data Hub, could someone with
>>>>> access to that server just go in and tell me how the "datastorer"
>>>>> extension is set up in the CKAN source folder structure?  And what
>>>>>the
>>>>> plugins line is?  (I've seen "datastore archiver" and "datastorer
>>>>> archive" but never know which was correct).
>>>>>
>>>>> My offer to help improve this part of the documentation -- assuming I
>>>>> can ever get this figured out -- still stands as well :-)
>>>>>
>>>>> Thanks again!
>>>>> Jim
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Jun 13, 2012 at 5:01 AM, Sean Hammond
>>>>><sean.hammond at okfn.org> wrote:
>>>>>>> I'm (still) trying to get the DataStorer functionality working.  I
>>>>>>> have a fresh install of CKAN 1.7 from source running on a local
>>>>>>>Ubuntu
>>>>>>> 10.04 LTS virtual environment.
>>>>>>>
>>>>>>> I got CKAN running, the FileStore running, everything is looking
>>>>>>>good.
>>>>>>>
>>>>>>> I really need some help clarifying the instructions found here:
>>>>>>>
>>>>>>> https://github.com/okfn/ckanext-datastorer
>>>>>>>
>>>>>>> These instructions *seem* to work, as in no errors are generated
>>>>>>> during the installation, but I'm really not sure where the files
>>>>>>>are
>>>>>>> supposed to end up.  When I try to access CKAN after installing
>>>>>>>this,
>>>>>>> I get a 500 error and the logs report "PluginNotFoundException:
>>>>>>> datastore."
>>>>>>>
>>>>>>> My CKAN folder is in my server's user's home folder,
>>>>>>>~/pyenv/src/ckan.
>>>>>>>  The config file is ~/pyenv/src/ckan/datasc.ini.  The installation
>>>>>>> instructions instruct me to download a zip file which becomes an
>>>>>>> okfn-ckanext-datastorer folder (which I've tried putting in ~ and
>>>>>>>in
>>>>>>> ~/pyenv/src/ckan).  When I run the installation, it generates a
>>>>>>> subfolder "ckanext" which has its own folder within it called
>>>>>>> "datastorer".  I tried putting that final "datastorer" folder
>>>>>>>directly
>>>>>>> in my existing ~/pyenv/src/ckan/ckanext folder and got the same
>>>>>>> results.  So at that point I'm completely lost.
>>>>>>>
>>>>>>> Can someone who has DataStorer running successfully tell me a)
>>>>>>>what to
>>>>>>> put in my CONFIG.ini file's plugins line (e.g., "datastore
>>>>>>>archiver"
>>>>>>> or "datastorer archiver" or something else)?  And b) what should
>>>>>>>the
>>>>>>> correct file structure be for the datastorer extension folder(s)
>>>>>>> relative to the root of my CKAN installation?
>>>>>>
>>>>>> Hi Jim,
>>>>>>
>>>>>> I haven't installed datastorer before myself, but I would try
>>>>>>reading
>>>>>> the 'Installing an Extension' docs here:
>>>>>>
>>>>>> 
>>>>>>http://docs.ckan.org/en/ckan-1.7/extensions.html#installing-an-extens
>>>>>>ion
>>>>>>
>>>>>> and then you might understand the ckanext-datastorer README a little
>>>>>> better. For example, I would probably download ckanext-datastorer by
>>>>>> activating my virtualenv and running a command like:
>>>>>>
>>>>>>    pip install -e
>>>>>>git+https://github.com/okfn/ckanext-datastorer.git#egg=ckanext-datast
>>>>>>orer
>>>>>>
>>>>>> this should download and install ckanext-datastorer in a directory
>>>>>>like:
>>>>>>
>>>>>>    pyenv/src/ckanext-datastorer
>>>>>>
>>>>>> You might still need to run pip install -r on the requires.txt file
>>>>>>in
>>>>>> the ckanext-datastorer directory.
>>>>>>
>>>>>> In the plugins line of your CKAN ini file you should add something
>>>>>>like:
>>>>>>
>>>>>>    plugins = datastorer
>>>>>>
>>>>>> A couple of things you can do to test whether datastorer is working
>>>>>> properly are to run CKAN with `paster serve development.ini` and
>>>>>>see if
>>>>>> it crashes with something like 'Plugin not found: datastorer', run
>>>>>>the
>>>>>> datastorer tests, something like:
>>>>>>
>>>>>>    nosetests tests
>>>>>>
>>>>>> from the ckanext-datastorer directory, and to try out the
>>>>>> `paster datastorer` command (from the pyenv/src/ckan directory).
>>>>>>
>>>>>> _______________________________________________
>>>>>> ckan-dev mailing list
>>>>>> ckan-dev at lists.okfn.org
>>>>>> http://lists.okfn.org/mailman/listinfo/ckan-dev
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> -----
>>>>> Jim Craner, 2012 Fellow
>>>>> Code for America
>>>>> jim at codeforamerica.org
>>>>> (+1) 773-809-4546
>>>>> http://codeforamerica.org
>>>>>
>>>>> _______________________________________________
>>>>> ckan-dev mailing list
>>>>> ckan-dev at lists.okfn.org
>>>>> http://lists.okfn.org/mailman/listinfo/ckan-dev
>>>>
>>>> _______________________________________________
>>>> ckan-dev mailing list
>>>> ckan-dev at lists.okfn.org
>>>> http://lists.okfn.org/mailman/listinfo/ckan-dev
>>>
>>>
>>>
>>> --
>>> -----
>>> Jim Craner, 2012 Fellow
>>> Code for America
>>> jim at codeforamerica.org
>>> (+1) 773-809-4546
>>> http://codeforamerica.org
>>>
>>> _______________________________________________
>>> ckan-dev mailing list
>>> ckan-dev at lists.okfn.org
>>> http://lists.okfn.org/mailman/listinfo/ckan-dev
>>
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/ckan-dev
>
>
>
>-- 
>-----
>Jim Craner, 2012 Fellow
>Code for America
>jim at codeforamerica.org
>(+1) 773-809-4546
>http://codeforamerica.org
>
>_______________________________________________
>ckan-dev mailing list
>ckan-dev at lists.okfn.org
>http://lists.okfn.org/mailman/listinfo/ckan-dev