[ckan-dev] CKAN running extremely slow

Mon Sep 29 16:21:40 UTC 2014

Hi,

CKAN is running extremely slow on my production server. Around 10x
slower than in the development server (!)

Any thoughts on how to figure this out? I'm stumped

Some factors that I have made sure to be constant between the machines:
* The codebase is the same version on both servers
* The performance difference is there independently if I run CKAN
through apache or through "paster serve", so apache is not the culprit
here
* I'm still testing the config, so the production server has
absolutely *no* load at this point, other than my own requests
* There are minor differences between the virtual machines (see below)
but both have 4GB of RAM and 2 cores @ ~2GHz.

Running top or htop it *seems* that CKAN is more processor-hungry in
the production machine. Running "free -m" I get the impression that
it's also more memory-hungry (see below too). I can't figure out the
reason for these differences, and whether they can be clues for the
the differences in performance. Any ideas? All help appreciated!

Thanks,
Filipe

The development server:
---------------------------------
$ lscpu
Architecture:          i686
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                2
On-line CPU(s) list:   0,1
Thread(s) per core:    1
Core(s) per socket:    1
Socket(s):             2
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 42
Stepping:              7
CPU MHz:               1995.529
BogoMIPS:              3991.05
Hypervisor vendor:     VMware
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              6144K

$ free -m
             total       used       free     shared    buffers     cached
Mem:          4033       1929       2104         37        117        576
-/+ buffers/cache:       1235       2797
Swap:         1021          0       1021

The production server:
---------------------------------
$ lscpu
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                2
On-line CPU(s) list:   0,1
Thread(s) per core:    1
Core(s) per socket:    1
Socket(s):             2
NUMA node(s):          1
Vendor ID:             AuthenticAMD
CPU family:            15
Model:                 65
Stepping:              2
CPU MHz:               2210.185
BogoMIPS:              4420.37
L1d cache:             64K
L1i cache:             64K
L2 cache:              1024K
NUMA node0 CPU(s):     0,1

$ free -m
             total       used       free     shared    buffers     cached
Mem:          3954       3657        297          0          3         51
-/+ buffers/cache:       3601        352
Swap:         1019        859        160