[collectd] collected 4.10.1 stops writing and high CPU

[Yves Mettier]

Hello,

Issue #75 is the first think I'm thinking about.

Are you using rrdcached ?
If not, you should (but with so many rrds, I'm sure you are).

If yes, try to configure your collectd to *not* create rrds for some 
hours (maybe one or two days).
If this is better for you, you are probably experiencing issue #75.

Have a look at https://github.com/collectd/collectd/issues/75.
As far as I know, there is no "good" solution. Only some tips and 
tricks.


If not issue #75, here are some ieads...

About your CPU shooting the roof, could you check if it works full time 
or if it is waiting for your disk ? (iostat should help).

Are you sure your disk is not 99% full (perfs are lower when a disk is 
nearly full).
Are you sure your disk is not broken ?

With iostat, if you have a FS dedicated to the rrd files, have you 
checked that it is that FS and not another that is working slowly ?

Note : I'm using 5.2, so I will not be able to help you better.

Regards,
Yves

Le 2013-01-16 07:32, Jesse Reynolds a écrit :
> Hello
>
> We have a collectd server that is writing to about 24,000 RRD files,
> most of which are 15 MB each (with some at 30 MB and some at 45 MB),
> about 480 GB of RRD files in all.
>
> On occasion we are seeing disk writes drop right down to a trickle,
> and at the same time collectd's CPU shooting through the roof. Once
> collectd goes into this state it can be like this for hours, and the
> RRD files are mostly not being updated in this time. The only way to
> get things going again is to 'kill -9 <collectd's pids>' and start
> collectd again.
>
> The RRD files for data originating within this instance of collectd
> (and not coming via the network plugin) are not interrupted, so it is
> something to do with the network plugin, it seems.
>
> Has anyone got any advice on how we might chase this problem down
> further? We are on Ubuntu 12.04.
>
> Is it possible to peer into collectd to see if it's a problem with
> the network plugin, or the rrd plugin, or something else?
>
> Thank you
> Jesse
>
>
> _______________________________________________
> collectd mailing list
> collectd at verplant.org
> http://mailman.verplant.org/listinfo/collectd

-- 
- Homepage       - http://ymettier.free.fr                             
-
- GPG key        - http://ymettier.free.fr/gpg.txt                     
-
- C en action    - http://ymettier.free.fr/livres/C_en_action_ed2.html 
-
- Guide Survie C - http://www.pearson.fr/livre/?GCOI=27440100673730    
-