[collectd] Too many open files

[Domagoj Mikac]

This is the list of files opened by collectd:

collectd  4061      root  cwd       DIR      253,0     4096
5174054 /usr/lib/collectd
collectd  4061      root  rtd       DIR      253,0     4096          2 /
collectd  4061      root  txt       REG      253,0   167923
4665406 /usr/sbin/collectd
collectd  4061      root  mem       REG      253,0    98437
4665284 /usr/lib/libstatgrab.so.6.2.2
collectd  4061      root  mem       REG      253,0   208352
12505380 /lib/libm-2.5.so
collectd  4061      root  mem       REG      253,0   630584
4651128 /usr/lib/libnetsnmp.so.10.0.3
collectd  4061      root  mem       REG      253,0    32824
12505372 /lib/libwrap.so.0.7.6
collectd  4061      root  mem       REG      253,0    46680
12505192 /lib/libnss_files-2.5.so
collectd  4061      root  mem       REG      253,0    16044
5174106 /usr/lib/collectd/match_regex.so
collectd  4061      root  mem       REG      253,0  1062108
4653065 /usr/lib/libX11.so.6.2.0
collectd  4061      root  mem       REG      253,0    20723
5174078 /usr/lib/collectd/disk.so
collectd  4061      root  mem       REG      253,0  1250176
4653620 /usr/lib/libxml2.so.2.6.26
collectd  4061      root  mem       REG      253,0   526896
4658949 /usr/lib/libfreetype.so.6.3.10
collectd  4061      root  mem       REG      253,0   194008
4654195 /usr/lib/libfontconfig.so.1.1.0
collectd  4061      root  mem       REG      253,0   186124
4653636 /usr/lib/libpangoft2-1.0.so.0.1400.9
collectd  4061      root  mem       REG      253,0   254476
4654272 /usr/lib/libpango-1.0.so.0.1400.9
collectd  4061      root  mem       REG      253,0    32708
4654549 /usr/lib/libXrender.so.1.3.0
collectd  4061      root  mem       REG      253,0    34532
4658953 /usr/lib/libpangocairo-1.0.so.0.1400.9
collectd  4061      root  mem       REG      253,0    44744
5174150 /usr/lib/collectd/snmp.so
collectd  4061      root  mem       REG      253,0   125736
12505157 /lib/ld-2.5.so
collectd  4061      root  mem       REG      253,0  1606808
12505191 /lib/libc-2.5.so
collectd  4061      root  mem       REG      253,0    16428
12505395 /lib/libdl-2.5.so
collectd  4061      root  mem       REG      253,0    52443
5174174 /usr/lib/collectd/unixsock.so
collectd  4061      root  mem       REG      253,0   125612
12505238 /lib/libpthread-2.5.so
collectd  4061      root  mem       REG      253,0    75028
4659395 /usr/lib/libz.so.1.2.3
collectd  4061      root  mem       REG      253,0    44060
12505397 /lib/librt-2.5.so
collectd  4061      root  mem       REG      253,0   644472
12505422 /lib/libglib-2.0.so.0.1200.3
collectd  4061      root  mem       REG      253,0   101404
12506690 /lib/libnsl-2.5.so
collectd  4061      root  mem       REG      253,0   259128
12505220 /lib/libgobject-2.0.so.0.1200.3
collectd  4061      root  mem       REG      253,0  1296772
12506670 /lib/libcrypto.so.0.9.8e
collectd  4061      root  mem       REG      253,0    46389
5174144 /usr/lib/collectd/rrdtool.so
collectd  4061      root  mem       REG      253,0    20092
4654923 /usr/lib/libXdmcp.so.6.0.0
collectd  4061      root  mem       REG      253,0     9412
4663446 /usr/lib/libXau.so.6.0.0
collectd  4061      root  mem       REG      253,0    76400
12506692 /lib/libresolv-2.5.so
collectd  4061      root  mem       REG      253,0    11396
12505218 /lib/libgmodule-2.0.so.0.1200.3
collectd  4061      root  mem       REG      253,0    17325
5174104 /usr/lib/collectd/logfile.so
collectd  4061      root  mem       REG      253,0    14574
5174094 /usr/lib/collectd/interface.so
collectd  4061      root  mem       REG      253,0   133056
12505384 /lib/libexpat.so.0.5.0
collectd  4061      root  mem       REG      253,0   489749
4664895 /usr/lib/librrd_th.so.4.0.7
collectd  4061      root  mem       REG      253,0   448940
4653635 /usr/lib/libcairo.so.2.9.2
collectd  4061      root  mem       REG      253,0   153956
4663780 /usr/lib/libpng12.so.0.10.0
collectd  4061      root  mem       REG      253,0 56416256
4658895 /usr/lib/locale/locale-archive
collectd  4061      root  mem       REG      253,0    25462
4714487 /usr/lib/gconv/gconv-modules.cache
collectd  4061      root    0u      CHR        1,3
1480 /dev/null
collectd  4061      root    1u      CHR        1,3
1480 /dev/null
collectd  4061      root    collectd  4061      root    5u     IPv4
39946                 UDP *:58507 2u      CHR        1,3
1480 /dev/null
collectd  4061      root    3u     unix 0xf6579c80
39941 /opt/collectd/collectd_socket


And after that, I have 1083 lines that look like this (with different
last two numbers). 

collectd  4061   root    5u     IPv4      39946   UDP *:58507 


Domagoj












On Thu, 2009-08-20 at 12:22 +0200, Florian Forster wrote:
> Hi Domagoj,
> 
> On Wed, Aug 19, 2009 at 01:25:46PM +0200, Domagoj Mikac wrote:
> > [2009-08-19 12:15:56] rrdtool plugin: rrd_update_r (/opt/collectd/rrd/test.rrd) failed: opening '/opt/collectd/rrd/test.rrd': Too many open files
> > [2009-08-19 12:19:20] rrdtool plugin: rrd_update_r (/opt/collsof | grep "rrd" | lesslectd/rrd/test.rrd) failed: mmaping file '/opt/collectd/rrd/test2.rrd': Invalid argument
> 
> weird. Why could collectd think it updates “test.rrd” while librrd
> thinks it's supposed to update “test2.rrd”? And, why aren't there a host
> and plugin directory? Did you edit those messages?
> 
> > After starting collectd process it creats RRD files for only 1257
> > devices (RRDs for more than 1000 devices are not created, even though
> > I have enough free space on disk)
> 
> Can you please use ‘lsof’ or a similar tool to check *which* files are
> opened by collectd? Just because the ‘rrdtool’ plugin complains doesn't
> mean the fault really is there. In any case, it opens one RRD file at a
> time, so the ‘rrdtool’ plugin should be responsible for one open file
> descriptor only.
> 
> Regards,
> -octo