[collectd] zeormq architecture inquiry

[Allan Feid]

Thanks Francois, the way the code is right now, the subscriber is the node
doing the bind, and the publisher connects to the subscriber. This would
mean that your central collectd process would be able to do the filtering
since it is the subscriber.

As far as AMQP goes, we have noticed scaling problems with the broker model,
where this box becomes complex to scale out and seems to be the bottle neck.
That is why ZeroMQ is appealing for this kind of situation.

On Mon, Aug 29, 2011 at 12:42 PM, Francois-Xavier Bourlet
<fx at dotcloud.com>wrote:

> Hi guys,
>
> Just a little note: The current implementation of ZMQ filter on the
> subscriber, not on the publisher...
> Seem that ZMQ v3 is addressing the problem.
>
> my 2cents
>
> On Mon, Aug 29, 2011 at 9:22 AM, Florian Forster <octo at collectd.org>wrote:
>
>> Hi Allan,
>>
>> if you're after distributing the load, you might want to take a look at
>> the AMQP plugin, too. It has these "topic" branches, where subscribers
>> can subscribe to "matching" messages only. This allows you to distribute
>> the load in a consistent manner and is re-configurable during runtime.
>>
>> It's possible to only subscribe to certain messages in ZeroMQ as well,
>> but I *think* they match the message content for this. Since the plugin
>> uses the binary protocol, that might not work for us. I might be wrong,
>> though, and there is some "label" that you can attach to messages, which
>> would make this kind of filtering possible with ZeroMQ, too.
>>
>> Regards,
>> —octo
>> --
>> Florian octo Forster
>> Hacker in training
>> GnuPG: 0x0C705A15
>> http://octo.it/
>>
>> -----BEGIN PGP SIGNATURE-----
>> Version: GnuPG v1.4.10 (GNU/Linux)
>>
>> iQIcBAEBAgAGBQJOW7y2AAoJEMPSHpbi2Mmg0ysP/ijjRkTLWdvFCxs+sBBXtvU3
>> liEIgNf90s3Jgzr33bgx+7m/BQ0JgDT7VrNvH3ek8/OdePGJ15Lnnqr6T5mDz2gD
>> Tj0uysiFCyQCIZPiw5v23x+iNLhwkeS/RC9HFBTPTG3I+s4jG46EvVvBfjlosEYA
>> g+LslGIZ7yG02PN/WKxehYUEK3nnWlz14uHyFwPoQfUGWObpQiiKzerM5R0uL/qn
>> rwyK+IFlmAgzU0m1cbaGq3KCyqOGDHzreW6rC1fql8IFC1ca2ugFA3F6ttYUzRvV
>> yP1RYwydWwA6WYjYyyExWsSTQTWhIyx0JWnxZslodhdA2pEHU+OGsciuPoBnCW5c
>> 35GAozEiAuRFe2QKFPnhDkLyVf8Wh/agyWfCSR8Q1i2UVVrhWUFRIaOCzC/+e8od
>> UamMKv3KkuC931M6YDbLNW4W/E71rQB9sAxCOItVmOpISaW5nCMiw59dknZwN2I4
>> WsdmTYzMdQZhmjB28/i1fo0vZVuWHH/dK0zAoaWwutanthlVFKrSxcnmfkjzQNj1
>> WlHqXDvW6h7crksOeWQamrUqplHgP0sKSWsTI2z4zytCGL3+KpdeXe/0FBqPou7J
>> qHqFM2nTKdRNpL8fgcRm9nTz0VyB0vmpmrIQ8WgOjpwfNz9APUrW5s1RECovb+ow
>> 4wLyW448ylCs6WC7HXwE
>> =HGPq
>> -----END PGP SIGNATURE-----
>>
>> _______________________________________________
>> collectd mailing list
>> collectd at verplant.org
>> http://mailman.verplant.org/listinfo/collectd
>>
>>
>
>
> --
> François-Xavier Bourlet
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.verplant.org/pipermail/collectd/attachments/20110829/d09c4e0b/attachment-0001.html>