[question] Support for Rate Limiting Messages Sent to Clients

[sky93]

[question] Support for Rate Limiting Messages Sent to Clients

[FZambia]

Hello @sky93

Centrifugo does not have sth like this available at the moment, and no plans to add it in the observable future. In general, would be nice to have built-in option to quickly configure – but need to consider how to integrate it with everything else in Centrifugo and distributed environment.

I guess the most effective solution is reducing on the layer before Centrifugo – probably add in-memory rate limiters on your publisher side.

Or add some rate limiting proxy between publisher and Centrifugo. I suppose Nginx can be such proxy - it has built-in leaky bucket limiting and I believe it's possible to configure it to take channel into account. Sth like this (did not test it):

http {
    # Define a key for rate limiting based on the 'channel' URL parameter.
    map $arg_channel $limit_key {
        default "";
        "~^(.+)$" $1;
    }

    limit_req_zone $limit_key zone=per_channel:10m rate=1r/2s;

    server {
        listen 80;
        server_name yourserver.com;

        location /api/publish {
            limit_req zone=per_channel burst=0 nodelay;
            proxy_pass http://centrifugo-upstream;
        }
    }
}

And add channel to request URL when using publish API so that proxy could extract it and rate limit based on it.

But that's just an example. I guess you may find other ways to reduce number of messages published.

What do you think? What is the use case btw where you have 2k messages in a single channel?

[sky93]

Thank you very much for your detailed response. My use case involves handling market data, where we have multiple markets with frequent updates in price. Given the volume and frequency of data updates, your suggestion to implement an in-memory rate limiter on the publisher side or a rate limiting proxy like Nginx is particularly relevant.

I will look into adapting it to our needs and test its efficacy in managing the data flow to Centrifugo.

Thank you once again for your guidance.