Losing flows from many network devices with 1 collector

[cloudflare]

Losing flows from many network devices with 1 collector

[lspgn]

Hi @MIKNOTAURO,
Which version are you using? How many flows per router? NetFlow or sFlow?
It really depends on the specs of the server.
Are the containers limited in RAM and CPU?

Decoding takes around 25uS to decode NetFlow/IPFIX packets and 75uS to decode sFlow.
At this rate, a GoFlow running on one core should be able to decode 10k-40k samples per second.
But this does not take into account the time to push the data to Kafka: which can depend a lot on your setup.

Try running it without Kafka and check the metrics.

Regarding the drop, it may be a UDP buffer too small.
I'd suggest to monitor the following:

# netstat -su
Udp:
    xxxx packets received
    xxxx packets to unknown port received
    xxxx packet receive errors
    xxxx receive buffer errors

should help.

Thank you