Limit retry backoff (and unlimited retries)

[morrone]

Limit retry backoff (and unlimited retries)

[pricelessjunk]

Hey so I created a pull request for this change. #756.

Please verify if this is how you imagined it. If its good I can ask the maintainers to have a look.

[morrone]

Please verify if this is how you imagined it. If its good I can ask the maintainers to have a look.

Yes, that looks perfect. Thank you!

[pricelessjunk]

I was looking into this a little. There does seem to be an upper limit to the back off time which is 24 hours. This value is also automatically applied after 32 attempts (due to overflow).

Did you want to make this configurable instead of it being a constant?

Reference -
https://github.com/confluentinc/kafka-connect-elasticsearch/blob/master/src/main/java/io/confluent/connect/elasticsearch/RetryUtil.java#L94

[morrone]

Yes, making it configurable would be great. We would want to configure the maximum to be something like 5-10 minutes.