Support late binding for Kafka

[spring-cloud]

Support late binding for Kafka

[codependent]

+1 for this feature

[garyrussell]

Looks like there are two issues being discussed here.

• late binding (detect the broker is down and do the provisioning later, perhaps on a schedule)
• allow integration tests to "pass" when there is no broker - I don't really understand how that will help - surely an integration test without a broker can never pass - spring-kafka-test provides the KafkaEmbedded JUnit rule which can be used in integration tests sample app here.

This issue is to address the first of these.

[Tal24]

Our MS tries to connect to Kafka every 30 seconds (re-try), but still the service is not up until kafka is up, should this be implemented? because we want the service to be up even if kafka is down and the late binding (re-try) should be under the hood every 30 seconds

[matanshukry]

Looking forward for this feature as well

[LittleShrimp1987]

if we got a switch, that would be perfect.

[ljramones]

Any idea when this will be supported? If I run an integration test on a build server, it will fail due to the lack of zookeeper infrastructure present. This particular integration test is intended to test that we can load the context. If we use the rabbitMQ binding then it works even through rabbitmq is not present.

Any way to disable it somehow. I hate to have to disable all these tests as they are handy to see if we screwed up things.

[yrobert]

I would be interested to get this feature too

[ulrich-h-da]

I'd be glad to use this feature in my integration tests

[cforce]

@garyrussell Was KGH-12 sobychacko/spring-cloud-stream@54abf56 a solution to setup late binding?
Do we need to cfg autoStartUp() for the Kafka Output or InputBindingLifecycle to false, so application will late bind and then i need to do start() on that bean on ApplicationReadyEvent ? Howto be fast up/non blocking and then do retries with timeout?

[garyrussell]

@cforce Please don't ask questions on old, closed, issues. In any case, GitHub issues are not for asking questions.

Ask questions on Stack Overflow, tagged with spring-cloud-stream.

[sweelam]

Is there any solution for this requirement?

[Xyaren]

There isn't just no documentation about this.
Late binding is not working properly due to all the retries and timeouts taking several minutes before "giving up".

[matanshukry]

@Xyaren I didn't find much documentation about it, but it does seem to work from a few minutes of trying it.
Want to explain the problem / open a new issue ?