Traces not propagated to Cloud Trace, StackdriverTraceAutoConfiguration fails with timeout

[irenavy]

Traces not propagated to Cloud Trace, StackdriverTraceAutoConfiguration fails with timeout

[meltsufin]

Some context here: openzipkin/zipkin-gcp#102

Maybe there is an issue with credentials. Are you able to upgrade to Spring Cloud GCP 2.x to try the latest version?

[irenavy]

Thanks @meltsufin , I added roles/cloudtrace.agent to service account, which resolved timeout error.
But traces are still not sent to Cloud trace.

Traces are being sent to stackdriver logging -

Some additional details - the microservice is a pubsub subscriber and we are using spring cloud stream binder for consuming and publishing messages to topics. It is deployed on GKE and uses istio proxy.

[irenavy]

As per documentation,

Spring Cloud Sleuth integrates with Spring Integration. It creates spans for publish and subscribe events.

Basically, I want to capture traces and spans for these events. Will spring-cloud-gcp-starter-trace dependency suffice or I need any additional dependencies to make it work with PubSub calls? I could not find any example for tracing pubsub events.

[meltsufin]

Pub/Sub is not fully supported with Sleuth yet. You can get some tracing if you're using Spring Integration with Pub/Sub, but not the Pub/Sub Template. There is an issue for adding the support: openzipkin/zipkin-gcp#190.

[irenavy]

So PubSub events will not able be propagated to Cloud Trace automatically. Can you please help me with below queries:

Should it work with custom spans if I include grpc dependencies

Spring Cloud Sleuth provides instrumentation for gRPC through TraceGrpcAutoConfiguration

Can you please suggest a way of sending traces to stackdriver trace when using cloud stream binder? I am using Cloud sleuth for distributed tracing and it works fine with stackdriver logging i.e for each request new traceid is generated and same is propagated to next microservice. I am not sure if I can use alternatives like openTelemetry along with sleuth for exporting traces to stackdriver trace.

[meltsufin]

Stream binder uses Spring Integration under the hood. So, it might work. Can you give it a try and let us know?
Regarding TraceGrpcAutoConfiguration, I believe it's only relevant to when you're creating your own gRPC service.