Can zipkin collect data through kafka?

[kong]

Can zipkin collect data through kafka?

[codefromthecrypt]

similar question asked on the other issue. zipkin is mostly a dumb proxy. lost data is almost always elasticsearch queue overflow errors. unless you can carefully tune elasticsearch, enable storage throttling https://github.com/openzipkin/zipkin/tree/master/zipkin-server#throttled-storage-experimental

[codefromthecrypt]

also make sure you are sampling.. if you are doing 100% sampling with no rate-limit you can overwhelm any storage. Rate limiter is the best kind of sampler

[shakuzen]

To make this issue relevant to this repository, perhaps it could be refocused as "can the kong-plugin-zipkin report spans to Zipkin via Kafka?" From the Zipkin Server side, it can collect spans via Kafka. I'm not sure if this plugin supports reporting spans to Kafka or not, though. If not, this could be an enhancement request.

[JoeHooo]

To make this issue relevant to this repository, perhaps it could be refocused as "can the kong-plugin-zipkin report spans to Zipkin via Kafka?" From the Zipkin Server side, it can collect spans via Kafka. I'm not sure if this plugin supports reporting spans to Kafka or not, though. If not, this could be an enhancement request.

I thought about whether I could get kong's data through kafka. I set the environment variable KAFKA_BOOTSTRAP_SERVERS of zipkin, but felt no improvement.I guess kong's data is still sent over HTTP
Now, my question is how to transfer kong's data to zipkin through kafka

This is my expected architecture diagram

I don't know if KAFKA_BOOTSTRAP_SERVERS are configured in the environment variable, so zipkin can collect data through kafka

[JoeHooo]

To make this issue relevant to this repository, perhaps it could be refocused as "can the kong-plugin-zipkin report spans to Zipkin via Kafka?" From the Zipkin Server side, it can collect spans via Kafka. I'm not sure if this plugin supports reporting spans to Kafka or not, though. If not, this could be an enhancement request.

Yes, I have the same doubts.

[codefromthecrypt]

there is no kafka code here. so yes this would be a new feature, and likely not that difficult to write if someone knows lua.