timeplus-io/proton-rust-client

Rust client for Timeplus Proton, a fast and lightweight streaming SQL engine

proton-rust-client's Issues

Streaming query does not work in release mode.

Describe what's wrong

Proton has two sets of HTTP APIs, one is running on port 8123, this is the same as clickhouse. And the other is running on port 3218 which supports streaming queries. Simply put, the same query SELECT * FROM some_stream behaves differently on these two APIs. On port 8123 it returns immediately, but on port 3128, it will keep running and returnning fresh data.

This isssue is about running streaming query on port 3128 with this library. It won't work in release mode (e.g. using cargo run --release). The reason why it worked for non-release mode is because of this:

[dev-dependencies]
clickhouse = { version = "0.11", features = ["test-util"] }

with the test-util, the clickhouse crate does not use any compression by default (otherwise, it uses lz4), this is the tricky part. And with lz4, streaming query does not work. So, in order to make streaming query work, we need to disable compression when do streaming query:

let client = Client::default()....;
/// do non-streaming query with the `client` ...

/// when you want to do streaming query, disable compression
client.with_compression(Compression::None);
client.query("<... my streaming query ...>").fetch ...

How to reproduce

Error message and/or stacktrace

Additional context