Comments (4)
I couldn't reproduce this error on my side. We have test that close and reopen the connector for three times and I didn't see any thread leaked. SnowflakeSinkTask is closed properly as well.
Maybe that is caused by thread leaks in version < 1.3.
from snowflake-kafka-connector.
How did you close the connector? If by sending DELETE request to REST api of Kafka Connect, this shouldn't happen.
from snowflake-kafka-connector.
We also experienced similar issue. After deleting connnector via Kafka Connect's REST API, there were clients in the consumer group even after minutes, and JMX metrics for connector was still available. We had to stop Kafka Connect process.
We've checked connected clients with Kafka's shell tools;
kafka-consumer-groups.sh --bootstrap-server $BS --describe --group $CG
Sorry that I can not provide logs since we have multiple Snowflake Kafka Connectors running and not able to distinguish their logs. #87 (comment)
from snowflake-kafka-connector.
@sfc-gh-zli Yup, this was reported in v1.2.1, my guess is this leak got fixed by #166. Closing this issue, thanks.
from snowflake-kafka-connector.
Related Issues (20)
- Ingesting real-time change data to Snowflake HOT 5
- Configuring temporal type formats with Snowpipe Streaming HOT 3
- Transactional ingest HOT 4
- NDJSON support. HOT 4
- `buffer.flush.time` setting not working correctly. HOT 10
- Struct array elements are being serialized before writing to Array column HOT 4
- CVE-2023-39410 in Snowflake-kafka-connect JAR HOT 1
- Where is the 2.1.1 release? HOT 2
- Using configProviders other than file fails validation HOT 3
- google.cloud.storage.StorageException: 401 Unauthorized, causing RECORD_METADATA Exception: Invalid column name HOT 3
- Snowflake Sink committing offsets for null/tombstone messages HOT 4
- `google.cloud.storage.StorageException: 401 Unauthorized` HOT 3
- SNOW-989387 Connectors errored out after updating to v2.1.2 HOT 18
- Insert order when using snowpipe streaming HOT 2
- Streaming Channel Offset Migration (transient exception) HOT 2
- SCHEMA EVOLUTION: Converting a String to Number Column HOT 2
- Ingestion loop when Snowflake Ingestion fails HOT 3
- Log is flooded with INFO messages HOT 1
- Failure to properly deserialize decimal data type HOT 4
- Distribute "slim" version of the connector HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from snowflake-kafka-connector.