Comments (3)
serejja
commented on August 22, 2024
Hey @baconalot please checkout the latest master, we got rid of using the allPartitionMap (which is the topic-partition map used by fetcher manager) in fetcherRoutines and this problem should vanish now. Let us know though if doesn't work as expected for you.
Thanks!
from go_kafka_client.
baconalot
commented on August 22, 2024
Hi @serejja that helps with the crash, which does not occur anymore. But.. now either one of the pids get all the partitions or nothing. Is is arbitrary if the latest started one gets the partitions or they remain with the first started, but they never balance like: pid1 -> part1 + part2 [enter pid2] pid1 -> part2 & pid2 -> part1.
from go_kafka_client.
serejja
commented on August 22, 2024
Hi @baconalot,
sorry for getting this abandoned. Does this still occur? Lots of changes were made since then including fixing lots of rebalance issues.
Thanks!
from go_kafka_client.
Related Issues (20)
- consumer.Close() never finishes and always panics HOT 5
- 76% of time are `runtime.goexit` HOT 11
- go get -u github.com/stealthly/go_kafka_client throw error
- Manual commits HOT 1
- low level consumer throws invalid memory address on calling go_kafka_client.(*SaramaClient).Initialize HOT 1
- panic when i start use config.OffsetStorage = NewSiestaClient(config) HOT 8
- Documentation
- SiestaClient not commiting offsets with Go Kafka Client HOT 1
- Build out a framework for Go Kafka Client on Mesos HOT 3
- Panic thrown when Zookeeper Node Restarts HOT 3
- Godeps lists the wrong version of jimlawless/cfg HOT 1
- No API document? HOT 2
- BUG?: why not break after handle all request？(tryRemoveOldApiRequests) HOT 2
- when consumer connect to zk fail, it create a large number connect in short time.
- Can't find jimlawless/cfg HOT 1
- Install Error: HOT 1
- Create topic
- Unable to store consumer offsets in kafka HOT 1
- Failed awaiting on state barrier HOT 1
- Clarify relation to siesta
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from go_kafka_client.