Comments (3)
Seeking by a MessageId (which contains a partition number) should seek that partition.
It's not the expected behavior. In Java client, a MessageId
that does not contain a topic name cannot be sought as well. Messages received from a multi-topics consumer contain the topic name so that it can be sought because the multi-topics consumer can find the internal consumer to seek. This implementation was introduced since Java client 3.0.0 in apache/pulsar#19158
Is there any way in the provided python API to seek on a per-partition basis as a workaround?
Currently, you can seek to a very large timestamp to simulate seek(MessageId.latest)
.
from pulsar-client-python.
Hi @BewareMyPower - I'm not sure I follow, but are multi-topic consumers entangled in this discussion? In the example above, all I am doing is making a single topic and then trying to seek latest on it. Isn't that exactly the behaviour being discussed here: apache/pulsar#3643 (comment)
Currently, you can seek to a very large timestamp to simulate seek(MessageId.latest).
Will swap over to doing this in the interim, cheers :)
from pulsar-client-python.
but are multi-topic consumers entangled in this discussion?
It's always confusing in Pulsar when topics and partitions are mentioned. I'd rather to mention "topic" as "non-partitioned topic" or "a partition of a partitioned topic". In Java client, a multi-topics consumer could also be created when the subscribed topic is a single partitioned topic.
from pulsar-client-python.
Related Issues (20)
- Negative acknowledge doesn't work with message_id HOT 2
- Producer callback is unable to utilise python raise to propagate errors HOT 14
- Document for the pulsar.Result enum
- Document for the batching arguments when creating producer
- Add proper type hints for public APIs HOT 1
- Reader set to MessageId.latest and inclusive start message does not work HOT 6
- Custom logger doesn't work with created resources (like producers) HOT 5
- Avro EOF Error HOT 1
- publish sdist for pypi HOT 5
- Reader.has_message_available() returns True even if no messages to consume, when start_message_id is earliest HOT 2
- Segmentation fault sometimes happens when running unit tests HOT 2
- 3.5.0 release? HOT 2
- There is a memory leak,I need help HOT 3
- Support on PPC64LE
- Singleton Pulsar Producer Using Python Client Not Working HOT 7
- Multi Topic consumer not using client provided logger - MultiTopicsConsumerImpl:526 | Received Message from one of the topic HOT 2
- Support for tableview in python client.
- 3.0.6 LTS maintenance release? HOT 1
- Disable consumer auto reconnect HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pulsar-client-python.