bitspark/telstar

Telstar makes it easy to write consumer groups and producers against redis streams

telstar's Issues

Add Backoff mechanics

Syntax Idea:

@app.consumer("extractor.v2", ["contentAdded"], backoff=True)
def method(record: Content):
    do_something()

Setup release tracking with git tags and releases on github

`telstar.stage` does not dates

It throws TypeError: Object of type datetime is not JSON serializable when passed a dict with {"now": datetime.datetime.now()}

Add API to work with multiple streams at once

If you want to listen for n > 1 streams you need multiple instances of the consumer which is cumbersome and actually not needed as redis supports reading from multiple streams at once.

Add telstar admin capabilities

In order to understand an entire system one needs to have the ability to probe internals and derive a conclusion from them. That is why we need to have something along the lines of:

# create an admin object
admin = telstar.admin(redis.from_url("..."))
admin.get_streams()
admin.get_consumers()
admin.get_groups()

# A single stream also needs to be inspectable
[ stream ] = admin.get_streams()
stream.get_pending_messages()

# Inspect things that look dead
admin.get_dead_groups()
admin.get_dead_consumers()
admin.get_broken_messages()

# Maintenance methods
[group] = admin.get_dead_groups()
group.remove()

[consumer] = admin.get_dead_consumers()
consumer.remove()

[message] = admin.get_broken_messages()
message.ack()
message.mark_as_seen()
message.remove()

[stream] = admin.get_streams()
stream.trim(size=1000)