Super stream support #32
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
acogoluegnes
force-pushed
the
super-stream-consumer
branch
from
b6859f5 to
3bdb085
Compare
Offset storage on a given message trigger the storage for other partitions in the super stream.
The metadata of the super stream are now provided in the
route method. This abstraction hides the infrastructure
needed to find out about the super stream topology.
The user can now have full control over the routing strategy,
even though the provided implementations ("hash" and "key")
should be enough most of the time.
The configuration of the routing strategy has been also refactored
to reflect the change and to be simpler.
The message count before storage setting is divided by the number of partitions to make sure we store offsets approximately as set on the consumer builder (assuming partitions are balanced).
acogoluegnes
force-pushed
the
super-stream-consumer
branch
from
3bdb085 to
0e3826b
Compare
pivotal-rabbitmq-ci
pushed a commit
that referenced
this pull request
Sep 27, 2021
Super stream support
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.