Releases: ricardoarchive/kafka-topic-cloner
Releases · ricardoarchive/kafka-topic-cloner
Skip control messages
- Don't block when consuming control-messages-only event batches
This allows to clone exactly-once topic, but the target looses the contorl messages.
Compression codecs
- Corrected a bug that prevented cloning large batches of small-sized messages
- Implemented compression codecs (you can choose between the 4 standard values: none, gzip, snappy, lz4)
- Changed the hasher's shorthand (now 'p')
Cross-cluster cloning
- Implemented cross-cluster cloning
- Changed some parameter names / shorthands
- Added some verifications before actually cloning
- Various bugfixes
High-volume producer
This version contains a debugged producer (which was not supporting high-volume topics before).
The vendor folder has been removed from github.
The code is cleaner, some comments appeared and the README is finally up-to-date!
Also, we added a fancy .exe binary for windows users.
Async producer
The producing is now executed by batches, thanks to an async producer.
This greatly increases the cloning performances.
Code refactoring
- The code is now prettier :)
- Added a timeout parameter to let the user choose the value (default 10s)
- Added a default-hasher parameter to disable the use of the murmur2 hasher (still recommended)
- Added some verbose logs
Timeout
The cloning loop now timeouts after 10 seconds without cloning any new event.
Murmur hasher
Added murmur-based partitioning and a verbose mode
First release
Merge pull request #10 from ricardo-ch/timeout Added timeout after 10 seconds