You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I saw that concurrency in Kafka connector and multiple topics support have been added in releases 2.1.0 and 2.2.0 respectively (PR #329 and #658).
The first one is enabled with partitions attributes set accordingly to number of partitions. The second one can be activated with topic attribute as a regexp and pattern attribute set to true (or the topics attribute).
According the documentation
partitions
The number of partitions to be consumed concurrently. The connector creates the specified amount of Kafka consumers. It should match the number of partition of the targeted topic. Type: int
false
1
It is said "the targeted topic", singular. Shall I understand that concurrency is not compliant with multiple topics support, especially with regexp ? If compliant, will each instantiated Kafka consumer consume from all "pattern" targeted topics or each topic will have its own consumers instances ?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi all,
I saw that concurrency in Kafka connector and multiple topics support have been added in releases 2.1.0 and 2.2.0 respectively (PR #329 and #658).
The first one is enabled with
partitions
attributes set accordingly to number of partitions. The second one can be activated withtopic
attribute as a regexp andpattern
attribute set totrue
(or thetopics
attribute).According the documentation
It is said "the targeted topic", singular. Shall I understand that concurrency is not compliant with multiple topics support, especially with regexp ? If compliant, will each instantiated Kafka consumer consume from all "pattern" targeted topics or each topic will have its own consumers instances ?
Best regards.
Beta Was this translation helpful? Give feedback.
All reactions