Add bucketing for messaging queues

[shivanshuraj1333]

Important

Adds time bucketing to SQL queries for Kafka messaging queues in sql.go, enhancing data filtering by tsBucketStart and tsBucketEnd.

• Behavior:
  • Adds bucketing logic to SQL queries in sql.go for Kafka messaging queues.
  • Introduces tsBucketStart and tsBucketEnd to filter data within specific time buckets.
• Functions:
  • Updates generateConsumerSQL(), generatePartitionLatencySQL(), generateConsumerPartitionLatencySQL() to include tsBucketStart and tsBucketEnd in WHERE clauses.
  • Modifies generateProducerPartitionThroughputSQL(), generateProducerTopicLatencySQL(), generateConsumerLatencySQL() similarly.
  • Adjusts generateConsumerServiceLatencySQL(), generateProducerSQL(), generateNetworkLatencyThroughputSQL() to use new bucketing logic.
  • Updates onboardProducersSQL() and onboardConsumerSQL() to incorporate time bucketing.

^{This description was created by for b21a5e8. It will automatically update as commits are pushed.}

[request-info]

We would appreciate it if you could provide us with more info about this issue/pr!

[ellipsis-dev]

👍 Looks good to me! Reviewed everything up to b21a5e8 in 1 minute and 6 seconds

More details

• Looked at 272 lines of code in 1 files
• Skipped 0 files when reviewing.
• Skipped posting 2 drafted comments based on config settings.

1. pkg/query-service/app/integrations/messagingQueues/kafka/sql.go:9

• Draft comment:
  The calculation of tsBucketStart subtracts 1800 seconds from the start time, which may lead to incorrect bucketing. Ensure this is the intended behavior.
• Reason this comment was not posted:
  Comment did not seem useful.

2. pkg/query-service/app/integrations/messagingQueues/kafka/sql.go:6

• Draft comment:
  Avoid using the component/index.tsx file structure approach, as it makes it difficult to debug and find components using global search tools like VS Code.
• Reason this comment was not posted:
  Comment was not on a valid diff hunk.

Workflow ID: wflow_cL2PDfTgP6ezZjce

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.