Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Remove transaction delays to improve throughput and change meaning of scenario runner users key #127

Merged
merged 4 commits into from
Jan 12, 2024

Conversation

dav1do
Copy link
Contributor

@dav1do dav1do commented Jan 10, 2024

This makes some changes to the runner to improve throughput and make the "users" key easier to understand and more likely to work.

  • The user value in the spec is now defined as users/worker (node), rather than being the total users and needing to be divisible by the number of nodes.
  • I removed the sleep between every transaction in a number of scenarios. As we're targeting one write/3.5 milliseconds, the current values aren't super insightful (way too lazy). The SIMULATE_THROTTLE_REQUESTS env var can be used to avoid each worker going bananas. If we want, we can expose the min/max wait as CLI options, as it can be applied to the scenario struct when building it.
  • I added recording the transaction, scenario, and error logs on the goose workers as the scenario and transaction were added in feat: add tokio-console support #124.

 Now, the user value defines how many users to execute for each node.
Previously, it was the total users and needed to be evenly divisible by the number of nodes.
@dav1do dav1do requested review from smrz2001 and 3benbox January 10, 2024 16:44
Copy link
Contributor

@3benbox 3benbox left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Collaborator

@smrz2001 smrz2001 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

runner/src/simulate.rs Outdated Show resolved Hide resolved
@dav1do dav1do merged commit dd46948 into feat/ws1-1409-event-sync Jan 12, 2024
1 check passed
@dav1do dav1do deleted the feat/scenario-load branch January 12, 2024 04:08
dav1do added a commit that referenced this pull request Jan 17, 2024
…ing of scenario runner users key (#127)

* fix: adjust runner user count to mean users/worker and adjust default value
* feat: capture worker error logs
* feat: delete long wait times between scenario tx
github-merge-queue bot pushed a commit that referenced this pull request Jan 19, 2024
…ing of scenario runner users key (#127)

* fix: adjust runner user count to mean users/worker and adjust default value
* feat: capture worker error logs
* feat: delete long wait times between scenario tx
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants