Allow to benchmark multi-machine clusters
See original GitHub issueCurrently, it is only possible to benchmark on a single machine (except for the special case where we run with --pipeline=benchmark-only
which (a) puts the burden of provisioning on the user and (b) does not gather system metrics (like CPU usage or index size). Rally should be able to run benchmarks also on clusters across multiple machines.
In this ticket we want to collect the high-level ideas around making this possible. Work should be done in smaller, more focused tickets. At least these areas need to change:
- Provisioning (consider also #42 and #117)
- Gathering metrics (we need to gather them on the machines that are being benchmarked)
- Reporting: We currently report system level metrics only once (e.g. CPU usage) and need to reconsider that (although we will prepare for that case already in #54)
Note: Distribution of the load generator is handled separately in #257.
Issue Analytics
- State:
- Created 7 years ago
- Comments:6 (4 by maintainers)
Top Results From Across the Web
Chapter 4. Multi-machine cluster intallation Red Hat Ansible ...
Mutli-machine cluster installation with an external managed database ... The Ansible Automation Platform installer allows you to deploy only one automation ...
Read more >Enable Benchmarking - Analytics Help
Click Admin. Under ACCOUNT, click Account Settings. Select the Benchmarking checkbox. Click Save.
Read more >Benchmark Setup with Citus and pgbench
The easiest way to start a Citus Cluster is by vising the Citus Cloud dashboard. This dashboard allows you to choose different coordinator...
Read more >Performance Benchmarking with Big Data - Geotab
Advantages of benchmarking with IoT · Unprecedented level of detail · No wait times for industry benchmarks · Multi-machine Benchmarking · Data ...
Read more >Clustering Guide | etcd
Bootstrapping an etcd cluster: Static, etcd Discovery, ... etcd listens on listen-client-urls to accept client traffic. etcd member ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
We’ll implement this gradually and implement support for single-machine clusters in #184 first. Then we can extend Rally to multi-machine clusters. This will reduce the risk of adding too many changes at once (as we then also need an ability to define cluster topology).
Gotcha, thanks!