question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Allow to benchmark multi-machine clusters

See original GitHub issue

Currently, it is only possible to benchmark on a single machine (except for the special case where we run with --pipeline=benchmark-only which (a) puts the burden of provisioning on the user and (b) does not gather system metrics (like CPU usage or index size). Rally should be able to run benchmarks also on clusters across multiple machines.

In this ticket we want to collect the high-level ideas around making this possible. Work should be done in smaller, more focused tickets. At least these areas need to change:

  • Provisioning (consider also #42 and #117)
  • Gathering metrics (we need to gather them on the machines that are being benchmarked)
  • Reporting: We currently report system level metrics only once (e.g. CPU usage) and need to reconsider that (although we will prepare for that case already in #54)

Note: Distribution of the load generator is handled separately in #257.

Issue Analytics

  • State:closed
  • Created 7 years ago
  • Comments:6 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
danielmitterdorfercommented, Nov 21, 2016

We’ll implement this gradually and implement support for single-machine clusters in #184 first. Then we can extend Rally to multi-machine clusters. This will reduce the risk of adding too many changes at once (as we then also need an ability to define cluster topology).

1reaction
mxplusbcommented, Jul 30, 2016

Gotcha, thanks!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Chapter 4. Multi-machine cluster intallation Red Hat Ansible ...
Mutli-machine cluster installation with an external managed database ... The Ansible Automation Platform installer allows you to deploy only one automation ...
Read more >
Enable Benchmarking - Analytics Help
Click Admin. Under ACCOUNT, click Account Settings. Select the Benchmarking checkbox. Click Save.
Read more >
Benchmark Setup with Citus and pgbench
The easiest way to start a Citus Cluster is by vising the Citus Cloud dashboard. This dashboard allows you to choose different coordinator...
Read more >
Performance Benchmarking with Big Data - Geotab
Advantages of benchmarking with IoT · Unprecedented level of detail · No wait times for industry benchmarks · Multi-machine Benchmarking · Data ...
Read more >
Clustering Guide | etcd
Bootstrapping an etcd cluster: Static, etcd Discovery, ... etcd listens on listen-client-urls to accept client traffic. etcd member ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found