Adding delay to some jobs

Spark-Bench Version

spark-bench-launch-2.1.1_0.2.2-RELEASE

Spark Version on Your Cluster

Spark.2.2.1

Scala Version on Your Spark Cluster

Scala version 2.11.8 Spark Cluster: Spark Standalone ( 1 master and 2 slaves).

Your Exact Configuration File (with system details anonymized)

spark-bench = {
  spark-submit-config = [{
    spark-args = {
      master = "spark://XX.XX.XX.XX:7077"
    }
    workload-suites = [
    {
      descr = "***  KMeans Workload *******"
      benchmark-output = "console"
      workloads = [
        {

         name = "kmeans"
         input = "/tmp/kmeans-data.csv"
         k = 10
        }
      ]
    }
    ]
  }]
}

Description of Problem, Any Other Info

I have run the SparkBench using KMeans Workload. Using the Spark dashboard i got the following jobs:

I am studying the Spark performance. I would like to add some delay inside some jobs ( e.g. adding delay inside job1 5 second). Is there any way to add this delay.

[ecurtin]

I mean that you would need to edit the code inside of Spark itself and recompile Spark. You can use Spark-Bench as-is and just change the spark-home parameter to point to your new version of Spark with your custom changes.

[xiandong79]

@Aalnafessah hi~ Did you succeed in adding delay for some spark-jobs? And how?