[QUESTION]: How to use SparkSession.ExecuteCommand

I have found this page in the documentation but I would like to know how to use it

I have tried doing the following example:

var optionsDictionary = new Dictionary<string, string>
        {
            {"driver", "com.microsoft.sqlserver.jdbc.SQLServerDriver"},
            {"jdbcUrl", $"jdbc:sqlserver://{server};database={db};user={user};password={password}"}
        };
_sparkSession.ExecuteCommand("runner", $"DROP TABLE {temporaryTable};", optionsDictionary);

StackTrace:

System.Exception: JVM method execution failed: Nonstatic method 'executeCommand' failed for class '6' when called with 3 arguments ([Index=1, Type=String, Value=runner], [Index=2, Type=String, Value=DROP TABLE TemporaryTable;], [Index=3, Type=Dictionary`2, Value=System.Collections.Generic.Dictionary`2[System.String,System.String]], )
 ---> Microsoft.Spark.JvmException
   --- End of inner exception stack trace ---
   at Microsoft.Spark.Interop.Ipc.JvmBridge.CallJavaMethod(Boolean isStatic, Object classNameOrJvmObjectReference, String methodName, Object[] args)
   at Microsoft.Spark.Interop.Ipc.JvmBridge.CallNonStaticJavaMethod(JvmObjectReference objectId, String methodName, Object[] args)
   at Microsoft.Spark.Interop.Ipc.JvmObjectReference.Invoke(String methodName, Object[] args)
   at Microsoft.Spark.Sql.SparkSession.ExecuteCommand(String runner, String command, Dictionary`2 options)

[imback82]

Do you have a runner class that implements ExternalCommandRunner on the JVM side?

If you do, you can pass the JAR that contains the runner class as a part of the spark-submit.

[rajeev99342]

Hi @this-fifo. No problem man. Thanks WTB