Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[FEATURE REQUEST]: Structured DataFrame.Explain

See original GitHub issue

Is there any technical reason why the output of DataFrame.Explain cannot be returned in a structured form? Happy to have a look and submit a PR if it’s possible and would be desirable.

Thanks for the great work.

Issue Analytics

State:
Created 3 years ago
Reactions:1
Comments:9 (7 by maintainers)

Top GitHub Comments

1reaction

imback82commented, Apr 3, 2020

Also, if you want to see this in action, you can try to debug the application: https://github.com/dotnet/spark/blob/master/docs/developer-guide.md#how-to-do-local-debugging and you will see which gets outputted to which console.

1reaction

imback82commented, Apr 3, 2020

You can get to JvmObjectReference IJvmObjectReferenceProvider.Reference => _jvmObject; or SparkEnvironment.JvmBridge.

Top Results From Across the Web

DataFrames in Spark - The Definitive Guide

In Spark, DataFrames are the distributed collections of data, organized into rows and columns. Each column in a DataFrame has a name and...

The pandas DataFrame: Make Working With Data Delightful

In this tutorial, you'll get started with pandas DataFrames, which are powerful and widely used two-dimensional data structures. You'll learn how to perform ......

What are DataFrames?

A DataFrame is a data structure that organizes data into a 2-dimensional table of rows and columns, much like a spreadsheet. Learn more....

Structured Streaming Programming Guide

Streaming DataFrames can be created through the DataStreamReader interface (Scala/Java/Python docs) returned by SparkSession.readStream() . In R, with the read.

Python Pandas DataFrame

Pandas DataFrame is two-dimensional size-mutable, potentially heterogeneous tabular data structure with labeled axes (rows and columns).