question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Heatmap error checking and documentation for data larger than Bitmap supports

See original GitHub issue

Found this on rendering big datasets in to a heat map. From my point of view it looks like that the internal plotting runs into an variable limit (i guess singed short (2^15)) and than stretches the last row of data al the way to the end as seen in pictures,

OK Render less than 2^15 rows in y dimension

outOK1 outOK2

Faild renders at more than 2^15 rows

outFail1 outFail2

[Test]
[TestCase(3768,"outOK1.png")]
[TestCase(32768,"outOK2.png")]
[TestCase(34000,"outFail1.png")]
[TestCase(60000,"outFail2.png")]
        public void ScottplotBoundary( int traceCount ,string path) {
            Random r           = new Random();
            int    sampleCount = 500;
            
            var zData = new double[traceCount, sampleCount];
            for (var i = 0; i < traceCount; i++) {
                for (var i1 = 0; i1 < sampleCount; i1++) {
                    zData[i, i1] = r.NextDouble() ; 
                }
            }
            
            var                plt = new Plot();
            CoordinatedHeatmap hmc = plt.AddHeatMapCoordinated(zData);
            plt.AxisAuto(0, 0);
            plt.SaveFig(path);
        }

found on nuget 4-1.6-beta – running on core 3.1

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:6 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
StendProgcommented, Feb 14, 2021

Hi @swharden, I think this exceptions must be part of optional validation. I use 2k*2k = 4M bitmaps a lot, and it’s very close to provided limits…

0reactions
swhardencommented, Feb 16, 2021

I came to a compromise and like @StendProg suggested moved the size-checking code into the deep validation method. I also extended the XML documentation for the AddHeatmap() methods to indicate rendering may become unpredictable for large arrays with ~10M or more values.

Thanks again for both of your input!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Kernel Density Estimation (Dynamic Heatmap)
A heatmap is a popular method for representing sparse data on a regular raster grid, where each pixel on the grid is influenced...
Read more >
A Complete Guide to Heatmaps
A heatmap (aka heat map) depicts values for a main variable of interest across two axis variables as a grid of colored squares....
Read more >
Big data surface plots: Call gnuplot from tikz to generate ...
The image plotting style generates a bitmap heatmap, which is included in the otherwise vectorial image. This is in my opinion the best...
Read more >
Troubleshooting Heatmaps
If a heatmap has low or no click data, there are a few things to check: Make sure your Clarity tracking code is...
Read more >
99 ORA-60001 to ORA-65535
ORA-62602: The bitmap size exceeds maximum size of its SQL data type. Cause: An attempt was made to construct a bitmap larger than...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found