Heatmap error checking and documentation for data larger than Bitmap supports
See original GitHub issueFound this on rendering big datasets in to a heat map. From my point of view it looks like that the internal plotting runs into an variable limit (i guess singed short (2^15)) and than stretches the last row of data al the way to the end as seen in pictures,
OK Render less than 2^15 rows in y dimension
Faild renders at more than 2^15 rows
[Test]
[TestCase(3768,"outOK1.png")]
[TestCase(32768,"outOK2.png")]
[TestCase(34000,"outFail1.png")]
[TestCase(60000,"outFail2.png")]
public void ScottplotBoundary( int traceCount ,string path) {
Random r = new Random();
int sampleCount = 500;
var zData = new double[traceCount, sampleCount];
for (var i = 0; i < traceCount; i++) {
for (var i1 = 0; i1 < sampleCount; i1++) {
zData[i, i1] = r.NextDouble() ;
}
}
var plt = new Plot();
CoordinatedHeatmap hmc = plt.AddHeatMapCoordinated(zData);
plt.AxisAuto(0, 0);
plt.SaveFig(path);
}
found on nuget 4-1.6-beta – running on core 3.1
Issue Analytics
- State:
- Created 3 years ago
- Comments:6 (5 by maintainers)
Top Results From Across the Web
Kernel Density Estimation (Dynamic Heatmap)
A heatmap is a popular method for representing sparse data on a regular raster grid, where each pixel on the grid is influenced...
Read more >A Complete Guide to Heatmaps
A heatmap (aka heat map) depicts values for a main variable of interest across two axis variables as a grid of colored squares....
Read more >Big data surface plots: Call gnuplot from tikz to generate ...
The image plotting style generates a bitmap heatmap, which is included in the otherwise vectorial image. This is in my opinion the best...
Read more >Troubleshooting Heatmaps
If a heatmap has low or no click data, there are a few things to check: Make sure your Clarity tracking code is...
Read more >99 ORA-60001 to ORA-65535
ORA-62602: The bitmap size exceeds maximum size of its SQL data type. Cause: An attempt was made to construct a bitmap larger than...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Hi @swharden, I think this exceptions must be part of optional validation. I use 2k*2k = 4M bitmaps a lot, and it’s very close to provided limits…
I came to a compromise and like @StendProg suggested moved the size-checking code into the deep validation method. I also extended the XML documentation for the
AddHeatmap()
methods to indicate rendering may become unpredictable for large arrays with ~10M or more values.Thanks again for both of your input!