Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Creating COG out of big rasters

See original GitHub issue

I’m trying to create a COG out of a very big rasters (e.g. 73012 x 364544) and I spotted the following pattern: the progress bar is very fast at the beginning of the process but but it gets slower and slower as it gets closer to the end. For example the first 20% have been completed in few minutes but then:

Reading input: /tmp/tmpg1bth1qf/dest/20211207_023956_SN8_L3_SR_MS.tif
  [##########--------------------------]   27%  03:56:52

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:8 (3 by maintainers)

github_iconTop GitHub Comments

drnextgiscommented, Jan 7, 2022

I don’t know the root cause of the issue but I’ve found a workaround.

In my case blockxsize / blockysize values of the source raster are 512px. When I set blockxsize=512 and blockxsize=512 for the output raster then everything works fine (1024px is also ok). But if change it to 256px then performance becomes very poor. Closing for now.

drnextgiscommented, Jan 7, 2022

Apparently add_mask=True is a culprit. With add_mask=False it takes same amount of time as for gdal_translate.

Read more comments on GitHub >

github_iconTop Results From Across the Web

COG – Cloud Optimized GeoTIFF generator - GDAL
This driver supports the creation of Cloud Optimized GeoTIFF (COG) ... BIGTIFF=YES if the final file is anticipated to be too big for...
Read more >
Large GeoTiff (raster) files on GeoServer using COG
Navigate to GeoServer's data directory, create a folder called cogs then copy and paste or cog file envisat_cog.tif into that directory. Back to ......
Read more >
Creating BigTiff COGS for raster RGB photos from a tile ...
First create the virtual mosaic from the directory of tiles, ensuring that a alpha band is created in the VRT to set transparency...
Read more >
GeoExamples - Cloud Optimized GeoTIFF tutorial
The easiest way to create a COG is using the GDAL command line interface. If the GeoTIFF data is created from a script...
Read more >
Accessing data from large online rasters with Cloud-Optimized ...
In this post I show how we can convert any raster to a cloud-optimised-geotiff (COG), and efficiently read data from online COG using...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Post

No results found

github_iconTop Related Hashnode Post

No results found