Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Creating COG out of big rasters

See original GitHub issue

I’m trying to create a COG out of a very big rasters (e.g. 73012 x 364544) and I spotted the following pattern: the progress bar is very fast at the beginning of the process but but it gets slower and slower as it gets closer to the end. For example the first 20% have been completed in few minutes but then:

Reading input: /tmp/tmpg1bth1qf/dest/20211207_023956_SN8_L3_SR_MS.tif
  [##########--------------------------]   27%  03:56:52

Issue Analytics

State:
Created 2 years ago
Comments:8 (3 by maintainers)

Top GitHub Comments

2reactions

drnextgiscommented, Jan 7, 2022

I don’t know the root cause of the issue but I’ve found a workaround.

In my case blockxsize / blockysize values of the source raster are 512px. When I set blockxsize=512 and blockxsize=512 for the output raster then everything works fine (1024px is also ok). But if change it to 256px then performance becomes very poor. Closing for now.

2reactions

drnextgiscommented, Jan 7, 2022

Apparently add_mask=True is a culprit. With add_mask=False it takes same amount of time as for gdal_translate.

Top Results From Across the Web

COG – Cloud Optimized GeoTIFF generator - GDAL

This driver supports the creation of Cloud Optimized GeoTIFF (COG) ... BIGTIFF=YES if the final file is anticipated to be too big for...

Large GeoTiff (raster) files on GeoServer using COG

Navigate to GeoServer's data directory, create a folder called cogs then copy and paste or cog file envisat_cog.tif into that directory. Back to ......

Creating BigTiff COGS for raster RGB photos from a tile ...

First create the virtual mosaic from the directory of tiles, ensuring that a alpha band is created in the VRT to set transparency...

GeoExamples - Cloud Optimized GeoTIFF tutorial

The easiest way to create a COG is using the GDAL command line interface. If the GeoTIFF data is created from a script...

Accessing data from large online rasters with Cloud-Optimized ...

In this post I show how we can convert any raster to a cloud-optimised-geotiff (COG), and efficiently read data from online COG using...