Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Investigate slow down in tile read - with GDAL 3.2 / PROJ 7.1

See original GitHub issue

Recent change in rasterio wheels have slowed down the benchmark results 😱

I’m pretty sure this is PROJ Network related but so far trying to set PROJ_NETWORK="OFF" didn’t change the results

Rasterio 1.2.0 (wheels, GDAL 3.2 PROJ 7.1)

------------------------------ benchmark 'boundless tile ': 32 tests -------------------------------
Name (time in ms)          Min                 Max                Mean              Median          
----------------------------------------------------------------------------------------------------
uint8-none            108.5558 (1.0)      126.8517 (1.04)     115.1905 (1.0)      112.1499 (1.0)    
int8-none             109.6052 (1.01)     121.6052 (1.0)      118.0994 (1.03)     119.2085 (1.06)   
uint8-alpha           110.6480 (1.02)     125.7326 (1.03)     117.4947 (1.02)     118.3415 (1.06)   
int8-nodata           110.7580 (1.02)     123.3845 (1.01)     117.2090 (1.02)     116.2332 (1.04)   
uint8-mask            110.7956 (1.02)     131.3988 (1.08)     119.6921 (1.04)     120.7951 (1.08)   
int8-mask             111.7627 (1.03)     123.2978 (1.01)     117.8066 (1.02)     116.9831 (1.04)   
uint8-nodata          111.8703 (1.03)     152.9090 (1.26)     123.9524 (1.08)     119.1758 (1.06)   
uint16-mask           111.9459 (1.03)     127.4050 (1.05)     119.4055 (1.04)     119.3883 (1.06)   
uint16-nodata         113.4022 (1.04)     126.1931 (1.04)     120.1505 (1.04)     120.3528 (1.07)   
uint16-none           113.8831 (1.05)     132.1449 (1.09)     119.8992 (1.04)     117.7171 (1.05)   
int16-none            115.2442 (1.06)     129.8928 (1.07)     123.3345 (1.07)     123.3232 (1.10)   
uint32-none           116.3571 (1.07)     142.1609 (1.17)     126.5434 (1.10)     124.2245 (1.11)   
int8-alpha            116.8246 (1.08)     137.9757 (1.13)     124.9687 (1.08)     122.6505 (1.09)   
int32-none            117.1793 (1.08)     129.2304 (1.06)     123.7179 (1.07)     123.1899 (1.10)   
int16-mask            117.4448 (1.08)     131.4058 (1.08)     125.6912 (1.09)     127.1211 (1.13)   
float32-nodata        117.8420 (1.09)     128.8745 (1.06)     123.4513 (1.07)     123.3787 (1.10)   
int32-nodata          119.3298 (1.10)     146.0470 (1.20)     130.7116 (1.13)     130.2676 (1.16)   
uint32-mask           119.8624 (1.10)     134.5737 (1.11)     127.5335 (1.11)     128.3267 (1.14)   
float32-alpha         120.0401 (1.11)     132.9804 (1.09)     127.4635 (1.11)     127.2211 (1.13)   
int16-nodata          120.1741 (1.11)     129.7522 (1.07)     125.8600 (1.09)     125.8432 (1.12)   
float64-mask          120.5540 (1.11)     146.2014 (1.20)     134.3785 (1.17)     133.5396 (1.19)   
uint32-nodata         120.5606 (1.11)     131.9888 (1.09)     126.6672 (1.10)     127.0793 (1.13)   
float32-mask          120.7796 (1.11)     136.2334 (1.12)     126.5621 (1.10)     126.1069 (1.12)   
float64-nodata        122.0620 (1.12)     135.6752 (1.12)     127.7181 (1.11)     127.7623 (1.14)   
int32-alpha           122.6442 (1.13)     138.9959 (1.14)     129.4443 (1.12)     129.0930 (1.15)   
int16-alpha           123.7984 (1.14)     136.2212 (1.12)     129.9288 (1.13)     129.8224 (1.16)   
float32-none          123.9311 (1.14)     139.5618 (1.15)     129.1787 (1.12)     128.0166 (1.14)   
uint16-alpha          124.7180 (1.15)     135.7632 (1.12)     129.8693 (1.13)     129.4375 (1.15)   
float64-none          124.7569 (1.15)     138.5068 (1.14)     130.8611 (1.14)     131.2135 (1.17)   
int32-mask            124.8037 (1.15)     142.8469 (1.17)     131.1598 (1.14)     129.0305 (1.15)   
uint32-alpha          125.7560 (1.16)     140.9796 (1.16)     132.4900 (1.15)     132.3716 (1.18)   
float64-alpha         134.7508 (1.24)     141.5945 (1.16)     138.8557 (1.21)     139.4906 (1.24)

ref: https://github.com/cogeotiff/rio-tiler/runs/1836212131?check_suite_focus=true

Rasterio 1.1.8 (wheels, GDAL 2.4 PROJ 5?)

---------------------------- benchmark 'boundless tile ': 32 tests -----------------------------
Name (time in ms)         Min                Max               Mean             Median       
------------------------------------------------------------------------------------------------
int8-none             11.2351 (1.0)      11.6735 (1.02)     11.2756 (1.0)      11.2677 (1.0) 
uint8-none            11.2519 (1.00)     11.3936 (1.0)      11.2838 (1.00)     11.2827 (1.00)
uint8-nodata          11.8479 (1.05)     11.9658 (1.05)     11.8813 (1.05)     11.8780 (1.05)
int8-nodata           11.8703 (1.06)     11.9715 (1.05)     11.9043 (1.06)     11.9030 (1.06)
int8-mask             12.8745 (1.15)     12.9406 (1.14)     12.8962 (1.14)     12.8937 (1.14)
uint8-mask            12.8860 (1.15)     14.1836 (1.24)     12.9457 (1.15)     12.9027 (1.15)
uint8-alpha           13.9131 (1.24)     14.0786 (1.24)     13.9487 (1.24)     13.9442 (1.24)
int8-alpha            13.9450 (1.24)     14.0137 (1.23)     13.9759 (1.24)     13.9757 (1.24)
int16-none            14.5551 (1.30)     14.6662 (1.29)     14.5944 (1.29)     14.5957 (1.30)
uint16-none           14.5883 (1.30)     15.9511 (1.40)     14.7249 (1.31)     14.6237 (1.30)
uint16-nodata         15.5985 (1.39)     15.6652 (1.37)     15.6305 (1.39)     15.6284 (1.39)
int16-nodata          15.6070 (1.39)     16.0283 (1.41)     15.6651 (1.39)     15.6482 (1.39)
int16-mask            16.3793 (1.46)     16.5309 (1.45)     16.4164 (1.46)     16.4129 (1.46)
uint16-mask           16.3931 (1.46)     17.9173 (1.57)     16.4741 (1.46)     16.4321 (1.46)
float32-none          17.4943 (1.56)     17.9977 (1.58)     17.5404 (1.56)     17.5289 (1.56)
float32-nodata        18.4476 (1.64)     19.1201 (1.68)     18.5291 (1.64)     18.4991 (1.64)
uint32-none           19.0480 (1.70)     20.4486 (1.79)     19.1069 (1.69)     19.0791 (1.69)
uint32-nodata         19.1961 (1.71)     19.2700 (1.69)     19.2372 (1.71)     19.2371 (1.71)
float32-mask          19.2293 (1.71)     19.3944 (1.70)     19.2809 (1.71)     19.2787 (1.71)
int32-nodata          19.4194 (1.73)     19.7311 (1.73)     19.4573 (1.73)     19.4464 (1.73)
int32-none            19.4539 (1.73)     19.5605 (1.72)     19.4969 (1.73)     19.4942 (1.73)
float32-alpha         20.0840 (1.79)     20.1823 (1.77)     20.1227 (1.78)     20.1233 (1.79)
uint32-mask           20.1992 (1.80)     20.3131 (1.78)     20.2379 (1.79)     20.2354 (1.80)
int32-mask            20.4991 (1.82)     20.5783 (1.81)     20.5293 (1.82)     20.5268 (1.82)
uint16-alpha          20.5555 (1.83)     20.7778 (1.82)     20.5977 (1.83)     20.5886 (1.83)
float64-nodata        20.7182 (1.84)     20.8266 (1.83)     20.7402 (1.84)     20.7339 (1.84)
int16-alpha           20.7372 (1.85)     20.8623 (1.83)     20.7886 (1.84)     20.7842 (1.84)
float64-none          20.9546 (1.87)     21.6983 (1.90)     21.0181 (1.86)     20.9960 (1.86)
uint32-alpha          21.8330 (1.94)     22.5884 (1.98)     21.9114 (1.94)     21.8732 (1.94)
float64-mask          22.0051 (1.96)     22.5801 (1.98)     22.0775 (1.96)     22.0708 (1.96)
int32-alpha           22.2331 (1.98)     23.4782 (2.06)     22.3817 (1.98)     22.2635 (1.98)
float64-alpha         28.2078 (2.51)     28.3588 (2.49)     28.2380 (2.50)     28.2259 (2.51)
------------------------------------------------------------------------------------------------

ref: https://github.com/cogeotiff/rio-tiler/runs/1752857857?check_suite_focus=true

Issue Analytics

State:
Created 3 years ago
Reactions:1
Comments:6 (5 by maintainers)

Top GitHub Comments

2reactions

vincentsaragocommented, Mar 26, 2021

@knownasilya https://github.com/cogeotiff/rio-tiler/discussions/375#discussioncomment-531514

No, it’s yet to be release in GDAL (3.3) and then in Rasterio wheels

1reaction

vincentsaragocommented, Jun 3, 2021

Update: rasterio 1.2.4 wheels is now shipped with gdal 3.3 and the benchmark numbers are a bit better


---------------------------- benchmark 'boundless tile ': 32 tests -----------------------------
Name (time in ms)         Min                Max               Mean             Median          
------------------------------------------------------------------------------------------------
uint8-none            36.0845 (1.0)      36.8890 (1.0)      36.3359 (1.0)      36.2777 (1.0)    
int8-none             36.1478 (1.00)     36.9407 (1.00)     36.3401 (1.00)     36.2810 (1.00)   
uint8-nodata          37.1855 (1.03)     37.4427 (1.02)     37.2892 (1.03)     37.2724 (1.03)   
int8-nodata           37.2892 (1.03)     38.0494 (1.03)     37.4661 (1.03)     37.4175 (1.03)   
uint8-mask            37.5013 (1.04)     38.7525 (1.05)     37.8128 (1.04)     37.6675 (1.04)   
int8-mask             37.5848 (1.04)     40.1506 (1.09)     37.9931 (1.05)     37.7323 (1.04)   
uint8-alpha           39.1817 (1.09)     43.0933 (1.17)     39.8805 (1.10)     39.6071 (1.09)   
int8-alpha            39.2252 (1.09)     42.1031 (1.14)     39.7188 (1.09)     39.4863 (1.09)   
int16-none            39.5304 (1.10)     40.0263 (1.09)     39.6825 (1.09)     39.6272 (1.09)   
uint16-none           39.6292 (1.10)     41.3537 (1.12)     40.1360 (1.10)     40.1174 (1.11)   
uint16-nodata         40.9142 (1.13)     42.3014 (1.15)     41.3534 (1.14)     41.2695 (1.14)   
int16-nodata          41.0232 (1.14)     41.5285 (1.13)     41.2542 (1.14)     41.2321 (1.14)   
int16-mask            41.0269 (1.14)     42.3144 (1.15)     41.3744 (1.14)     41.2496 (1.14)   
uint16-mask           41.1403 (1.14)     44.4045 (1.20)     41.7933 (1.15)     41.4693 (1.14)   
float32-none          42.6787 (1.18)     43.5693 (1.18)     42.8966 (1.18)     42.8695 (1.18)   
float32-nodata        43.6781 (1.21)     44.5622 (1.21)     43.8753 (1.21)     43.7682 (1.21)   
float32-mask          43.9407 (1.22)     46.4043 (1.26)     44.6261 (1.23)     44.4294 (1.22)   
uint32-none           44.3420 (1.23)     47.4058 (1.29)     44.9163 (1.24)     44.6874 (1.23)   
int32-none            44.6777 (1.24)     45.7105 (1.24)     44.9701 (1.24)     44.9806 (1.24)   
uint32-nodata         44.9128 (1.24)     45.7491 (1.24)     45.2326 (1.24)     45.1528 (1.24)   
uint32-mask           45.1234 (1.25)     46.2527 (1.25)     45.4043 (1.25)     45.2577 (1.25)   
int32-nodata          45.2145 (1.25)     45.7462 (1.24)     45.4282 (1.25)     45.4019 (1.25)   
uint16-alpha          45.4811 (1.26)     47.0015 (1.27)     45.8007 (1.26)     45.6506 (1.26)   
int16-alpha           45.6208 (1.26)     48.0502 (1.30)     46.0785 (1.27)     45.8841 (1.26)   
int32-mask            45.8539 (1.27)     47.6034 (1.29)     46.3157 (1.27)     46.2353 (1.27)   
float64-none          45.9549 (1.27)     47.2615 (1.28)     46.5413 (1.28)     46.5551 (1.28)   
float64-nodata        46.2531 (1.28)     46.9339 (1.27)     46.5561 (1.28)     46.4983 (1.28)   
float32-alpha         46.5752 (1.29)     47.5749 (1.29)     46.9523 (1.29)     46.9053 (1.29)   
float64-mask          46.9536 (1.30)     48.7336 (1.32)     47.4195 (1.31)     47.2932 (1.30)   
uint32-alpha          47.5474 (1.32)     49.4702 (1.34)     48.1462 (1.33)     47.9025 (1.32)   
int32-alpha           47.7178 (1.32)     48.3405 (1.31)     47.9654 (1.32)     47.9418 (1.32)   
float64-alpha         53.3614 (1.48)     54.8137 (1.49)     53.8984 (1.48)     53.7636 (1.48)

Top Results From Across the Web

GDAL Documentation

GDAL is a translator library for raster and vector geospatial data formats that is released under an MIT style Open. Source License by...

Changelog for GDAL 3.2.0 - ABI laboratory

Requires libheif - OGCAPI: tiles/maps/coverage raster/vector experimental driver - TGA: read/only driver to read TGA image file format * New OGR drivers: ...

Read() when more - GitHub

Requires libheif - OGCAPI: tiles/maps/coverage raster/vector experimental driver - TGA: read/only driver to read TGA image file format * New OGR drivers: ...

QGIS Desktop 3.22 User Guide

Raster and imagery formats supported by the installed GDAL (Geospatial Data ... or Embed Layers and Groups… from another project, as read-only copies...

Bug listing with status CONFIRMED as at 2022/12/20 18:46:38

... -s is slow with a lot of results" status:CONFIRMED resolution: severity: ... Bug:107081 - "new ebuild: fs2open (freespace 2 the source code...