question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

QST: Trouble reading a large ESRI geodatabase

See original GitHub issue

I am trying to read a large ESRI File geodatabase. I know that geopandas can read the particular layer I’m interested in because it successfully loads the other layers in the File Geodatabase with no issues.

However this layer is a large polygon layer containing all building footprints for a major European country. The .read_file method takes extremely long to execute.

How can I reduce the amount of time it takes to read this dataset so that I can perform further analysis on it?

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
jorisvandenbosschecommented, Oct 15, 2020

Yeah, so you already discovered that option! 😉 (closing this issue then)

1reaction
jorisvandenbosschecommented, Oct 15, 2020

@awa5114 using geopandas, you could also try to read only a subset of the data at a time, if that is possible for your use case. See the docs here about the multiple options for this: https://geopandas.readthedocs.io/en/latest/docs/user_guide/io.html#reading-subsets-of-the-data

Read more comments on GitHub >

github_iconTop Results From Across the Web

Troubleshooting Performance Issues with Enterprise ... - Esri
Troubleshooting Enterprise Geodatabase Performance ... Example 2: Application Generating too much SQL (load) – the Angry DBA.
Read more >
Troubleshooting Performance Issues with Enterprise ... - Esri
Performance issues random, varied by workflow and data used. • Enterprise geodatabase and application 15+ years old. - upgraded in-place through multiple ArcGIS...
Read more >
Loading large volumes of raster data into a geodatabase
In ArcCatalog right click on the raster catalog and select load and load data... from the menu. Page 55. 54. Insert operations. •...
Read more >
Problem: Unable to export a large hosted feature service with ...
Solution or Workaround · Launch ArcGIS Pro, and sign in to ArcGIS Online. · Add the hosted feature service to the map. ·...
Read more >
ArcGIS Pro is unusable with large SDE geodatabases
Solved: We have ArcGIS Pro 2.0, and we are trying to connect to our main SDE geodatabase, but it's painfully slow, to the...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found