To little RAM in Graph Processing leads to weird Exception in LocationIndex
See original GitHub issueI’ve been playing around with GH for a while now and everything worked fine so far, until I tried building the latest and greatest all new and shiny graph of all of Europe with my little 16 GB machine (Mac OS) with 14Gb allocated for the JVM, when it was throwing the following error
2017-06-07 13:42:10,958 [main] INFO com.graphhopper.reader.osm.GraphHopperOSM - edges: 69505872, nodes 54314626, there were 2119927 subnetworks. removed them => 2119847 less nodes
Exception in thread "main" java.lang.IllegalStateException: location index was opened with incorrect graph: 54314817 vs. 54314626
at com.graphhopper.storage.index.LocationIndexTree.loadExisting(LocationIndexTree.java:265)
at com.graphhopper.GraphHopper.createLocationIndex(GraphHopper.java:1134)
at com.graphhopper.GraphHopper.initLocationIndex(GraphHopper.java:1149)
at com.graphhopper.GraphHopper.postProcessing(GraphHopper.java:842)
at com.graphhopper.GraphHopper.process(GraphHopper.java:650)
at com.graphhopper.GraphHopper.importOrLoad(GraphHopper.java:619)
at com.graphhopper.tools.Import.main(Import.java:31)
The error is included in GH versions 0.82 and 0.9. It did not appear when I ran the whole process on a 64GB Ubuntu 16.04. Server on which it was using more then 26GB.
Issue Analytics
- State:
- Created 6 years ago
- Comments:13 (13 by maintainers)
Top Results From Across the Web
breadth-first-search on huge graph with little ram
I currently have a graph that has about 10 million nodes and 35 million edges. For now the complete graph is loaded into...
Read more >Check if your Mac needs more RAM in Activity Monitor
In the Activity Monitor app on your Mac, click Memory (or use the Touch Bar). The Memory Pressure graph lets you know if...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
I’ll try tomorrow.
Mit besten Physiker-Grüßen
No problem. Probably we should make the removal atomic.