Reduce refresh_queries's memory usage
See original GitHub issuerefresh_queries
looks up all outdated queries and then schedules refresh tasks for each. The lookup can take a while and consume a lot of memory. We could probably do this in batches or yield for each outdated query.
Issue Analytics
- State:
- Created 4 years ago
- Comments:5 (5 by maintainers)
Top Results From Across the Web
Excel - Power queries eating up all RAM and taking ages to load
The file takes ages to load (I set up all data connections with Refresh data when opening the file checked), with 10-11 GBs...
Read more >Power Query for Excel: Load Settings Minimize Wasted Memory
To change the Default Query Load Settings, choose Options from the Machine Settings section of the Power Query ribbon or in the File...
Read more >Very high memory consumption on refresh
HI, I have very high memory consumption when I load from Power Query to PBI Desktop or when I'm doing plain refresh. My...
Read more >Performance Tip for Power BI; Enable Load Sucks Memory Up
The best approach is to disable loading before closing query editor. Disabling Load doesn't mean the query won't be refreshed, it only means...
Read more >Tuning for Refresh - Vertica
Set MEMORYSIZE in the REFRESH pool to a fixed value. The Resource Manager then tunes the refresh query to only use this amount...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Seems like it might be as simple as calling
yield_per
on the SQLA query object.👍