question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Really slow on large datasets

See original GitHub issue

Hi there, so i am trying out django-reversion==1.8.7 + django 1.7 in my admin on a table that has about 300.000 records and its really slow when i click on recover deleted which i am assuming it will call get_deleted method.

I am using it on my development machine (vagrant) with 1 core and 4 GB RAM. Is there anything i can do to make this work? Is this supposed to work well for these many datasets?

Thanks

Issue Analytics

  • State:closed
  • Created 8 years ago
  • Comments:16 (9 by maintainers)

github_iconTop GitHub Comments

1reaction
etianencommented, Nov 20, 2017

I’m fighting deadlines at the moment, but a reversion release can be done next week.

On 16 November 2017 at 10:06, James Malone notifications@github.com wrote:

This is great and critical fix - will you be releasing this as an official ‘release’ any time soon? Thanks, JM

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/etianen/django-reversion/issues/439#issuecomment-344875332, or mute the thread https://github.com/notifications/unsubscribe-auth/AAJFCCxRCGxEqsC8UaTy1kbMg1TjsbVwks5s3AkRgaJpZM4FjZoO .

1reaction
etianencommented, Sep 14, 2017

Wow, that’s excellent!

That query has been slow for the entire history of django-reversion, and I couldn’t think of any way to improve it. You’ve done the world a fine service! 😄

On 14 September 2017 at 14:09, Alexey Paramonov notifications@github.com wrote:

Works blazing fast now, checked and confirmed.

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/etianen/django-reversion/issues/439#issuecomment-329476461, or mute the thread https://github.com/notifications/unsubscribe-auth/AAJFCDUiLTLj-AbqqgF2JQ-7WTuwRaI9ks5siSVzgaJpZM4FjZoO .

Read more comments on GitHub >

github_iconTop Results From Across the Web

Very slow data loading on large dataset · Issue #546 - GitHub
I made a simple python script to check the NLP library speed, which loads 1.1 TB of textual data. It has been 8...
Read more >
Speed in large datasets - Forums - IBM Support
I am working on a dataset of about 10.000.000 records, and getting a simple frequency analysis or sorting a file can take several...
Read more >
R running very slowly after loading large datasets > 8GB
The problem arises because R loads the full dataset into the RAM which mostly brings the system to a halt when you try...
Read more >
Why are pandas slow for large datasets? - Quora
There are many reasons why pandas is slow on large datasets. Be it inherent issues with large datasets, or some that are more...
Read more >
Code performance in R: Working with large datasets
Some computations will not only become very slow, but even impossible for large datasets, for example, due to working memory.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found