question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

slow on large files?

See original GitHub issue

E.g. this (3300 line) file takes yapf over 10 minutes https://github.com/pydata/pandas/blob/master/pandas/tseries/tests/test_offsets.py.

 % time yapf --diff pandas/tseries/tests/test_offsets.py > /dev/null
yapf --diff pandas/tseries/tests/test_offsets.py > /dev/null  712.20s user 5.37s system 84% cpu 14:04.86 total
 % time autopep8 --diff pandas/tseries/tests/test_offsets.py > /dev/null
autopep8 --diff pandas/tseries/tests/test_offsets.py > /dev/null  13.46s user 0.33s system 85% cpu 16.191 total

(related: #39 ?)

Issue Analytics

  • State:open
  • Created 8 years ago
  • Reactions:2
  • Comments:8 (6 by maintainers)

github_iconTop GitHub Comments

5reactions
garymmcommented, May 6, 2019

I still find YAPF to be terribly slow on large files.

2reactions
sebastien-rossetcommented, Apr 9, 2020

I have done a comparison of yapf versus black for a large python file which is generated by the OpenAPITools code generator.

  • time yapf -i iam_api.py completes in 1m50.350s
  • time black iam_api.py completes in 0.786s
  • time black --fast iam_api.py completes in 0m0.641s

So yapf is about 139 slower compared to black for that particular file.

Read more comments on GitHub >

github_iconTop Results From Across the Web

What causes the slow transfer of large files? How to solve this ...
1) Large Amount of Data · 2) Low Transfer Efficiency · 3) High Risk · 1) Improve the work efficiency via a large...
Read more >
Large file transfers are slow over internal (Local) networks ...
Large file transfers are slow over internal (Local) networks. How can I speed up large file (500 k and larger) transfers in Microsoft...
Read more >
How to Transfer Large Files over Slow Network Connections
5 Steps to Transfer Large Files over Slow Network · Test your Internet speed. · If not - get into the usual slow...
Read more >
Slow Large File Copy Issues - Microsoft Community Hub
By "performance problems", they mean that the file isn't copying as fast as they expect. The most common scenario is copying large SQL...
Read more >
Large file copying speed. Why does it slow down?
When I copy a file about 2TB in size from 1 disk to another the speed starts of fast say 185MBps and then...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found