Performance improvement?

Hello.

We are users of pathspec in some other project. I have a performance question.

For a long list of rules (dozens) matches large amount of files (hundreds of thousands) the match_file takes a long time. Is there any method to improve its performance? For example, using a big regex instead of multiple small ones.

[karajan1001]

For example, It would take 20μs for each file. And 2 seconds for 100k file. And if we use big regex and use if expression to skip the normalization in the UNIX system. It could be 100ms (maybe several hundred for Windows users). This could give great help to user experience in the interactive tools relied on path specification.

[excitoon]

Of course it is

On Fri, Sep 2, 2022, 7:20 PM Nicholas Bollweg @.***> wrote:

Is it worth adding an actual benchmark with e.g. pytest-benchmark https://pypi.org/project/pytest-benchmark/ or asv https://asv.readthedocs.io/en/stable/?

— Reply to this email directly, view it on GitHub https://github.com/cpburnz/python-pathspec/issues/38#issuecomment-1235688297, or unsubscribe https://github.com/notifications/unsubscribe-auth/AARGSB5QNTB6GVKOFGFC5O3V4ISMXANCNFSM4NPDKCWA . You are receiving this because you commented.Message ID: @.***>