--commands_to_delete hangs forever

Here’s a minimal example. If my source file includes:

\todo1{
\begin{figure}
\caption{\todo2{\emph{problem}}}
\end{figure}
}

When running:

python3.8 -m arxiv_latex_cleaner --commands_to_delete todo1 todo2 --verbose sources

It seems to hang forever on the above file. In my attempts, removing any of the todo1, todo2, figure, or emph seems to make the problem go away…

[bradknox]

I did a pseudo-binary search to find the problematic command and manually removed it.

I played around with just that command, trying to find a minimal example. I found that this version allows arxiv_latex_cleaner to complete but slows it down by 10x or so:

\test{Alternative: $\Psi \{\psi_{\pi_{SF}}\}$}

And this version does appear to make it hang indefinitely: \test{Alternative: $\Psi \cup \{\psi_{\pi_{SF}}\}$}

I’m running python3 -m arxiv_latex_cleaner <folder_name> --commands_to_delete test with Python 3.8.2.

[jponttuset]

Thanks so much @joellindegger for the investigation! Adding regex is perfectly fine, it’d be great if you could send a PR.