Stop auto-correcting Numbers and special characters

Hi again,

If I have the following string: The support is 24/7, awesome!

It removes 24/7. Is there a way to avoid deleting numbers and other special characters such as"$£" etc.?

[mammothb]

I am able to preserve the number by using Python’s raw string notation for regular expression patterns, i.e.,

ignore_token=r"\d{2}\w*\b|\d+\W+\d+\b|\d\w*\b|[!@£#$%^&*();,.?:{}/|<>]"

instead of

ignore_token="\d{2}\w*\b|\d+\W+\d+\b|\d\w*\b|[!@£#$%^&*();,.?:{}/|<>]"

I think your backslashes \ were treated as escape characters since you did not use raw string notation.

[mammothb]

6 mths converted to 6mths because 6 matches \d\w*\b and is ignored. Then when two words are joined together to look for a possibly correct word (part of word_segmentation algorithm), 6mths matches \d\w*\b as well and is ignored.

solv is corrected sold instead of solve because the frequency of sold (42979181) is higher than that of solve (13452150) in the provided frequency dictionary.

I is correct to a while i is preserved because i is an exact match of i (gets returned as a result immediately) while I is not an exact match of i (different case) so it is corrected based the rest of the lookup algorithm and a (9081174698) has higher frequency than that of i (3086225277).

You could try to apply lower() to your input to prevent I from being corrected to a.