Punctuations getting removed

Hello. Great work!

For inputs with punctuations, There are many novel, innovaive, and empirical anayysis availaible. we get outputs like there are many novel innovative and empirical analysis available. Is it possible to keep the punctuations?

[duhaime]

It’s a shame this is closed–keeping punctuation is pretty vital to the integrity of language…

[alvesman]

My phrase spell checker preserving punctuation: ` import re word_split = re.compile(r"[^\W]+", re.U)

def spell_corrected(term): suggestions = sym_spell.lookup_compound( term, max_edit_distance=2, # The maximum edit distance between input and suggested words. ignore_non_words=True, # numbers and acronyms are left alone split_phrase_by_space=True, # otherwise hyphen words will be split https://github.com/wolfgarbe/SymSpell/issues/85 ignore_term_with_digits=True # any term with digits is left alone )

corrected = suggestions[0].term
# This combined with split_phrase_by_space=True would be enough just to spell check
# but punctuation is lost.

# The spell check is already done in 'corrected'. Now we just want to keep the punctuation.
in_list = word_split.findall(term)
chk_list = word_split.findall(corrected)

# To keep punctuation we take the original phrase and do word by word replacement
out_term = term
word_count = 0
for word in in_list:
    out_term = out_term.replace(word, chk_list[word_count])
    word_count += 1

return out_term

`