For I'm, it's, I'll, you're, I've, I'd

>>> g2p('It\'s')
['IH1', 'T', ' ', 'EH1', 'S'] # Should be ['IH1', 'T', ' ', 'S']
>>> g2p('I\'m')
['AY1', ' ', 'AH0', 'M'] # Should be ['AY1', ' ', 'M']

's
S
Z
'll
L
've
V
'd
D
're
R
't
T
'm
M

[Kyubyong]

You’re right. I’ve corrected by changing the word tokenizer from nltk.word_tokenize to TweetTokenizer. Try again. Thanks!

[begeekmyfriend]

Hi, another tiny problem. The new TweetTokenizer cannot distinguish punctuation and abbreviation as follows. The original tokenizer seems good for it.

>>> from g2p_en import G2p
>>> g2p = G2p()
>>> ''.join(g2p('8 p.m.'))
'EY1T PIY1 . EH1M .'