question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Succeed to train THCHS30 in Chinese mandarin!

See original GitHub issue

Hi all. I have good news that I have succeeded to train THCHS30 in Chinese mandarin. The code is open on my repo with just a little modification against the master branch. In this repo I used pinyin phoneme as symbols and the evaluation input are also sentences in Chinese pinyin. Since the number of Chinese characters are enormous, we can use pypinyin to translate into finite English symbols plus number 12345 as tone of voice. It produces good effect in 90K steps. The evaluation audio are here: eval_audio_92k.zip And the pre-trained model is here. And the align graph seems to be very good. step-92000-align However, the dataset THCHS30 is with multi-speakers so that there are some problems in some evaluation by chance like silence. So I still need to find some better mandarin dataset with single speaker and long hours enough for training. In all, this tacotron project is very good for me, thanks a lot.

Issue Analytics

  • State:closed
  • Created 6 years ago
  • Reactions:33
  • Comments:180 (1 by maintainers)

github_iconTop GitHub Comments

2reactions
konghuanhuancommented, Feb 19, 2019

@zhuyiif 问题解决了吗?

这个branch 我跑不起来,能帮忙看看是什么原因吗? NotFoundError (see above for traceback): Restoring from checkpoint failed. This is most likely due to a Variable name or other graph key that is missing from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

Key model/inference/decoder/Location_Sensitive_Attention/attention_bias not found in checkpoint [[{{node save/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, …, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device=“/job:localhost/replica:0/task:0/device:CPU:0”](_arg_save/Const_0_0, save/RestoreV2/tensor_names, save/RestoreV2/shape_and_slices)]]

2reactions
begeekmyfriendcommented, Apr 9, 2018

Hi all, I am sorry maybe I was wrong. The modification of hyper parameters such as mel fbank does not help improve but impair the result of evaluation. Therefore I have changed it back into 80. Apologize for my mistakes. See my latest commit https://github.com/begeekmyfriend/tacotron/commit/cbc2b877e2674a1271ab226d03ba3de64f69a65e

Read more comments on GitHub >

github_iconTop Results From Across the Web

THCHS-30 : A Free Chinese Speech Corpus
The training text involves 772, 000 sentences, amounting to. 18 million words and 115 million Chinese characters. The phone LM was trained using...
Read more >
THCHS-30 : A Free Chinese Speech Corpus - arXiv
The training text involves. 772, 000 sentences, amounting to 18 million words and. 115 million Chinese characters. The phone LM was trained ...
Read more >
THCHS-30 : A Free Chinese Speech Corpus - ResearchGate
In this paper, we follow this trend and release a free Chinese speech database THCHS-30 that can be used to build a full-...
Read more >
Training Chinese model - DeepSpeech - Mozilla Discourse
I have used the deepspeech code to train the Chinese model for some time. ... And to train the language model, the data...
Read more >
Modeling Attention and Memory for Auditory Selection in a ...
training phase, meanwhile a speech perceptor is trained to extract the temporal acoustic feature ... proach on WSJ0 and THCHS-30 datasets and the...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found