Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

sentencepiece==0.1.92 causing segmentation fault

See original GitHub issue

🐛 Bug

Information

transformers==2.9.1 torch==1.4.0

Starting from today, I notice newly released sentencepiece==0.1.92 causing segmentation fault while calling torch functions. Downgrade to sentencepiece==0.1.91 solve it.

Issue Analytics

State:
Created 3 years ago
Reactions:89
Comments:12 (2 by maintainers)

Top GitHub Comments

4reactions

zhjunqincommented, Oct 26, 2020

same problem when use sentencepiece==0.1.94

3reactions

thomwolfcommented, Nov 4, 2020

Cf #8199 we will remove the hard dependency on sentencepiece (replaced by the tokenizers library) in a coming release, probably end of next week.

Top Results From Across the Web

1 - Stack Overflow

git has hooks (git help githooks) and apparently your pre-commit hook triggers a segfault. Do you need more guidance about hooks ?

解决import ltp 出现core dumped的问题_hampeter的博客

经过查找，sentencepiece==0.1.92 causing segmentation fault #4857，知道了sentencepiece版本太高了，回退一个版本问题就解决了。...

sentencepiece 0.1.83 - PyPI

Usage. See this google colab page to run sentencepiece interactively. Segmentation. % python >>> import sentencepiece as spm >>> sp ...

Core dumped when training, no error messages

Any idea what could be causing this? Thread 32 "python" received signal SIGSEGV, Segmentation fault. [Switching to Thread 0x7ffe40a80700 ...

Unable to start training process Segmentation fault (core ...

Hi, I am trying to start training proccess on latest DeepSpeech release, but getting seg fault every time. my flags CUDA_VISIBLE_DEVICES=2 python3 -u ......