Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Loss: Nan
See original GitHub issue用的是SynthText数据集，训练时出现：
RankWarning: Polyfit may be poorly conditioned
edge = fit_line([p0[0], p1[0]], [p0[1], p1[1]])
上面的警告不影响训练，训练一段时间后loss出现Nan值。我并没有执行build.sh这个程序，因为学校集群环境中没有NVCC。看其他问题中提到好像也不需要编译它。 希望问题能得到解决。
Issue Analytics
- State:
- Created 4 years ago
- Comments:8
Top Results From Across the Web
Deep-Learning Nan loss reasons - python - Stack Overflow
You may have an issue with the input data. Try calling assert not np.any(np.isnan(x)) on the input data to make sure you are...
Read more >Getting NaN for loss - General Discussion - TensorFlow Forum
Hi! The problem is not in the concatenation layer but in how you normalize the input data and how you pass it to...
Read more >Common Causes of NANs During Training
Common Causes of NANs During Training · Gradient blow up · Bad learning rate policy and params · Faulty Loss function · Faulty...
Read more >Debugging a Machine Learning model written in TensorFlow ...
“NaN loss during training.” If there is anything that will strike terror into the hearts of a ML practitioner, it's NaN losses.
Read more >Keras Sequential model returns loss 'nan'
I'm implementing a neural network with Keras, but the Sequential model returns nan as loss value. I have sigmoid activation function in the ......
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
问题太久了,大概是因为ctc引起的问题,google一下ctc引起loss nan的问题,应该很好找到答案.这个项目我没有继续做下去,最终效果我也没有呈现.所以,我准备关闭问题了,也不要加我微信了,谢谢.