Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
How to specify which layers to be trained during transfer learning (finetuning) the network
See original GitHub issue❓ How to specify which layers to be trained during transfer learning (finetuning) the network ❓
I would like to specify which layers (beside FC) should be fine-tuned during training on the custom dataset. I saw that there is C.MODEL.BACKBONE.FREEZE_AT parameter but I’m not sure if this is the only thing needed to be set in order for this to work.
Issue Analytics
- State:
- Created 3 years ago
- Comments:8
Top Results From Across the Web
Transfer learning & fine-tuning - Keras
Instantiate a base model and load pre-trained weights into it. Freeze all layers in the base model by setting trainable = False ....
Read more >Transfer learning and fine-tuning | TensorFlow Core
One way to increase performance even further is to train (or "fine-tune") the weights of the top layers of the pre-trained model alongside...
Read more >CNN Transfer Learning & Fine Tuning | by Victor Roman
With fine-tuning, we first change the last layer to match the classes in our dataset, as we have done before with transfer learning....
Read more >Transfer Learning in Keras with Computer Vision Models
In deep learning, transfer learning is a technique whereby a neural network model is first trained on a problem similar to the problem...
Read more >TRANSFER LEARNING AND FINE TUNING OF NEURAL ...
When we train our model from scratch we should decide the no of different layers and working with them by decreasing or increasing...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@chongruo @Jerryzcn Could you look at this question?
Initially, I used 1e-3 and the following problem appeared with freezing 3 segments (FREEZE_AT = 3). I reduced it to 3e-4 and the problem is still there. Do you have any other information on what can be the cause of the problem?