Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add tutorial for fine-tuning BERT

See original GitHub issue

I would like to add tutorial on fine-tuning BERT in flax. Would you like to have that example in this library?

Issue Analytics

State:
Created 3 years ago
Comments:8 (3 by maintainers)

Top GitHub Comments

1reaction

marcvanzeecommented, Jul 8, 2021

Great! Closing this issue then, and looking forward to your PRs! 😄

1reaction

marcvanzeecommented, Mar 15, 2021

Awesome, we are aware of the HuggingFace implementation (we helped reviewing it and rewriting it to Linen), and I think it would be a great idea to use their version!

On Sun, Mar 14, 2021 at 10:24 PM Vasudev Gupta @.***> wrote:

Hi @marcvanzee https://github.com/marcvanzee, I’m glad you replied!

I am planning to fine-tune BERT in flax this week for diving deeper into flax. So, don’t have code now but will have by the end of next weekend. HuggingFace is having implementation of BERT https://github.com/huggingface/transformers/blob/master/src/transformers/models/bert/modeling_flax_bert.py in flax. So, I was thinking of picking it up for fine-tuning.

Even that would be great if you link my repository in flax examples. I will surely checkout HOWTO and share the link to the repository once done.

Thanks!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/google/flax/issues/1124#issuecomment-798982447, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABL7BBRQQCRI57GYV43Z6DTDUSPXANCNFSM4ZFAQESQ .

–

Marc van Zee

Top Results From Across the Web

BERT Fine-Tuning Tutorial with PyTorch - Chris McCormick

In this tutorial I'll show you how to use BERT with the huggingface PyTorch library to quickly and efficiently fine-tune a model to...

Tutorial: Fine-tuning BERT for Sentiment Analysis - by Skim AI

In this notebook I'll use the HuggingFace's transformers library to fine-tune pretrained BERT model for a classification task. Then I will compare the...

Fine-tuning a BERT model | Text - TensorFlow

This tutorial demonstrates how to fine-tune a Bidirectional Encoder Representations from Transformers (BERT) (Devlin et al., 2018) model ...

Fine-tune a pretrained model - Hugging Face

In this tutorial, you will fine-tune a pretrained model with a deep learning framework of your choice: Fine-tune a pretrained model with Transformers...

Fine-Tuning BERT for Text Classification

Fine-Tuning BERT for Text Classification. A step-by-step tutorial in Python. Pizzo Corno, Bergamo ...