Updating examples/nlp_seq

See original GitHub issue

This issue tracks updates the nlp_seq example to follow practices outlined in #231.

Port to linen API - once ported all subsequent changes should be done in linen_examples/nlp_seq
Update README.md (links to paper, command line, TensorBoard metrics)
Add requirements.txt
Update file structure (separate main.py, configs/ directory)
Use ml_collections.ConfigDict
Add benchmark test (optional)
Add unit test
Add Colab (optional)
Adhere to Google Python style
Shorten/beautify training loop (consider using clu for this)

Issue Analytics

State:
Created 3 years ago
Comments:6 (2 by maintainers)

Top GitHub Comments

1reaction

bohnetbdcommented, Sep 13, 2021

Cool. Sounds good to me. Personally, I would recommend to take on one task at a time 😃 so it is easier to review.

0reactions

andsteingcommented, Sep 20, 2021

One task at a time LGTM.

When doing non-trivial changes (e.g. updating to Optax), thanks for adding links to before/after metrics like in #1476

Top Results From Across the Web

Sequence-to-sequence Models - Stanford NLP Group

Attention summarizes the encoder, focusing on specific parts/words. In this example, since “Jiri” means “use”, the attention will focus on the vectors.

How to Develop a Seq2Seq Model for Neural Machine ...

In this post, you will discover how to define an encoder-decoder sequence-to-sequence prediction model for machine translation, as described by ...

Machine Translation With Sequence To Sequence Models ...

In this article, you will learn how to create a machine translator using NLP with the Keras TensorFlow framework using a recurrent neural...

Understanding Encoder-Decoder Sequence to Sequence Model

In this article, I will try to give a short and concise explanation of the sequence to sequence model which have recently achieved...

Character-level recurrent sequence-to-sequence model - Keras

This example demonstrates how to implement a basic character-level recurrent sequence-to-sequence model. We apply it to translating short ...