Is there a way to put Elmo as a Keras layer and integrate it into a Keras model?

I used my own corpus to trained Elmo provided here. I wonder if there is a way to put Elmo as a Keras layer and integrate it into a Keras model. If yes, could you please provide an example just like usage_character.py? Thank you very much.

[nreimers]

I added some examples here: https://github.com/UKPLab/elmo-bilstm-cnn-crf https://github.com/UKPLab/elmo-bilstm-cnn-crf/blob/master/Keras_ELMo_Tutorial.ipynb

There I used ELMo to train a Keras network (for sentence classification and sequence tagging).

In my first experiments I had the ELMo layer as a trainable embedding layer. However, this produces computationally quite a large overhead, because the ELMo embeddings must be computed each time. Computing the embeddings once and fixing them gave a big performance boost (at training time) without reducing the performance.

[jacobzweig]

Hi - just a small note that I’ve updated the example in https://github.com/strongio/keras-elmo/blob/master/Elmo Keras.ipynb to allow trainable weights. Hope that helps 😃