layer and attention are empty.

I’m using colab but it doesn’t work. Help.

%%javascript require.config({ paths: { d3: ‘//cdnjs.cloudflare.com/ajax/libs/d3/3.4.8/d3.min’, jquery: ‘//ajax.googleapis.com/ajax/libs/jquery/2.0.0/jquery.min’, } });

def` show_head_view(model, tokenizer, sentence_a, sentence_b=None):

inputs = tokenizer.encode_plus(sentence_a, sentence_b, return_tensors='pt', 

add_special_tokens=True)

input_ids = inputs['input_ids']
if sentence_b:
    token_type_ids = inputs['token_type_ids']
    attention = model(input_ids, token_type_ids=token_type_ids)[-1]
    sentence_b_start = token_type_ids[0].tolist().index(1)
else:
    attention = model(input_ids)[-1]
    sentence_b_start = None
input_id_list = input_ids[0].tolist() # Batch index 0
tokens = tokenizer.convert_ids_to_tokens(input_id_list)    
head_view(attention, tokens, sentence_b_start)

model_version = ‘bert-base-uncased’ do_lower_case = True

model = BertModel.from_pretrained(model_version, output_attentions=True) tokenizer = BertTokenizer.from_pretrained(model_version, do_lower_case=do_lower_case)

sentence_a = “the cat sat on the mat” sentence_b = “the cat lay on the rug”

show_head_view(model, tokenizer, sentence_a, sentence_b)

[gogokre]

Hi, Did you solve this problem already? I just resolved this If you clone this to your local and use the Jupter Notebook by Anaconda and run this code. It will be fine. Hope that helps you

Thank you very much. As you mentioned, I succeeded using Jupter Notebook.

[WenTingTseng]

Hi, Did you solve this problem already? I just resolved this If you clone this to your local and use the Jupter Notebook by Anaconda and run this code. It will be fine. Hope that helps you