ValueError: could not broadcast input array from shape (4,) into shape (1,)

Thanks for the very interesting paper and code. I’m trying to train adapet on custom data (in Google Colab). I’ve prepared the data in the format as indicated in the documentation. my task is a binary sentiment classification task “positive” vs. “negative”.

!python cli.py --data_dir data/sentiment-news-econ \
               --pattern 'The quote: "[TEXT1]". The quote is overall [LBL]' \
               --dict_verbalizer '{"positive": "verbalizer_1", "negative": "verbalizer_2"}'

I get the following error:

Traceback (most recent call last):
  File "cli.py", line 54, in <module>
    train(config)
  File "/content/drive/MyDrive/Colab Notebooks/Few-shot-experiments/ADAPET/src/train.py", line 93, in train
    loss, dict_val_update = model(sup_batch)
  File "/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py", line 550, in __call__
    result = self.forward(*input, **kwargs)
  File "/content/drive/MyDrive/Colab Notebooks/Few-shot-experiments/ADAPET/src/adapet.py", line 213, in forward
    pet_disc_loss = self.get_decoupled_label_loss(batch)
  File "/content/drive/MyDrive/Colab Notebooks/Few-shot-experiments/ADAPET/src/adapet.py", line 178, in get_decoupled_label_loss
    lbl_logits = self.get_single_logits(pet_mask_ids, mask_idx, list_lbl) # [bs, num_lbl]
  File "/content/drive/MyDrive/Colab Notebooks/Few-shot-experiments/ADAPET/src/adapet.py", line 70, in get_single_logits
    lbl_ids[i, :len(i_lbl_ids)] = i_lbl_ids
ValueError: could not broadcast input array from shape (4,) into shape (1,)

The error seems to come from the following part in the source code. Where the token IDs for the labels are retrieved. https://github.com/rrmenon10/ADAPET/blob/6d2bfef5405ca53112235021d9fb8b36f641be9d/src/adapet.py#L70

I couldn’t figure out what it causing it though 😕

[MoritzLaurer]

ah no, my line 72 is return self.config.max_num_lbl (without _tok) I’ll try manually deleting the cloned directory and reinstalling, maybe that fixes it

—update: after manually deleting and reinstalling on my google drive, it seems to be working now, thank you!

[amith-ananthram]

(and congrats on the very cool work!)