QA Documentation: I got error just copy and pasting documentation

Environment info

• transformers version: 4.3.1
• Platform:Manjaro Linux
• Python version: 1.5.1
• PyTorch version (GPU?): Yes
• Using GPU in script?: Yes
• Using distributed or parallel set-up in script?: No

Who can help

@sgugger

Information

I am trying the to train a QA model following the huggingface documentation, I just copied and pasted the code in my machine (and in Colab) but I was not able to proceed in the training phase because I got None value.

To reproduce

Steps to reproduce the behavior:

1. Go to the documentation: https://huggingface.co/transformers/custom_datasets.html at Squad training section
2. Copy and paste the code as you can see from my pastebin: https://pastebin.com/hZvq7Zs7
3. And you got the following error File "/home/andrea/PycharmProjects/qa-srl/test.py", line 78, in __getitem__ return {key: torch.tensor(val[idx]) for key, val in self.encodings.items()} RuntimeError: Could not infer dtype of NoneType
4. My naive solution was modifying the getitem method from the SquadDataset class in order to avoid to serve the val[idx] == None

[andreabac3]

Thank you @joeddav the posted code works perfectly.

[andreabac3]

Sorry for bothering you @joeddav again, I have a question related to the code posted by you here. I am still getting None with the dataset built by myself using this code. My dataset works perfectly with the run_squad original script. In this snipped posted by you I encounter None in the vector of end_positions and I don’t know how fix it. I saw the condition in which there’s a None the start_positions but what I have to do in the case the None is only in the end_positions vector?

Kind regards, Andrea