ParserError: Error tokenizing data. C error: Calling read(nbytes) on source failed. Try engine='python'.

I read a 16 GB CSV file with pandas. It used to work well, but recently I started hitting this error: ParserError: Error tokenizing data. C error: Calling read(nbytes) on source failed. Try engine='python'. I tried waiting a few days in case it’s a limit of some sort, but it didn’t help. I keep hitting this error.

It used to work well before (the file is read and processed, no issues), so I would expect it to work the same way, as nothing has changed in the code nor in the file.

Is it because of the file size? Am I now hitting some limits or what? What are the limits, if so? Or could the file get corrupted by Google Drive? Some more detailed information would be great.

My browser is: Chrome 81.0.4044.122 (Official Build) (64-bit)

[craigcitro]

There’s nothing colab-specific here: that error is coming from the library you’re using (I’m guessing pandas?).

I’d try asking on stack overflow.

[chekoduadarsh]

Use the following command to solve the issue if you are using pandas on google colab

df.read_csv('file.csv', encoding='utf8', engine='python')