Question about DataPre.py

Hi, @iyuge2 Thank you for your contribution to this project. I downloaded the data from the address you provided and ran it. It did achieve the same result as result-stat.

Then I download SIMS|MOSI|MOSEI raw data and use DatePre.py to generate features.pkl. But the processed data cannot be used for run.py.

Let’s take MOSI as an example(I download the raw data and use DataPre.py to process):

1. The file you provided are aligned_50.pkl(367.3MB) and unaligned_50.pkl(554.2MB).
2. I use DatePre.py to generate *.pkl for the MOSI dataset. Got features.pkl 2.8G, which is really bigger than your *.pkl.

Then I use features.pkl to run, but it failed…😭

Failure situation:

Error of 'list' object has no attribute 'astype'.

Then I change https://github.com/thuiar/MMSA/blob/b2e70bbd198ba8e8dc041f5e059c3baa2027b34a/data/load_data.py#L37-L39

to

self.labels = {
       'M': np.array(data[self.mode][self.args.train_mode+'_labels'], dtype=np.float32)
 }

But it didn’t work, we will get a new error of : RuntimeError: cublas runtime error : resource allocation failed at /opt/conda/conda-bld/pytorch_1565272279342/work/aten/src/THC/THCGeneral.cpp:216 There must be a problem with the DataPre.py generate data. I really don’t know how to solve it.

For the DataPre.py file, I only modified the path so that the data can be found for processing, and I have not changed other places. @iyuge2 Please help me…

[leijue222]

I have succeeded with your previous version. If I apply the old version that ran successfully to the current version, it still fails. Or conversely, applying the new version of MISA to the old one is also a failure. And the error message is the same: RuntimeError: cublas runtime error : resource allocation failed at /opt/conda/conda-bld/pytorch_1565272279342/work/aten/src/THC/THCGeneral.cpp:216

[leijue222]

This issue has too much redundant information, I put the simplified content after debugging in issue#23.