error related to `verify_determinism()` function

i’m trying to replay the raw vr recording with safe_replay_demo despite the bounch of warning for loading material

Warning[examples/SharedMemory/plugins/tinyRendererPlugin/TinyRendererVisualShapeConverter.cpp,558]:
issue extracting mesh from COLLADA/STL file

I found it’s always impossiable to pass the verify_determinism() function, the object list never match in original_file["physics_data"] and new_file["physics_data"].

For instance, the replay of cleaning_windows_0_Rs_int_0_2021-05-23_23-11-46.hdf5 will yield two different set of objects:

new_file['physics_data'].keys()
Out[3]: <KeysViewHDF5 ['1', '100', '119', '120', '121', '122', '123', '194', '58', '59', '8', '90']>
original_file["physics_data"].keys()
Out[4]: <KeysViewHDF5 ['1', '194', '45', '46', '59', '60', '62', '63', '64', '65', '66', '8']>

Not sure if they are related, please let me know if you need more info.

[jing-bi]

I generated a video so maybe it’s easier to see what’s wrong

this is a replay for cleaning_windows_0_Rs_int_0_2021-05-23_23-11-46_episode

https://user-images.githubusercontent.com/34174970/151209286-d1f80219-74b0-497f-8b7c-178d00f16b80.mp4

left is the original one downloaded from the BEHAVIOR website, the right is the replayed one.

To me looks like the agent is misplaced somehow

[jing-bi]

btw, at commit fe9e80b, the behavior replay is compatible with the refactored environment, but I’m still struggling to replicate the result.