question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

32bit test suite: pandas 1.3.3 "Buffer dtype mismatch"

See original GitHub issue

What happened:

When running the test suite in a 32-bit environment on the openSUSE buildservice, I get the following error

[  672s] =================================== FAILURES ===================================
[  672s] ______________________ test_categorical_set_index[tasks] _______________________
[  672s] [gw1] linux -- Python 3.9.7 /usr/bin/python3.9
[  672s] 
[  672s] shuffle = 'tasks'
[  672s] 
[  672s]     @pytest.mark.parametrize("shuffle", ["disk", "tasks"])
[  672s]     def test_categorical_set_index(shuffle):
[  672s]         df = pd.DataFrame({"x": [1, 2, 3, 4], "y": ["a", "b", "b", "c"]})
[  672s]         df["y"] = pd.Categorical(df["y"], categories=["a", "b", "c"], ordered=True)
[  672s]         a = dd.from_pandas(df, npartitions=2)
[  672s]     
[  672s]         with dask.config.set(scheduler="sync", shuffle=shuffle):
[  672s]             b = a.set_index("y", npartitions=a.npartitions)
[  672s]             d1, d2 = b.get_partition(0), b.get_partition(1)
[  672s] >           assert list(d1.index.compute()) == ["a"]
[  672s] 
[  672s] /usr/lib/python3.9/site-packages/dask/dataframe/tests/test_categorical.py:274: 
[  672s] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[  672s] /usr/lib/python3.9/site-packages/dask/base.py:288: in compute
[  672s]     (result,) = compute(self, traverse=False, **kwargs)
[  672s] /usr/lib/python3.9/site-packages/dask/base.py:570: in compute
[  672s]     results = schedule(dsk, keys, **kwargs)
[  672s] /usr/lib/python3.9/site-packages/dask/local.py:563: in get_sync
[  672s]     return get_async(
[  672s] /usr/lib/python3.9/site-packages/dask/local.py:506: in get_async
[  672s]     for key, res_info, failed in queue_get(queue).result():
[  672s] /usr/lib/python3.9/concurrent/futures/_base.py:438: in result
[  672s]     return self.__get_result()
[  672s] /usr/lib/python3.9/concurrent/futures/_base.py:390: in __get_result
[  672s]     raise self._exception
[  672s] /usr/lib/python3.9/site-packages/dask/local.py:548: in submit
[  672s]     fut.set_result(fn(*args, **kwargs))
[  672s] /usr/lib/python3.9/site-packages/dask/local.py:237: in batch_execute_tasks
[  672s]     return [execute_task(*a) for a in it]
[  672s] /usr/lib/python3.9/site-packages/dask/local.py:237: in <listcomp>
[  672s]     return [execute_task(*a) for a in it]
[  672s] /usr/lib/python3.9/site-packages/dask/local.py:228: in execute_task
[  672s]     result = pack_exception(e, dumps)
[  672s] /usr/lib/python3.9/site-packages/dask/local.py:223: in execute_task
[  672s]     result = _execute_task(task, data)
[  672s] /usr/lib/python3.9/site-packages/dask/core.py:121: in _execute_task
[  672s]     return func(*(_execute_task(a, cache) for a in args))
[  672s] /usr/lib/python3.9/site-packages/dask/dataframe/shuffle.py:861: in shuffle_group
[  672s]     return group_split_dispatch(df, c, k, ignore_index=ignore_index)
[  672s] /usr/lib/python3.9/site-packages/dask/utils.py:576: in __call__
[  672s]     return meth(arg, *args, **kwargs)
[  672s] /usr/lib/python3.9/site-packages/dask/dataframe/backends.py:358: in group_split_pandas
[  672s]     indexer, locations = pd._libs.algos.groupsort_indexer(
[  672s] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[  672s] 
[  672s] >   ???
[  672s] E   ValueError: Buffer dtype mismatch, expected 'const intp_t' but got 'long long'
[  672s] 
[  672s] pandas/_libs/algos.pyx:194: ValueError

If I didn’t overlook something, it is the same error for 187 tests:

[  681s] =========================== short test summary info ============================
[  681s] FAILED dataframe/tests/test_categorical.py::test_categorical_set_index[tasks]
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[False-False-1-1] - ...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[False-False-1-4] - ...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[False-False-3-1] - ...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[False-False-3-4] - ...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[False-True-1-1] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[False-True-1-4] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[False-True-3-1] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[False-True-3-4] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[True-False-1-1] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[True-False-1-4] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[True-False-3-1] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[True-False-3-4] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_value_counts_with_normalize - ...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[True-True-1-1] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_value_counts_with_normalize_and_dropna
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[True-True-1-4] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[True-True-3-1] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_series_map[True-True-3-4] - Va...
[  681s] FAILED dataframe/tests/test_groupby.py::test_groupby_reduction_split[split_out]
[  681s] FAILED dataframe/tests/test_groupby.py::test_groupby_apply_tasks - ValueError...
[  681s] FAILED dataframe/tests/test_groupby.py::test_groupby_split_out_multiindex[column0-2]
[  681s] FAILED dataframe/tests/test_groupby.py::test_groupby_split_out_multiindex[column0-3]
[  681s] FAILED dataframe/tests/test_groupby.py::test_groupby_split_out_multiindex[column1-2]
[  681s] FAILED dataframe/tests/test_groupby.py::test_groupby_split_out_multiindex[column1-3]
[  681s] FAILED dataframe/tests/test_groupby.py::test_groupby_split_out_multiindex[column2-2]
[  681s] FAILED dataframe/tests/test_groupby.py::test_groupby_split_out_multiindex[column2-3]
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[5-2-1] - ...
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[5-2-4] - ...
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[5-2-20]
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[5-5-1] - ...
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[5-5-4] - ...
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[5-5-20]
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[20-2-1]
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[20-2-4]
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[20-2-20]
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[20-5-1]
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[20-5-4]
[  681s] FAILED dataframe/tests/test_groupby.py::test_hash_groupby_aggregate[20-5-20]
[  681s] FAILED dataframe/tests/test_groupby.py::test_split_out_multi_column_groupby
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[idx-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[idx-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[idx-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[idx-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on1-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on1-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on1-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on1-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on2-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on2-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on2-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on2-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on3-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on3-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on3-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_unknown[on3-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[idx-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[idx-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[idx-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[idx-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on1-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on1-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on1-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on2-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on1-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on2-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on2-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on2-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on2-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on3-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on3-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on2-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on3-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on2-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on3-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on3-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_right[idx-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on3-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on3-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_right[on1-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_known[on3-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[idx-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[idx-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_right[on2-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[idx-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_right[on3-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[idx-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_left[idx-True-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on1-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on1-left]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_left[idx-0.75-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on1-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_left[on1-True-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on1-outer]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_left[on1-0.75-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_unknown_to_unknown[on2-inner]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_left[on2-True-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_left[on2-0.75-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_left[on3-True-right]
[  681s] FAILED dataframe/tests/test_merge_column_and_index.py::test_merge_known_to_double_bcast_left[on3-0.75-right]
[  681s] FAILED dataframe/tests/test_multi.py::test_hash_join[tasks-inner] - ValueErro...
[  681s] FAILED dataframe/tests/test_multi.py::test_hash_join[tasks-left] - ValueError...
[  681s] FAILED dataframe/tests/test_multi.py::test_hash_join[tasks-right] - ValueErro...
[  681s] FAILED dataframe/tests/test_multi.py::test_hash_join[tasks-outer] - ValueErro...
[  681s] FAILED dataframe/tests/test_multi.py::test_merge[tasks-inner] - ValueError: B...
[  681s] FAILED dataframe/tests/test_multi.py::test_merge[tasks-outer] - ValueError: B...
[  681s] FAILED dataframe/tests/test_multi.py::test_merge[tasks-left] - ValueError: Bu...
[  681s] FAILED dataframe/tests/test_multi.py::test_merge[tasks-right] - ValueError: B...
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_by_index_patterns[inner-tasks]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_by_index_patterns[outer-tasks]
[  681s] FAILED tests/test_distributed.py::test_fused_blockwise_dataframe_merge[True]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_by_index_patterns[left-tasks]
[  681s] FAILED tests/test_distributed.py::test_fused_blockwise_dataframe_merge[False]
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[5-2-1] - Val...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[5-2-4] - Val...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[5-2-20] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[5-5-1] - Val...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[5-5-4] - Val...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[5-5-20] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[20-2-1] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[20-2-4] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[20-2-20] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[20-5-1] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[20-5-4] - Va...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_hash_split_unique[20-5-20] - V...
[  681s] FAILED dataframe/tests/test_dataframe.py::test_split_out_drop_duplicates[None]
[  681s] FAILED dataframe/tests/test_dataframe.py::test_split_out_drop_duplicates[2]
[  681s] FAILED dataframe/tests/test_dataframe.py::test_split_out_value_counts[None]
[  681s] FAILED dataframe/tests/test_dataframe.py::test_split_out_value_counts[2] - Va...
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_by_index_patterns[right-tasks]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_by_multiple_columns[tasks-inner]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_by_multiple_columns[tasks-outer]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_by_multiple_columns[tasks-left]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_by_multiple_columns[tasks-right]
[  681s] FAILED tests/test_distributed.py::test_combo_of_layer_types - ValueError: Buf...
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_index_without_divisions[tasks]
[  681s] FAILED dataframe/tests/test_multi.py::test_half_indexed_dataframe_avoids_shuffle
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_tasks_large_to_small[lg-28-left]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_tasks_large_to_small[lg-28-right]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_tasks_large_to_small[lg-32-left]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_tasks_large_to_small[lg-32-right]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_tasks_large_to_small[sm-28-left]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_tasks_large_to_small[sm-28-right]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_tasks_large_to_small[sm-32-left]
[  681s] FAILED dataframe/tests/test_multi.py::test_merge_tasks_large_to_small[sm-32-right]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_shuffle[tasks] - ValueError: Buf...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_shuffle_npartitions_task - Value...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_shuffle_npartitions_lt_input_partitions_task
[  681s] FAILED dataframe/tests/test_shuffle.py::test_index_with_non_series[tasks] - V...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_index_with_dataframe[tasks] - Va...
[  681s] FAILED tests/test_distributed.py::test_shuffle_priority - ValueError: Buffer ...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_shuffle_from_one_partition_to_one_other[tasks]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_shuffle_empty_partitions[tasks]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_set_index_tasks[4] - ValueError:...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_set_index_tasks[7] - ValueError:...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_set_index_tasks[23] - ValueError...
[  681s] FAILED tests/test_distributed.py::test_map_partitions_df_input - ValueError: ...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_set_index_tasks_2[tasks] - Value...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_set_index_tasks_3[tasks] - Value...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_shuffle_sort[tasks] - ValueError...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_rearrange[threads-tasks] - Value...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_rearrange[processes-tasks] - Val...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_gh_2730 - ValueError: Buffer dty...
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-id-None]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-id-True]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-id-False]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-name-None]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-name-True]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-name-False]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-on2-None]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-on2-True]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-on2-False]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-on3-None]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-on3-True]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[None-on3-False]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-id-None]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-id-True]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-id-False]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-name-None]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-name-True]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-name-False]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-on2-None]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-on2-True]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-on2-False]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-on3-None]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-on3-True]
[  681s] FAILED dataframe/tests/test_shuffle.py::test_dataframe_shuffle_on_tasks_api[4-on3-False]
...
[  682s] = 187 failed, 7973 passed, 891 skipped, 119 xfailed, 8 xpassed, 4462 warnings, 5 rerun in 636.78s (0:10:36) =

Full buildlog: dask-test-i586_log.txt

pytest --pyargs dask -rfEs -n auto

Anything else we need to know?:

https://github.com/dask/dask/blob/7b661440e7a916b8a9b369cc24bd4180f8564e0b/dask/dataframe/backends.py#L356-L360

Environment:

  • Dask version: 2019.9.1
  • Python version: 3.9.7
  • Operating System: openSUSE Tumbleweed
  • Install method (conda, pip, source): source (rpm package)

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
TomAugspurgercommented, Sep 22, 2021
0reactions
mgornycommented, Mar 21, 2022

Could you submit the fixes as PRs, please?

Read more comments on GitHub >

github_iconTop Results From Across the Web

Spearman correlation is broken (dtype mismatch) on 32-bit ...
Calling the corr method of a DataFrame with method='spearman' produces a ValueError due to a buffer dtype mismatch on 32-bit platforms.
Read more >
What's new in 1.3.0 (July 2, 2021) - Pandas
Use pandas options or specify the dtype using dtype='string[pyarrow]' to allow the StringArray to be backed by a PyArrow array instead of a...
Read more >
Scikits-Learn RandomForrest trained on 64bit python wont ...
This occurs because the random forest code uses different types for indices on 32-bit and 64-bit machines. This can, unfortunately, only be fixed...
Read more >
Changelog - Dask documentation
Temporarily pin werkzeug in CI to avoid test suite hanging (GH#9325) James ... Fix “Buffer dtype mismatch” for pandas >= 1.3 on 32bit...
Read more >
pandas: powerful Python data analysis toolkit - Amazon S3
Warning: In pandas 0.17.0, the sub-package pandas.io.data will be ... with a category dtype would convert this to regular object-based Index ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found