question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

test: dask Backend specific xfailed tests

See original GitHub issue

This tracks tests xfailed only in the dask backend (i.e. not the pandas backend). This provides a good tracker of compatibility differences. In the codebase sections of not working code will be marked TODO - <reason keyword> - #2553.

Backend Specific Tests

Done? test file test name reason keyword GH Issue
test_datatypes test_series_to_ibis_literal ir.as_value_expr does not handle dd.Series as_value_expr
test_arrays test_array_collect_rolling_partitioned Windowing not implemented windowing
test_join test_join_with_non_trivial_key execute_materialized_join is broken execute_materialized_join
test_join test_join_with_non_trivial_key_project_table execute_materialized_join is broken execute_materialized_join
test_operations test_project_scope_does_not_override Windowing not implemented windowing
✔️ test_operations test_aggregation_group_by Aggregations not implemented aggregations
✔️ test_operations test_boolean_aggregation Aggregations not implemented aggregations
test_operations test_sort_by Sorting partially implemented sorting
test_operations test_complex_sort_by Sorting partially implemented sorting
✔️ test_operations test_weighted_average Grouping not implemented grouping
✔️ test_operations test_groupby_with_unnamed_arithmetic Grouping not implemented grouping
✔️ test_operations test_cast_on_group_by Grouping not implemented grouping
✔️ test_operations test_left_binary_op_gb Aggregations not implemented aggregations
✔️ test_structs test_struct_field_series_group_by_value Grouping not implemented grouping
test_timecontext test_context_adjustment_window Windowing not implemented windowing
test_timecontext test_setting_timecontext_in_scope Windowing not implemented windowing
test_timecontext test_context_adjustment_multi_window Windowing not implemented windowing
test_timecontext test_context_adjustment_window_groupby_id Windowing not implemented windowing
test_udf test_udaf_analytic_groupby Windowing not implemented windowing
test_udf test_udaf_window Windowing not implemented windowing
test_udf test_udaf_window_interval Windowing not implemented windowing
test_udf test_multiple_argument_udaf_window Windowing not implemented windowing
test_udf test_udaf_window_nan Windowing not implemented windowing
✔️ test_udf test_array_return_type_reduction_window Windowing not implemented windowing

Ibis/all tests

Done? test file test name reason keyword GH Issue
✔️ test_join test_join_project_left_table Pandas used in test pandas
✔️ test_generic test_isin Sorting not implemented sorting
✔️ test_generic test_notin Sorting not implemented sorting
✔️ test_union test_union Pandas used in test pandas
✔️ test_aggregations test_aggregate Aggregations not implemented / pandas in test aggregations
✔️ test_aggregations test_aggregate_grouped Aggregations not implemented / pandas in test aggregations
✔️ test_aggregations test_reduction_ops iloc used in test iloc
✔️ test_aggregations test_group_concat Aggregations not implemented / iloc in test aggregations
✔️ test_aggregations test_topk_op Sorting not implemented / pandas in test sorting
✔️ test_aggregations test_topk_filter_op Sorting not implemented / pandas in test sorting
✔️ test_string test_string_col_is_unicode pandas used in test body pandas
test_string test_string different dtypes returned dtype
test_string test_string Substring operations not implemented substring
✔️ test_temporal test_timestamp_truncate pandas used in test body pandas
✔️ test_temporal test_date_truncate pandas used in test body pandas
test_temporal test_integer_to_interval_timestamp Dask issues with DateOffset DateOffset https://github.com/dask/dask/issues/6958
test_temporal test_integer_to_interval_date Dask issues with DateOffset DateOffset https://github.com/dask/dask/issues/6958
✔️ test_temporal test_temporal_binop pandas used in test body pandas
✔️ test_temporal test_interval_add_cast_column pandas used in test body (sorting) pandas
✔️ test_temporal test_day_of_week_column_group_by pandas used in test body (sorting) pandas
test_temporal test_now_from_projection limit does not work limit
✔️ : test_vectorized_udf test_analytic_udf_mutate Windowing not implemented windowing
test_vectorized_udf test_analytic_udf_destruct Windowing not implemented windowing
test_vectorized_udf test_analytic_udf_destruct_overwrite Windowing not implemented windowing
test_vectorized_udf test_reduction_udf_destruct_window Windowing not implemented windowing

Notes

  • Many of the aggregation/grouping issues are interrelated (we often group before performing an aggregation)
  • AggContext has also not been implemented for the dask backend.
  • A large portion of the grouping issues are due to the fact that obj and grouper methods on Dask GroupBy structures

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:6 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
emilyreff7commented, May 18, 2021

A few additional tests were newly x-failed in the dask backend in this PR https://github.com/ibis-project/ibis/pull/2776/:

test file test name reason
test_vectorized_udf.py test_elementwise_udf_destruct Length mismatch
test_vectorized_udf.py test_elementwise_udf_overwrite_destruct Length mismatch
test_vectorized_udf.py test_elementwise_udf_overwrite_destruct_and_assign Length mismatch
test_vectorized_udf.py test_elementwise_udf_destruct_exact_once Length mismatch
test_vectorized_udf.py test_elementwise_udf_multiple_overwrite_destruct Length mismatch
1reaction
jrebackcommented, Dec 13, 2020

you can add checkboxes to the above table to make this easier once these are starting to get fixed

Read more comments on GitHub >

github_iconTop Results From Across the Web

Development Guidelines - Dask.distributed
This repository is part of the Dask projects. General development guidelines including where to ask for help, a layout of repositories, testing practices,...
Read more >
Changelog — Dask.distributed 2.11.0 documentation
Update UCX tests for new handshake step (GH#4036) jakirkham. Add test for informative errors in serialization cases (GH#4029) Matthew ...
Read more >
What's New - Xarray
Add documentation of specific BackendEntrypoints (PR7200). ... Ensure tests are not skipped in the py38-all-but-dask test environment (GH4509).
Read more >
kartothek.io.testing.read — kartothek 5.2.1.dev5+g1821ea5 ...
from kartothek.io.testing.read import * # noqa ``` Fixtures required to be implemented: ... Pass additional backend specific kwargs to the read function.
Read more >
whats-new.rst.txt - Xarray - PyData |
Fix a regression in the removal of duplicate backend entrypoints ... Ensure tests are not skipped in the ``py38-all-but-dask`` test environment ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found