test: dask Backend specific xfailed tests
See original GitHub issueThis tracks tests xfailed only in the dask backend (i.e. not the pandas backend). This provides a good tracker of compatibility differences. In the codebase sections of not working code will be marked TODO - <reason keyword> - #2553
.
Backend Specific Tests
Done? | test file | test name | reason | keyword | GH Issue |
---|---|---|---|---|---|
❌ | test_datatypes | test_series_to_ibis_literal | ir.as_value_expr does not handle dd.Series |
as_value_expr | |
❌ | test_arrays | test_array_collect_rolling_partitioned | Windowing not implemented | windowing | |
❌ | test_join | test_join_with_non_trivial_key | execute_materialized_join is broken |
execute_materialized_join | |
❌ | test_join | test_join_with_non_trivial_key_project_table | execute_materialized_join is broken |
execute_materialized_join | |
❌ | test_operations | test_project_scope_does_not_override | Windowing not implemented | windowing | |
✔️ | test_operations | test_aggregation_group_by | Aggregations not implemented | aggregations | |
✔️ | test_operations | test_boolean_aggregation | Aggregations not implemented | aggregations | |
❌ | test_operations | test_sort_by | Sorting partially implemented | sorting | |
❌ | test_operations | test_complex_sort_by | Sorting partially implemented | sorting | |
✔️ | test_operations | test_weighted_average | Grouping not implemented | grouping | |
✔️ | test_operations | test_groupby_with_unnamed_arithmetic | Grouping not implemented | grouping | |
✔️ | test_operations | test_cast_on_group_by | Grouping not implemented | grouping | |
✔️ | test_operations | test_left_binary_op_gb | Aggregations not implemented | aggregations | |
✔️ | test_structs | test_struct_field_series_group_by_value | Grouping not implemented | grouping | |
❌ | test_timecontext | test_context_adjustment_window | Windowing not implemented | windowing | |
❌ | test_timecontext | test_setting_timecontext_in_scope | Windowing not implemented | windowing | |
❌ | test_timecontext | test_context_adjustment_multi_window | Windowing not implemented | windowing | |
❌ | test_timecontext | test_context_adjustment_window_groupby_id | Windowing not implemented | windowing | |
❌ | test_udf | test_udaf_analytic_groupby | Windowing not implemented | windowing | |
❌ | test_udf | test_udaf_window | Windowing not implemented | windowing | |
❌ | test_udf | test_udaf_window_interval | Windowing not implemented | windowing | |
❌ | test_udf | test_multiple_argument_udaf_window | Windowing not implemented | windowing | |
❌ | test_udf | test_udaf_window_nan | Windowing not implemented | windowing | |
✔️ | test_udf | test_array_return_type_reduction_window | Windowing not implemented | windowing |
Ibis/all tests
Done? | test file | test name | reason | keyword | GH Issue |
---|---|---|---|---|---|
✔️ | test_join | test_join_project_left_table | Pandas used in test | pandas | |
✔️ | test_generic | test_isin | Sorting not implemented | sorting | |
✔️ | test_generic | test_notin | Sorting not implemented | sorting | |
✔️ | test_union | test_union | Pandas used in test | pandas | |
✔️ | test_aggregations | test_aggregate | Aggregations not implemented / pandas in test | aggregations | |
✔️ | test_aggregations | test_aggregate_grouped | Aggregations not implemented / pandas in test | aggregations | |
✔️ | test_aggregations | test_reduction_ops | iloc used in test | iloc | |
✔️ | test_aggregations | test_group_concat | Aggregations not implemented / iloc in test | aggregations | |
✔️ | test_aggregations | test_topk_op | Sorting not implemented / pandas in test | sorting | |
✔️ | test_aggregations | test_topk_filter_op | Sorting not implemented / pandas in test | sorting | |
✔️ | test_string | test_string_col_is_unicode | pandas used in test body | pandas | |
❌ | test_string | test_string | different dtypes returned | dtype | |
❌ | test_string | test_string | Substring operations not implemented | substring | |
✔️ | test_temporal | test_timestamp_truncate | pandas used in test body | pandas | |
✔️ | test_temporal | test_date_truncate | pandas used in test body | pandas | |
❌ | test_temporal | test_integer_to_interval_timestamp | Dask issues with DateOffset | DateOffset | https://github.com/dask/dask/issues/6958 |
❌ | test_temporal | test_integer_to_interval_date | Dask issues with DateOffset | DateOffset | https://github.com/dask/dask/issues/6958 |
✔️ | test_temporal | test_temporal_binop | pandas used in test body | pandas | |
✔️ | test_temporal | test_interval_add_cast_column | pandas used in test body (sorting) | pandas | |
✔️ | test_temporal | test_day_of_week_column_group_by | pandas used in test body (sorting) | pandas | |
❌ | test_temporal | test_now_from_projection | limit does not work | limit | |
✔️ : | test_vectorized_udf | test_analytic_udf_mutate | Windowing not implemented | windowing | |
❌ | test_vectorized_udf | test_analytic_udf_destruct | Windowing not implemented | windowing | |
❌ | test_vectorized_udf | test_analytic_udf_destruct_overwrite | Windowing not implemented | windowing | |
❌ | test_vectorized_udf | test_reduction_udf_destruct_window | Windowing not implemented | windowing |
Notes
- Many of the aggregation/grouping issues are interrelated (we often group before performing an aggregation)
- AggContext has also not been implemented for the dask backend.
- A large portion of the grouping issues are due to the fact that
obj
andgrouper
methods on DaskGroupBy
structures
Issue Analytics
- State:
- Created 3 years ago
- Comments:6 (2 by maintainers)
Top Results From Across the Web
Development Guidelines - Dask.distributed
This repository is part of the Dask projects. General development guidelines including where to ask for help, a layout of repositories, testing practices,...
Read more >Changelog — Dask.distributed 2.11.0 documentation
Update UCX tests for new handshake step (GH#4036) jakirkham. Add test for informative errors in serialization cases (GH#4029) Matthew ...
Read more >What's New - Xarray
Add documentation of specific BackendEntrypoints (PR7200). ... Ensure tests are not skipped in the py38-all-but-dask test environment (GH4509).
Read more >kartothek.io.testing.read — kartothek 5.2.1.dev5+g1821ea5 ...
from kartothek.io.testing.read import * # noqa ``` Fixtures required to be implemented: ... Pass additional backend specific kwargs to the read function.
Read more >whats-new.rst.txt - Xarray - PyData |
Fix a regression in the removal of duplicate backend entrypoints ... Ensure tests are not skipped in the ``py38-all-but-dask`` test environment ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
A few additional tests were newly x-failed in the dask backend in this PR https://github.com/ibis-project/ibis/pull/2776/:
you can add checkboxes to the above table to make this easier once these are starting to get fixed