Skip to content

Intermittent failure on dataframe::write_partitioned_parquet_results #9368

@alamb

Description

@alamb

Describe the bug

dataframe::write_partitioned_parquet_results sometimes passes and sometimes fails

This test was recently added in #9316

To Reproduce

Example failure https://github.com/apache/arrow-datafusion/actions/runs/8063185942/job/22024675172



---- dataframe::write_partitioned_parquet_results stdout ----
thread 'dataframe::write_partitioned_parquet_results' panicked at datafusion/core/tests/dataframe/mod.rs:1978:5:
assertion `left == right` failed: 

expected:

[
    "+-----+-----+",
    "| c1  | c2  |",
    "+-----+-----+",
    "| abc | 123 |",
    "| def | 456 |",
    "+-----+-----+",
]
actual:

[
    "+-----+-----+",
    "| c1  | c2  |",
    "+-----+-----+",
    "| def | 456 |",
    "| abc | 123 |",
    "+-----+-----+",
]

Expected behavior

I think we can just update the test to use assert_batches_sorted_eq https://docs.rs/datafusion/latest/datafusion/macro.assert_batches_sorted_eq.html so that the ordering is normalized

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinggood first issueGood for newcomers

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions