Describe the bug
flatten only supports List not FixedSizeList
To Reproduce
select flatten(some_fixed_size_list);
Error: Internal error: Not reachable, data_type should be List.
This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker
Expected behavior
flatten behaves the same on both List and FixedSizeList
Additional context
BuiltinScalarFunction::Flatten => {
fn get_base_type(data_type: &DataType) -> Result<DataType> {
match data_type {
DataType::List(field) => match field.data_type() {
DataType::List(_) => get_base_type(field.data_type()),
_ => Ok(data_type.to_owned()),
},
_ => internal_err!("Not reachable, data_type should be List"),
}
}
let data_type = get_base_type(&input_expr_types[0])?;
Ok(data_type)
}
probably just need to add a branch here for FixedSizeList
Describe the bug
flatten only supports
ListnotFixedSizeListTo Reproduce
Expected behavior
flatten behaves the same on both
ListandFixedSizeListAdditional context
probably just need to add a branch here for
FixedSizeList