Skip to content

Add serde support for Arrow FileTypeWriterOptions #8599

@andygrove

Description

@andygrove

Is your feature request related to a problem or challenge?

DataFusion supports many FileTypeWriterOptions:

pub enum FileTypeWriterOptions {
    #[cfg(feature = "parquet")]
    Parquet(ParquetWriterOptions),
    CSV(CsvWriterOptions),
    JSON(JsonWriterOptions),
    Avro(AvroWriterOptions),
    Arrow(ArrowWriterOptions),
}

The serde support in the datafusion-proto crate currently only supports JSON:

message FileTypeWriterOptions {
  oneof FileType {
    JsonWriterOptions json_options = 1;
  }
}

Describe the solution you'd like

Add serde support for Arrow FileTypeWriterOptions

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions