Is your feature request related to a problem or challenge?
#7466 from @devinjdangelo added support for specifying parquet specific options via the COPY SQL command. For exampe the following defaults compression to snappy but overrides compression for the col1 and col2
copy my_table
to my_file.parquet
(compression snappy
'compression::col1' 'zstd(5)',
'compression::col2.nested' 'zstd(10)'
Describe the solution you'd like
Update the COPY documentation in https://arrow.apache.org/datafusion/user-guide/sql/dml.html#copy to include this syntax and details
See also https://github.com/apache/arrow-datafusion/blob/main/datafusion/sqllogictest/test_files/copy.slt for a bunch of examples
Describe alternatives you've considered
No response
Additional context
No response
Is your feature request related to a problem or challenge?
#7466 from @devinjdangelo added support for specifying parquet specific options via the COPY SQL command. For exampe the following defaults compression to snappy but overrides compression for the
col1andcol2Describe the solution you'd like
Update the COPY documentation in https://arrow.apache.org/datafusion/user-guide/sql/dml.html#copy to include this syntax and details
See also https://github.com/apache/arrow-datafusion/blob/main/datafusion/sqllogictest/test_files/copy.slt for a bunch of examples
Describe alternatives you've considered
No response
Additional context
No response