Update Arrow to the latest release tag (2.0.0)#2

Merged

alexey-milovidov merged 461 commits intoClickHouse:masterfrom

FawnD2:apache-arrow-2.0.0

Nov 5, 2020

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 11, 2020

ARROW-9957: [Rust] Replace tempdir with tempfile
nevi-me
committed
ARROW-9966: [Rust] Speedup kernels for sum,min,max by 10%-60%

jorgecarleitao
authored and
nevi-me
committed
ARROW-9868: [C++][R] Provide CopyFiles for copying files between FileSystems

bkietz
authored and
nealrichardson
committed
ARROW-5034: [C#] ArrowStreamWriter and ArrowFileWriter implement sync WriteRecordBatch

suhsteve
authored and
eerhardt
committed
ARROW-9271: [R] Preserve data frame metadata in round trip

romainfrancois
and
nealrichardson
committed
ARROW-9387: [R] Use new C++ table select method

romainfrancois
and
nealrichardson
committed

Commits on Sep 12, 2020

ARROW-9979: [Rust] Fix arrow crate clippy lints

nevi-me
authored and
andygrove
committed
ARROW-9950: [Rust] [DataFusion] Made UDFs usable without a registry

jorgecarleitao
authored and
andygrove
committed
ARROW-9954: [Rust] [DataFusion] Made aggregates support the same signatures as functions.

jorgecarleitao
authored and
andygrove
committed
ARROW-9961: [Rust][DataFusion] Make to_timestamp function parses timestamp without timezone offset as local

alamb
authored and
andygrove
committed
ARROW-9790: [Rust][Parquet]: Increase test coverage in arrow_reader.rs

alamb
authored and
andygrove
committed
ARROW-9980: [Rust] [Parquet] Fix clippy lints
nevi-me
committed

Commits on Sep 15, 2020

Commits on Sep 17, 2020

ARROW-10024: [C++][Parquet] Create nested reading benchmarks

pitrou
authored and
emkornfield
committed
ARROW-8678: [C++/Python][Parquet] Remove old writer code path
emkornfield
committed
ARROW-3757: [R] R bindings for Flight RPC client
nealrichardson
committed
ARROW-9971: [Rust] Improve speed of `take` by 2x-3x (change scaling with batch size)

jorgecarleitao
authored and
andygrove
committed
ARROW-9990: [Rust] [DataFusion] Fixed the NOT operator

jorgecarleitao
authored and
andygrove
committed
ARROW-10028: [Rust] Simplified macro

jorgecarleitao
authored and
andygrove
committed
ARROW-9977: [Rust] Added min/max of [Large]StringArray

jorgecarleitao
authored and
andygrove
committed
ARROW-9987: [Rust] [DataFusion] Improved docs for `Expr`

jorgecarleitao
authored and
andygrove
committed
ARROW-10001 [Rust] [DataFusion] Added developer guide to README.

jorgecarleitao
authored and
andygrove
committed

Commits on Sep 18, 2020

Commits on Sep 20, 2020

ARROW-9338: [Rust] Add clippy instructions

nevi-me
authored and
andygrove
committed
ARROW-9902: [Rust] [DataFusion] Add array() built-in function

jorgecarleitao
authored and
andygrove
committed
ARROW-9937: [Rust] [DataFusion] Improved aggregations

jorgecarleitao
authored and
andygrove
committed

Commits on Sep 21, 2020

ARROW-10017: [Java] Fix LargeMemoryUtil long conversion

Patrick Woody
authored and
liyafan82
committed
ARROW-9969: [C++] Fix RecordBatchBuilder with dictionary types

troels
authored and
pitrou
committed
ARROW-10048: [Rust] Fixed error in computing min/max with null entries.

jorgecarleitao
authored and
andygrove
committed
ARROW-9922: [Rust] Add StructArray::TryFrom (+40%)

jorgecarleitao
authored and
andygrove
committed
ARROW-10037: [C++] Workaround to force find AWS SDK to look for shared libraries

kszucs
authored and
pitrou
committed
ARROW-9946: [R] Check `sink` argument class in `ParquetFileWriter`

karldw
and
nealrichardson
committed
ARROW-9775: [C++] Automatic S3 region selection
pitrou
committed
ARROW-8494: [C++][Parquet] Full support for reading mixed list and structs

committed
ARROW-10055: [Rust] DoubleEndedIterator implementation for NullableIter

vertexclique
authored and
andygrove
committed

Commits on Sep 22, 2020

ARROW-10013: [FlightRPC][C++] fix setting generic client options

lidavidm
authored and
pitrou
committed
ARROW-10035: [C++] Update vendored libraries
pitrou
committed
ARROW-10049: [C++/Python] Sync conda recipe with conda-forge

xhochy
authored and
kszucs
committed
ARROW-4189: [Rust] Added coverage report.

jorgecarleitao
authored and
kszucs
committed
ARROW-10062: [Rust] Fix for null elems at key position in dictionary arrays

vertexclique
authored and
andygrove
committed
ARROW-10060: [Rust] [DataFusion] Fixed error on which Err were discarded in MergeExec.

jorgecarleitao
authored and
andygrove
committed
ARROW-10064: [C++] Resolve compile warnings on Apple Clang 12

kszucs
authored and
xhochy
committed
ARROW-9078: [C++] Parquet read / write extension type with nested storage type
pitrou
committed
PARQUET-1878: [C++] lz4 codec is not compatible with Hadoop Lz4Codec

authored and
wesm
committed

Commits on Sep 23, 2020

ARROW-9010: [Java] Framework and interface changes for RecordBatch IPC buffer compression

liyafan82
authored and
emkornfield
committed
ARROW-10016: [Rust] Implement is null / is not null kernels

jhorstmann
authored and
nevi-me
committed
ARROW-10044: [Rust] Improved Arrow's README.

jorgecarleitao
authored and
nevi-me
committed
ARROW-9897: [C++][Gandiva] Added to_date function

projjal
authored and
praveenbingo
committed
ARROW-10073: [Python] Don't rely on dict item order in test_parquet_nested_storage

bkietz
authored and
kszucs
committed
ARROW-10066: [C++] Make sure default AWS region selection algorithm is used

pitrou
authored and
nealrichardson
committed
ARROW-9970: [Go] fix checkptr failure in sum methods

mark-rushakoff
authored and
wesm
committed

Commits on Sep 24, 2020

ARROW-10077: [C++] Fix possible integer multiplication overflow

Micah Kornfield
authored and
pitrou
committed
ARROW-9934 [Rust] Shape and stride check in tensor

Fernando José Herrera Elizalde
and
nevi-me
committed
ARROW-10075: [C++] Use nullopt from arrow::util instead of vendored namespace

Micah Kornfield
authored and
pitrou
committed
ARROW-10074: [C++] Use string constructor instead of string_view.to_string

Micah Kornfield
authored and
pitrou
committed
ARROW-10051: [C++][Compute] Move kernel state when merging

cyb70289
authored and
pitrou
committed
ARROW-9603: [C++] Fix parquet write to not assume leaf-array validity bitmaps have the same values as parent structs

emkornfield
authored and
pitrou
committed
ARROW-10027: [C++] Fix Take array kernel for NullType

jorisvandenbossche
authored and
pitrou
committed
ARROW-10076: [C++] Use temporary directory facility in all unit tests

Micah Kornfield
and
pitrou
committed
ARROW-10065: [Rust] Simplify code (+500, -1k)

jorgecarleitao
authored and
nevi-me
committed
ARROW-9557: [R] Iterating over parquet columns is slow in R

romainfrancois
authored and
nealrichardson
committed
ARROW-10083: [C++] Improve Parquet fuzz seed corpus

pitrou
authored and
nealrichardson
committed
ARROW-10085: [C++] Fix S3 region resolution on Windows

pitrou
authored and
bkietz
committed
ARROW-10003: [C++] Create parent dir for any destination fs in CopyFiles

bkietz
authored and
nealrichardson
committed

Commits on Sep 25, 2020

Commits on Sep 27, 2020

ARROW-9754: [Rust] [DataFusion] Implement async in ExecutionPlan trait
andygrove
committed
ARROW-10069: [Java] Support running Java benchmarks from command line

liyafan82
authored and
lidavidm
committed
ARROW-10019: [Rust] Add substring kernel

jorgecarleitao
authored and
nevi-me
committed

Commits on Sep 28, 2020

ARROW-9965: [Java] Improve performance of BaseFixedWidthVector.setSafe by optimizing capacity calculations

josiahyan
authored and
liyafan82
committed
ARROW-8618: [C++] Clean up some redundant std::move()s

bkietz
authored and
pitrou
committed
ARROW-9924: [C++][Dataset] Enable per-column parallelism for single ParquetFileFragment scans

bkietz
authored and
wesm
committed

Commits on Sep 29, 2020

Commits on Sep 30, 2020

Commits on Oct 1, 2020

Commits on Oct 2, 2020

ARROW-10148: [Rust] Improved rust/lib.rs that is shown in docs.rs

jorgecarleitao
authored and
andygrove
committed
ARROW-10084: [Rust] [DataFusion] Added length of LargeStringArray and fixed undefined behavior.

jorgecarleitao
authored and
andygrove
committed
ARROW-10046: [Rust] [DataFusion] Made `RecordBatchReader` implement Iterator

jorgecarleitao
authored and
andygrove
committed
ARROW-10103: [Rust] Add contains kernel

nevi-me
authored and
andygrove
committed
ARROW-10057: [C++] Add hand-written Parquet nested tests

pitrou
authored and
emkornfield
committed
ARROW-10157: [Rust] Add an example to the take kernel

alamb
authored and
paddyhoran
committed
ARROW-10160: [Rust] Improve DictionaryType documentation (clarify which type is which)

alamb
authored and
paddyhoran
committed

Commits on Oct 3, 2020

Commits on Oct 4, 2020

Commits on Oct 5, 2020

ARROW-9701: [CI][Java] Add a job for s390x Java on TravisCI

kiszk
and
kou
committed
ARROW-10156: [Rust] Added github action to label PRs for rust.

jorgecarleitao
authored and
kou
committed
ARROW-9786: [R] Unvendor cpp11 before release

romainfrancois
authored and
nealrichardson
committed
ARROW-9941: [Python] Better string representation for extension types

dianaclarke
authored and
pitrou
committed
ARROW-8394: [JS] Upgrade to TypeScript 4.0.2, fix typings for TS 3.9+

trxcllnt
authored and
nealrichardson
committed
ARROW-8735: [Rust] [Parquet] Allow arm 32 to use soft hash implementation

hannah-stevenson-frequenz
authored and
andygrove
committed
ARROW-10008: [C++][Dataset] Fix filtering/row group statistics of dict columns
bkietz
committed
ARROW-10121: [C++] Fix emission of new dictionaries in IPC writer

pitrou
authored and
wesm
committed
ARROW-10068: [C++] Add bundled external project for aws-sdk-cpp

committed
ARROW-10147: [Python] Pandas metadata fails if index name not JSON-serializable

dianaclarke
authored and
wesm
committed

Commits on Oct 6, 2020

Commits on Oct 7, 2020

Commits on Oct 8, 2020

ARROW-9782: [C++][Dataset] More configurable Dataset writing

bkietz
and
nealrichardson
committed
ARROW-10134: [Python][Dataset] Add ParquetFileFragment.num_row_groups
bkietz
committed
ARROW-10227: [Ruby] Use a table size as the default for parquet chunk_size

kanga333
authored and
kou
committed
ARROW-10229: [C++] Remove errant log line

emkornfield
authored and
pitrou
committed
ARROW-10023: [C++][Gandiva] Implement split_part function in gandiva

naman1996
authored and
praveenbingo
committed
ARROW-9967: [Python] Add compute module docs + expose more option classes

arw2019
and
pitrou
committed
ARROW-10040: [Rust] Iterate over and combine boolean buffers with arbitrary offsets

jhorstmann
authored and
nevi-me
committed
ARROW-10235: [Rust][DataFusion] Improve documentation for type coercion

alamb
authored and
jorgecarleitao
committed
ARROW-6537 [R]: Pass column_types to CSV reader

romainfrancois
and
nealrichardson
committed
ARROW-10233: [Rust] Make array_value_to_string available in all Arrow builds

alamb
authored and
jorgecarleitao
committed
ARROW-9414: [Packaging][deb][RPM] Enable S3
kou
committed
ARROW-10015: [Rust] Simd aggregate kernels

jhorstmann
authored and
andygrove
committed
ARROW-10043: [Rust][DataFusion] Implement COUNT(DISTINCT col)

drusso
authored and
andygrove
committed
ARROW-10164: [Rust] Add support for DictionaryArray to cast kernel

alamb
authored and
andygrove
committed

Commits on Oct 9, 2020

Commits on Oct 10, 2020

Commits on Oct 11, 2020

Commits on Oct 12, 2020

Commits on Nov 5, 2020

Merge tag 'apache-arrow-2.0.0' of github.com:apache/arrow into apache-arrow-2.0.0
FawnD2
committed