Support limit and filter for ScanBuilder and RepeatedScan#7565
Support limit and filter for ScanBuilder and RepeatedScan#7565
Conversation
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Polar Signals Profiling ResultsLatest Run
Previous Runs (2)
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.087x ➖ datafusion / vortex-file-compressed (1.087x ➖, 0↑ 3↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.069x ➖, 0↑ 2↓)
datafusion / vortex-compact (1.235x ❌, 0↑ 4↓)
datafusion / parquet (0.994x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (0.987x ➖, 1↑ 1↓)
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
duckdb / parquet (1.022x ➖, 0↑ 1↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.029x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.088x ➖, 0↑ 4↓)
datafusion / parquet (1.008x ➖, 1↑ 1↓)
datafusion / arrow (0.999x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
duckdb / parquet (0.972x ➖, 2↑ 0↓)
duckdb / duckdb (0.997x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMENo file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.032x ➖, 0↑ 9↓)
datafusion / vortex-compact (1.057x ➖, 0↑ 14↓)
datafusion / parquet (0.992x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (0.984x ➖, 2↑ 0↓)
duckdb / vortex-compact (0.984x ➖, 2↑ 1↓)
duckdb / parquet (0.997x ➖, 1↑ 0↓)
duckdb / duckdb (1.000x ➖, 0↑ 3↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb S3Verdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.945x ➖, 1↑ 2↓)
datafusion / vortex-compact (1.129x ➖, 1↑ 2↓)
datafusion / parquet (1.103x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.098x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.164x ➖, 0↑ 0↓)
duckdb / parquet (1.024x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.952x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.963x ➖, 0↑ 0↓)
duckdb / parquet (0.962x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.053x ➖, 0↑ 4↓)
datafusion / vortex-compact (1.078x ➖, 0↑ 8↓)
datafusion / parquet (1.014x ➖, 0↑ 0↓)
datafusion / arrow (1.001x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.996x ➖, 0↑ 0↓)
duckdb / parquet (0.996x ➖, 0↑ 0↓)
duckdb / duckdb (1.006x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.025x ➖, 1↑ 1↓)
datafusion / vortex-compact (1.148x ➖, 0↑ 6↓)
datafusion / parquet (1.105x ➖, 0↑ 4↓)
duckdb / vortex-file-compressed (0.956x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.950x ➖, 0↑ 0↓)
duckdb / parquet (1.006x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.081x ➖, 0↑ 14↓)
datafusion / parquet (1.012x ➖, 0↑ 2↓)
duckdb / vortex-file-compressed (1.040x ➖, 0↑ 8↓)
duckdb / parquet (1.014x ➖, 0↑ 0↓)
duckdb / duckdb (1.021x ➖, 1↑ 5↓)
Full attributed analysis
|
File Sizes: Clickbench on NVMEFile Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.001x ➖, 1↑ 1↓)
datafusion / vortex-compact (0.989x ➖, 0↑ 0↓)
datafusion / parquet (1.057x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (0.932x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.855x ➖, 0↑ 0↓)
duckdb / parquet (0.939x ➖, 0↑ 0↓)
Full attributed analysis
|
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Summary
Closes: #000
Testing