Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2774 commits
Select commit Hold shift + click to select a range
acf741f
[feature](binlog) Support gc binlogs by history nums and size (#35250)
w41ter May 23, 2024
0d2ab9d
[fix](clean trash) Fix clean trash lost submit task (#35271)
deardeng May 23, 2024
ed464ac
[branch-2.1] remove dlf dependencies (#35292)
morningman May 23, 2024
82887cc
[improvement](mtmv)Split expression get cherry pick21 (#35240)
seawinde May 23, 2024
4075408
[feature](mtmv)Support single table mv rewrite (#34185) (#35242)
seawinde May 23, 2024
bf37e5c
[feature](Nereids) support select distinct with aggregate (#35300)
924060929 May 23, 2024
b3f6668
fix case: test_create_table_without_distribution
Doris-Extras May 23, 2024
eb49cd8
[refactor](datalake) return the error status instead of static_cast<v…
AshinGau May 22, 2024
4008dc0
[Fix](regression) fix test_user_var.groovy by add set disable_nereids…
feiniaofeiafei May 22, 2024
9ba9953
[fix](routineload) fix data source properties do not persist in edit …
sollhui May 22, 2024
a52ee6e
[opt](mtmv) generate bi-map between base table and materialized view …
zddr May 22, 2024
a6f7747
[feature](datatype) add BE config to allow zero date (#34961)
kaijchen May 22, 2024
4b7608c
[fix](inverted index)Change index_id from int32 to int64 to avoid ove…
qidaye May 22, 2024
9277480
[fix](nereids)days_diff should match datetimev2 function sigature in …
starocean999 May 23, 2024
bb3a0fd
[fix](nereids)should use nereids expr's nullable info when call Expr'…
starocean999 May 23, 2024
0b90e37
[fix](Nereids) string literal coercion of in predicate (#35337)
mongo360 May 24, 2024
f062506
[fix](nereids)the preagg state for count(*) is wrong (#35326)
starocean999 May 24, 2024
cf46ebe
[improve](jdbc catalog) Remove all property checks during create (#35…
zy-kkk May 24, 2024
edb276a
[fix](typo)fix show backend typo (#35198)
catpineapple May 23, 2024
473e14c
[chore](backup) log backup/restore job during replay (#35234)
w41ter May 23, 2024
8c594c6
[Fix](regression) fix show data regression case (#35218)
airborne12 May 23, 2024
98b2bda
[opt](Nereids) remove restrict for count(*) in window (#35220)
morrySnow May 23, 2024
682d72b
[fix](noexcept) Remove incorrect noexcept #35230
zhiqiang-hhhh May 23, 2024
9427942
[opt](thrift)update thrift to support pushing limit to local Agg (#35…
englefly May 23, 2024
dd567fa
[fix](function) support return JsonType for If function (#35199)
DarvenDuan May 23, 2024
78fab91
[fix](overflow) show backends overflow for backend ids (#35245)
dataroaring May 23, 2024
07cd189
[test](inverted index) nonConcurrent is added to the test case (#35259)
zzzxl1993 May 23, 2024
e02dcec
[optimize](regression)Add retry for curl request (#35260)
qidaye May 23, 2024
3095038
[Fix](bloom filter) Fix bloom filter memory leak (#34871)
Yukang-Lian May 23, 2024
0e2b748
[fix](regression-test) line_delimiter parse error in regression_test …
133tosakarin May 23, 2024
d85ea83
[test](case) Remove sensitive information in k8s deploy test (#35185)
yongjinhou May 23, 2024
bd4dd94
[Fix](nereids) add checkBlockRules() check for create view and alter …
feiniaofeiafei May 23, 2024
708b5b5
[fix](ui): fix data preview error (#34521)
jeffreys-cat May 23, 2024
bbf502d
[fix](create-table)The CREATE TABLE IF NOT EXISTS AS SELECT statement…
CalvinKirs May 23, 2024
e6027ca
[fix](p2-test) fix test_export_with_parallelism case (#35283)
BePPPower May 23, 2024
c4776a4
[fix](regression-test) fix test_tvf_view_count_p2 regression test (#3…
BePPPower May 23, 2024
4b91ad0
[opt](memory) avoid allocate memory in agg operator constructor (#35301)
yiguolei May 24, 2024
d6e8fb7
[feature](mtmv) Support agg state roll up and optimize the roll up co…
seawinde May 24, 2024
f6beeb1
[Enhencement](tvf) select tvf supports using resource (#35139)
BePPPower May 24, 2024
bfe293c
[fix](nereids) AdjustNullable rule should handle union node with no c…
starocean999 May 24, 2024
1e07971
[Feat](nereids)when dealing insert into stmt with empty table source,…
feiniaofeiafei May 24, 2024
ca86ee7
[fix](load) fix wrong assert and cancel load error (#35362)
morningman May 24, 2024
639c7ee
[fix](decimalv2) fix scale of decimalv2 to string (#35222) (#35359)
jacktengg May 24, 2024
88e2753
[fix](Nereids) fix ShowProcedureStatusCommand sendResultSet (#35355)
zy-kkk May 24, 2024
41f29cf
[fix](decompress)(review) context leaked in failure path (#33622) (#3…
dataroaring May 24, 2024
c4b2ddd
[Fix](Variant) clear block after a flush complete (#35226) (#35372)
eldenmoon May 24, 2024
cf84998
Revert "[fix](broker load) Make Config.enable_pipeline_load works as …
Doris-Extras May 24, 2024
3eeb83f
[test](fix) Fix test check fail when test nested mv hit (#34293) (#35…
seawinde May 24, 2024
0f550ae
[fix](compression) handle exception to reuse compression context (#35…
dataroaring May 24, 2024
6299871
[opt](mtmv) Add threshold for relation mapping num when query rewrit…
seawinde May 24, 2024
9af493f
[fix](mtmv) Fix table id overturn and optimize get table qualifier me…
seawinde May 24, 2024
9c6a689
[fix](mtmv) Fix npe when the id of base table in mv is lager than Int…
seawinde May 24, 2024
5bcdc75
fix compile
Doris-Extras May 25, 2024
41c3a27
[minor](nereids): remove useless code (#35325)
jackwener May 24, 2024
c6c90ff
[chore](routine-load) make routine_load_consumer_pool_size can update…
sollhui May 24, 2024
34e5030
[bugifx](core) fix logical error of status check in nestedloop join (…
zhiqiang-hhhh May 24, 2024
80ba873
[regression-test](fix) test_date_diff case bug (#35356)
shuke987 May 24, 2024
b143f0d
[Improvement](date) shortcut for str to date parse (#35288)
BiteTheDDDDt May 24, 2024
806b7d6
[regression-test](fix) runtime_filter.groovy case bug (#35368)
shuke987 May 24, 2024
952875b
[chore](restore) Add logs about the restore table state (#35363)
w41ter May 24, 2024
fff6ab9
[fix](clean trash) Add clean trash regression case (#35330)
deardeng May 24, 2024
65b9e5a
[fix](chore) fix DCHECK failure of BufferWritable if failed to alloc …
jacktengg May 24, 2024
a79b436
remove iscloud mode
Doris-Extras May 25, 2024
6e17dc1
(cherry-pick)[branch-2.1] add calc tablet file crc and fix single co…
csun5285 May 26, 2024
ade1841
[fix](shuffle) Do not return error if local recvr is null (#35399)
Gabriel39 May 26, 2024
8f5deb1
[be](oom) add stacktrace in debugmode to find oom reason
Doris-Extras May 26, 2024
83cbb4e
fix cloud mode
Doris-Extras May 27, 2024
a9bd98d
[fix](nereids)AdjustNullable rule should handle union node with no ch…
starocean999 May 27, 2024
af986c3
[feat](Nereids): Put the Child with Least Row Count in the First Posi…
keanji-x May 27, 2024
b6eaf95
[fix](memory) Fix BE memory info compatible with Cgroup (#35412) (#35…
xinyiZzz May 27, 2024
e3b4d4e
Reset workload_group_max_num for regression test (#35430)
wangbo May 27, 2024
2e20e38
[improvement](jdbc catalog) remove useless jdbc catalog code (#34986)…
zy-kkk May 27, 2024
f99b2f0
[branch-2.1][hotfix](jdbc table) Restoring a table type that should n…
zy-kkk May 27, 2024
a82c6e8
[fix](Nereids) LogicalEmptyRelation type is wrong (#35382)
morrySnow May 27, 2024
2422439
[Update](regression) add case for inverted index (#35305)
airborne12 May 27, 2024
5ab5ec3
[Fix](inverted index) fix build index wrong size for inverted index (…
airborne12 May 27, 2024
b1795d4
[bugfix](hive)fix testcase for test_hive_write_different_path (#35209)
wuwenchi May 27, 2024
f98ed4e
[bugfix](hive)Misspelling of class names (#34981)
wuwenchi May 27, 2024
09f9012
[Fix](hive-writer) Fix hive partition update core. (#35311)
kaka11chen May 27, 2024
7284b69
[Configurations](multi-catalog)Fix enable_orc_filter_by_min_max funct…
kaka11chen May 27, 2024
82ff29f
[Chore](materialized-view) forbid create mv on row store table (#35360)
BiteTheDDDDt May 27, 2024
68eda58
[Fix](multi-catalog) Fix string dict filtering when use null related …
kaka11chen May 27, 2024
6d362c1
[fix](hint) fix hint tests with different be instances (#35188)
LiBinfeng-01 May 27, 2024
c44affb
Add downgrade scan thread num by column num (#35351)
wangbo May 27, 2024
596fb6f
[improve](ub) fix some runtime error of ubsan when downcast (#35343)
zhangstar333 May 27, 2024
d71e9d3
[Bugfix] Fix mv column type is not changed when do schema change (#34…
Lchangliang May 27, 2024
a32db25
[enhance](mtmv) allow add index for MTMV (#34225) (#35443)
zddr May 27, 2024
1a52e4f
[chore](mtmv)Optimize mtmv logs and exception information (#34957) (#…
zddr May 27, 2024
8c4f5af
[opt](Nereids) auto fallback when insert unsupport catalog (#33353) (…
morrySnow May 27, 2024
8ff95a0
[Fix](test) fix test case output for inverted_index_p0.test_tokenize …
airborne12 May 27, 2024
238e218
[fix](httpapi) restore compaction/run_status api can show be's overal…
Yulei-Yang May 28, 2024
f0e883c
[Fix](executor)Fix backend_active_tasks only scan one be (#35490)
wangbo May 28, 2024
7058b31
[fix](move-memtable) clear load streams before shutdown SegmentFileWr…
kaijchen May 27, 2024
d8eefd0
[fix] fix wrong result of spill agg with limit (#35403)
jacktengg May 27, 2024
79cd726
[Fix](inverted index) fix race condition in index build (#35427)
airborne12 May 27, 2024
9d6b2d6
[feature](metrics)support be jvm metrics. (#35023)
hubgeter May 27, 2024
f8fcd17
[fix](memory) Fix nested scoped tracker and nested reserve memory (#3…
xinyiZzz May 27, 2024
c38c939
[bug](Fe) fix potential deadlock in show proc statement (#34988)
xy720 May 27, 2024
3aab6b1
[chore](regression) add debug log for flaky case of test_stream_load_…
liaoxin01 May 27, 2024
7c808fc
[bugfix] Fix the case is unstable because Table[tbl_scalar_types_dup]…
Lchangliang May 27, 2024
ac49576
[Fix](nereids) fix merge aggregate setting top projection bug (#35348)
feiniaofeiafei May 27, 2024
dfcabf8
[fix](nereids) set mark join reference for bitmap-in-apply (#35435)
englefly May 27, 2024
9c15a85
[fix](tools) update tools cases #35467
xzj7019 May 27, 2024
2f7280b
[regression-test](fix) fix sql_block_rule_p0/test_sql_block_rule.groo…
shuke987 May 28, 2024
f6540d5
[regression-test](fix) fix schema_change_p2/test_schema_change.groovy…
shuke987 May 28, 2024
2310915
[fix](pipeline) Fix query hang if limited rows is reached (#35466)
Gabriel39 May 28, 2024
d2df392
[fix](nereids) push filter through window, using slot equal-set (#35361)
englefly May 28, 2024
8599e8e
[improvement](mtmv) Add id to statistics map in statement context for…
seawinde May 28, 2024
97a5f55
[fix](function) bitmap to base64 error length check (#35117)
Mryange May 28, 2024
87c9009
[Bug](materialized-view) fix unmatch mv coz table name (#35444)
BiteTheDDDDt May 28, 2024
4e7e8d7
[enhancement](atomicstatus) use lock to make the status object more s…
yiguolei May 28, 2024
96a4159
[opt](scan) Use lazy-init for segment iterators and avoid caching all…
mrhhsg May 28, 2024
43890ff
[fix](compaction) fix repeatedly picking tablets with disable auto co…
luwei16 May 28, 2024
9d04d18
[improvement](statistics)Write audit log while doing drop stats. (#34…
Jibing-Li May 28, 2024
63e63e1
[fix](Nereids) could not push down filter through cte producer someti…
morrySnow May 28, 2024
aa4fd3f
[fix](statistics)Improve analyze timeout. (#33836) (#35530)
Jibing-Li May 28, 2024
69da39b
[improvement](statistics)Use defaultSessionVariable instead of clone …
Jibing-Li May 28, 2024
9f6d826
[fix](group commit) should set wal id in runtime_state when building …
hust-hhb May 28, 2024
b78dae0
Revert "[fix](nereids) push filter through window, using slot equal-s…
morrySnow May 28, 2024
27cf5a6
[enhancement](export) filter empty partition before export table to r…
caiconghui May 28, 2024
84e9a14
[Fix](hive-writer) Fix partition column orders issue when the partiti…
kaka11chen May 28, 2024
50e81d9
[feat](nereids) add more rules to eliminate empty relation (#34997) -…
englefly May 28, 2024
7010606
Revert "[fix](group commit) should set wal id in runtime_state when b…
Doris-Extras May 28, 2024
d97788d
[Refactor](Status) Refactor the scanner scheduler code make return er…
HappenLee May 28, 2024
efdce7e
[fix](binlog) Fix add partition record sql (#35461)
w41ter May 28, 2024
86c7092
[opt](external) ignore not find files (#35319)
morningman May 28, 2024
2e1318b
[fix] (compaction) fix CompactionPermitLimiter causing compaction to…
csun5285 May 28, 2024
72a27a0
[fix](paimon)fix paimon cache bug (#35309)
suxiaogang223 May 28, 2024
eefeb4d
[fix](spill) fix wrong disk usage of spill (#35423)
jacktengg May 28, 2024
bddaeb9
[Fix](JobSchedual) Modify the default value of `async_task_consumer_t…
BePPPower May 28, 2024
aacc3bb
[Bug](runtime-filter) do not process rf on HashJoinBuildSinkLocalStat…
BiteTheDDDDt May 28, 2024
dc8d7fb
[github](pr) simplify the PR template (#35551)
morningman May 28, 2024
1fab4b6
[fix](group commit) should set wal id in runtime_state when building …
hust-hhb May 28, 2024
9fae082
[bugfix](hive)Partition fields in wrong order for 2.1 (#35554)
wuwenchi May 28, 2024
5c40e87
[opt](s3) auto retry when meeting 429 error (#35397)
morningman May 28, 2024
95393b5
Revert "[fix](memory) Fix nested scoped tracker and nested reserve me…
Doris-Extras May 28, 2024
b06794d
[opt](spill) add session variable of 'enable_force_spill' (#34664) (#…
jacktengg May 29, 2024
97da445
[pick](branch-2.1)fix test case to compatible with 3 replicas (#34276…
csun5285 May 29, 2024
746c620
[fix](index) bitmap and bloomfilter index should not do light index c…
cambyzju May 29, 2024
3736d0a
[Fix](hive-writer) Fix s3 file commiter not working. (#35502) (#35579)
morningman May 29, 2024
589518f
[fix](Nereids) fix Illegal aggregate node: group by and output is emp…
924060929 May 28, 2024
646d8ea
[fix](restore) Fix restore table name when lower_case_table_names ena…
w41ter May 28, 2024
7381cd5
[docker](hive) sync for hive initializing (#35479)
suxiaogang223 May 28, 2024
aaa89ec
[bugfix](iceberg)support null values as partition (#35503)
wuwenchi May 28, 2024
8fb2824
[improvement](page builder) avoid allocating big memory in ctor (#35493)
jacktengg May 28, 2024
6fd3916
[regression-test](framework) add log for scpFiles (#35570)
shuke987 May 29, 2024
f076fe8
[fix](Nereids) aggregate combinator should be case-insensitive (#35540)
morrySnow May 29, 2024
8c0c05b
[fix](auth) Fix no auth,but can select count(*) (#35465)
zddr May 29, 2024
1f5edae
[fix](Nereids) prune not required window expressions on window operat…
morrySnow May 29, 2024
c964ed3
[fix](pipeline) Prevent concurrent accessing to dependencies (#35560)…
Gabriel39 May 29, 2024
b91d2ca
[Feature](iceberg-writer) Implements iceberg sink basic functionality…
kaka11chen May 29, 2024
4294b73
Revert "Revert "[fix](memory) Fix nested scoped tracker and nested re…
Doris-Extras May 29, 2024
eefea4c
[fix](mtmv) Fix partition mv rewrite result wrong (#35236)
seawinde May 29, 2024
a536227
[fix](mtmv) Fix getting related partition table wrongly when multi ba…
seawinde May 29, 2024
bef931d
[fix](inverted index) add in list to fast execute logic after hit ind…
zzzxl1993 May 29, 2024
aafd0a7
[fix](Nereids) adjust nullable for set operation may cause IndexOutOf…
morrySnow May 29, 2024
680be6d
[fix](ub) fix uninitialized accesses in BE (#35370)
zclllyybb May 29, 2024
4d16856
[fix](short circurt) fix return default value issue (#34186)
felixwluo May 29, 2024
f6e8c53
[fix](Nereids) remove getTableInMinidumpCache temporary (#35571)
morrySnow May 29, 2024
36bb373
[bugfix](iceberg)support null values as partition for 2.1 (#35503) (#…
wuwenchi May 29, 2024
300582f
[branch-2.1](routine-load) fix be core when partial table load failed…
sollhui May 30, 2024
a03309c
Revert "[regression-test](framework) add log for scpFiles (#35570)"
Doris-Extras May 30, 2024
6abec88
[fix](compile) fix compile issue introduced from #35397
morningman May 30, 2024
2e4c2a6
[feature-wip](Cloud) Introduce azure core C++ sdk (#35208) (#35641)
ByteYue May 30, 2024
b0e2461
[branch-2.1][improvement](JdbcScan) Change the mysql function that do…
zy-kkk May 30, 2024
3cd7b88
[Fix](Variant) fix variant with empty key (#35671)
eldenmoon May 30, 2024
900850f
[fix](backup) save finished state for local repo backup (#35491)
w41ter May 30, 2024
9cd9207
[fix](inverted index) Remove float/double support in index writer (#3…
qidaye May 30, 2024
fb9363f
[fix](set) incorrect result of set operator (#35607)
mrhhsg May 30, 2024
0ed7dc1
[fix](resource-tag) missing resource tag after forwarding to master (…
morningman May 30, 2024
14de097
[opt](audit) add timeout for audit log load and modify the label form…
morningman May 30, 2024
373d9ab
[enhance](mtmv)add truncate table case (#35599)
zddr May 30, 2024
cb88334
[fix](meta) fix catalog replay error (#35532)
morningman May 30, 2024
3efab57
[fix](stats) Add synchronize for some analysis maps to avoid Concurre…
Jibing-Li May 30, 2024
8f264a7
[opt](nereids) compare str literal as date literal to compute selecti…
englefly May 30, 2024
34d27dd
[fix](mtmv) Fix get mv statistics plan wrong and optimize code usage …
seawinde May 30, 2024
fd23386
[fix](auth)fix simple auth check and default username (#35620)
wsjz May 30, 2024
0f7cc5f
[Bug](backend-options) fix use after free on BackendOptions::get_loca…
BiteTheDDDDt May 30, 2024
d458f1a
fix compile for jdk17
Doris-Extras May 30, 2024
64023c5
[fix](nereids) do not generate runtime filter on schema-scan (#35655)
englefly May 30, 2024
d6757e0
[fix](group commit) Group commit http stream should not begin txn (#3…
mymeiyi May 30, 2024
7b271f9
[branch-2.1](partial-update) duplicate key occurred when BE restart (…
zhannngchen May 31, 2024
11a5875
[fix](regression)Remove useless case which may cause preHeat npe. (#3…
Jibing-Li May 31, 2024
c2fc485
[fix](auto-partition) fix auto partition load lost data in multi send…
kaijchen May 31, 2024
885df89
[Nereids](Nereids): fix shape change in nereids regression test (#35488)
keanji-x May 31, 2024
14a17fd
[fix](test) fix mtmv case of drop index (#35697)
zddr May 31, 2024
514e957
[fix](mtmv) ignore MTMV when backup and restore (#35703)
zddr May 31, 2024
4414edd
[enhance](mtmv)Mv refresh on commit (#35702)
zddr May 31, 2024
f619e93
[enhance](auth) hive ranger support datamask (#35698)
zddr May 31, 2024
9c270e5
[fix](delete) Fix unrecognized column name delete handler (#32429) (#…
gavinchou May 31, 2024
9dc1196
[update](hudi) update hudi-spark bundle to 3.4.3 (#35013) (#35718)
AshinGau May 31, 2024
032a7a1
[fix](build) fix compile issue from #35702
morningman May 31, 2024
37d5631
[fix](mtmv)fix compile error (#35745)
zddr May 31, 2024
c5da3ea
[fix](decimal256) fix coredump when enable decimal256 but fallback to…
jacktengg May 31, 2024
48d4601
[regression-test](load) add something like $.tag.[a.b] key's json cas…
felixwluo May 31, 2024
5315df3
[opt](mtmv) Improve the mv rewrite performance by optimize code usag…
seawinde May 31, 2024
9468227
[Fix](tvf) Pass through user-defined properties (#35515) (#35747)
morningman May 31, 2024
b864aa7
[fix](pipeline) Fix query hang up if limited rows is reached (#35513)…
Gabriel39 May 31, 2024
1d89dd7
[fix](catalog) close connection on refresh (#35426) (#35743)
morningman May 31, 2024
bc062a2
[fix](orc)fix orc reader missing column. (#35735)
hubgeter May 31, 2024
cb96a79
[bugfix](iceberg)fix datetime conversion error and data path error (#…
wuwenchi May 31, 2024
2bad561
(Fix)[hive-writer] Fixed the issue when partition values contain spac…
kaka11chen May 31, 2024
9dd5738
[bugfix](stdcallonce) replace std callonce with a lock because it is …
yiguolei May 22, 2024
4e06f13
[fix](segment cache) estimate momory consumed by segment (#35647) (#3…
dataroaring Jun 1, 2024
d83c714
[branch-2.1](routine-load) adjusting the default configuration of rou…
sollhui Jun 1, 2024
8df1a3c
[Bug](load) fix s3 load not display the progress info (#35719)
zhangstar333 Jun 1, 2024
f67bd4b
[Fix](inverted index) fix fast execute condition for vexpr (#35673)
airborne12 Jun 1, 2024
bc95902
[fix](Nereids): Convert VarcharLiteral to StringLikeLiteral in Functi…
keanji-x Jun 1, 2024
2675014
[fix](s3) fix invalid s3 properties checking logic (#35757)
morningman Jun 1, 2024
75fd8c4
[fix](drop table) Improve error prompts when deleting materialized vi…
morningman Jun 1, 2024
72489a0
[cherry-pick](branch-2.1) remove some CHECKs in Tablet::revise_tablet…
zhannngchen Jun 1, 2024
e755d64
[feature](be jvm monitor)append enable_jvm_monitor in be.conf to cont…
morningman Jun 1, 2024
f03cee5
[enhancement](oom) add exception in olap data convertor when memory i…
yiguolei Jun 2, 2024
c033c71
[enhancement](cancel) add cancel query ability on be
Doris-Extras Jun 3, 2024
f25b7fb
[fix](binlog) Add is temp for UpsertRecord (#35774)
w41ter Jun 3, 2024
a086111
[improve](session) print more error msg when set a wrong session vari…
zhangstar333 Jun 3, 2024
d4956bf
do not use path style to access s3 (#35788)
Thearas Jun 3, 2024
4f0365e
[fix](s3) move s3 providers to fe-common to be accessible for jni rea…
AshinGau Jun 3, 2024
3e096dd
[Cherry-pick]Support kill query in be (#35794)
wangbo Jun 3, 2024
f80b856
[enhancement](oom) return error when bloom filter allocate memory fai…
yiguolei Jun 3, 2024
958687f
[fix](Nereids) unix_timestamp compute signature and fold const is wro…
morrySnow Jun 3, 2024
9cbf8cb
2.1.4-rc01
Doris-Extras Jun 3, 2024
940e26f
[feat](nereids) support Iceberg time travel syntax (#35812)
AshinGau Jun 3, 2024
ba0161c
Revert "[feature-wip](Cloud) Introduce azure core C++ sdk (#35208)" (…
ByteYue Jun 3, 2024
fe1a4c4
[Feature](IP) support ipv4/ipv6 with inverted index and conjuncts for…
Jun 3, 2024
398919d
2.1.4-rc02
Doris-Extras Jun 3, 2024
bc6b316
[chore](index) add config enable_create_bitmap_index_as_inverted_inde…
xiaokang Jun 4, 2024
c23ab25
[fix](nereids)keep equal predicate as join conjunct even if it can be…
starocean999 Jun 4, 2024
4b5163c
[Feat](nereids) add transform rule MergePercentileToArray (#35809)
feiniaofeiafei Jun 4, 2024
db3bbc2
[feature](merge-cloud) Change fe log rolling max size (#32777)
deardeng Mar 25, 2024
f94222a
[fix](log) Support fe log rollover size strategy (#34446)
deardeng May 9, 2024
5c8f87e
[opt](log) refine the FE logger (#35679)
morningman Jun 4, 2024
0585de1
[Improvement](coldhot) add statement to show objects which use storag…
Yulei-Yang Jun 4, 2024
5541fd1
[branch-2.1](partial update)add logs for partial update (#35416)
zhannngchen Jun 4, 2024
c2b830e
Pick "[Fix](Tablet) Fix the issue of redundant loading of stale rowse…
platoneko Jun 4, 2024
630fd06
Pick "[feature](Resource) Support to specify the root path for hdfs r…
ByteYue Jun 5, 2024
fdd87fe
[enhancement](delete-pred) enable delete sub predicate v2 for compact…
Hastyshell Jun 5, 2024
af31e96
[fix](storage_policy) fix cannot cancel a partition's storage policy …
Yulei-Yang Jun 5, 2024
bcde9c6
[enhancement](nereids)eliminate repeat node if there is only 1 groupi…
starocean999 Jun 5, 2024
efe1724
[Fix](inverted index) fix index_id wrong size in V2 (#35909)
airborne12 Jun 5, 2024
b5a35b9
[FIX] Pick array inverted index bugfix (#35837)
Jun 6, 2024
b6ab0c4
[fix](multi-catalog)fix hive partition insert regression case (#35846)
wsjz Jun 6, 2024
5cecbfc
[cherry-pick]Add workload metric query_be_memory (#35911)
wangbo Jun 6, 2024
104fcea
[fix](mtmv) mtmv disable dynamic partition (#35686) (#35949)
morningman Jun 6, 2024
cd808c3
[fix](mtmv) Fix that the storage medium specified for the mtmv is SSD…
zddr Jun 6, 2024
726377a
[bugfix](hive)fix the error message when creating hive table for 2.1 …
wuwenchi Jun 6, 2024
85328d4
[branch-2.1](test) comment out avro cases (#35963)
morningman Jun 6, 2024
fedb7e1
[fix](statistics) NPE when drop partition during publish (pick #35475…
freemandealer Jun 6, 2024
1d5b7cb
[fix](branch-2.1)(jdbc catalog) fix mariadb test conf port (#35982)
zy-kkk Jun 6, 2024
bec486e
1
wsjz May 26, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
6 changes: 0 additions & 6 deletions .asf.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -52,15 +52,12 @@ github:
- Clang Formatter
- CheckStyle
- P0 Regression (Doris Regression)
- P0 Regression PipelineX (Doris Regression)
- P1 Regression (Doris Regression)
- External Regression (Doris External Regression)
- FE UT (Doris FE UT)
- BE UT (Doris BE UT)
- Build Broker
- Build Documents
- ShellCheck
- clickbench-new (clickbench)
- Build Third Party Libraries (Linux)
- Build Third Party Libraries (macOS)
- COMPILE (DORIS_COMPILE)
Expand Down Expand Up @@ -95,8 +92,6 @@ github:
- BE UT (Doris BE UT)
- Build Broker
- ShellCheck
- Build Documents
- clickbench-new (clickbench)
- Build Third Party Libraries (Linux)
- Build Third Party Libraries (macOS)
- COMPILE (DORIS_COMPILE)
Expand All @@ -109,7 +104,6 @@ github:
- LemonLiTree
- Yukang-Lian
- TangSiyang2001
- platoneko
- Lchangliang
- freemandealer
- shuke987
Expand Down
17 changes: 11 additions & 6 deletions .clang-tidy
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,10 @@ Checks: |
clang-diagnostic-*,
clang-analyzer-*,
bugprone-redundant-branch-condition,
bugprone-use-after-move,
bugprone-bool-pointer-implicit-conversion,
bugprone-unused-raii,
bugprone-fold-init-type,
modernize-*,
-modernize-use-trailing-return-type,
-modernize-use-nodiscard,
Expand All @@ -19,15 +23,16 @@ Checks: |
-readability-inconsistent-declaration-parameter-name,
-readability-isolate-declaration,
-readability-named-parameter,
-readability-avoid-const-params-in-decls,
-readability-convert-member-functions-to-static,
portability-simd-intrinsics,
performance-type-promotion-in-math-fn,
performance-faster-string-find,
performance-inefficient-algorithm,
performance-move-const-arg
WarningsAsErrors: '*'
WarningsAsErrors: "*"
CheckOptions:
- key: readability-function-size.LineThreshold
value: '80'
- key: readability-function-cognitive-complexity.Threshold
value: '50'

- key: readability-function-size.LineThreshold
value: "80"
- key: readability-function-cognitive-complexity.Threshold
value: "50"
4 changes: 0 additions & 4 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,3 @@ Issue Number: close #xxx

<!--Describe your changes.-->

## Further comments

If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...

1 change: 0 additions & 1 deletion .github/actions/create-or-update-comment
Submodule create-or-update-comment deleted from 23ff15
40 changes: 0 additions & 40 deletions .github/workflows/auto-pr-reply.yml

This file was deleted.

4 changes: 3 additions & 1 deletion .github/workflows/build-thirdparty.yml
Original file line number Diff line number Diff line change
Expand Up @@ -166,10 +166,12 @@ jobs:
'llvm@16'
)

brew install "${packages[@]}"
brew install "${packages[@]}" || true

- name: Build
run: |
export MACOSX_DEPLOYMENT_TARGET=12.0

cd thirdparty
./build-thirdparty.sh -j "$(nproc)"

68 changes: 25 additions & 43 deletions .github/workflows/comment-to-trigger-teamcity.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,9 +45,7 @@ jobs:
"${COMMENT_BODY}" == *'run p1'* ||
"${COMMENT_BODY}" == *'run external'* ||
"${COMMENT_BODY}" == *'run pipelinex_p0'* ||
"${COMMENT_BODY}" == *'run clickbench'* ||
"${COMMENT_BODY}" == *'run arm'* ||
"${COMMENT_BODY}" == *'run tpch'* ||
"${COMMENT_BODY}" == *'run performance'* ]]; then
echo "comment_trigger=true" | tee -a "$GITHUB_OUTPUT"
else
Expand All @@ -64,7 +62,7 @@ jobs:
echo "TARGET_BRANCH='${TARGET_BRANCH}'" | tee -a "$GITHUB_OUTPUT"
echo "COMMENT_BODY='${COMMENT_BODY}'" | tee -a "$GITHUB_OUTPUT"

reg="run (buildall|compile|p0|p1|feut|beut|external|clickbench|pipelinex_p0|arm|tpch|performance)( [1-9]*[0-9]+)*"
reg="run (buildall|compile|p0|p1|feut|beut|external|pipelinex_p0|arm|performance)( [1-9]*[0-9]+)*"
COMMENT_TRIGGER_TYPE="$(echo -e "${COMMENT_BODY}" | xargs | grep -E "${reg}" | awk -F' ' '{print $2}' | sed -n 1p | sed 's/\r//g')"
COMMENT_REPEAT_TIMES="$(echo -e "${COMMENT_BODY}" | xargs | grep -E "${reg}" | awk -F' ' '{print $3}' | sed -n 1p | sed 's/\r//g')"
echo "COMMENT_TRIGGER_TYPE=${COMMENT_TRIGGER_TYPE}" | tee -a "$GITHUB_OUTPUT"
Expand All @@ -91,13 +89,6 @@ jobs:
else
echo "changed_be_ut=false" | tee -a "$GITHUB_OUTPUT"
fi
if file_changed_ckb; then
echo "changed_ckb=true" | tee -a "$GITHUB_OUTPUT"
echo "changed_tpch=true" | tee -a "$GITHUB_OUTPUT"
else
echo "changed_ckb=false" | tee -a "$GITHUB_OUTPUT"
echo "changed_tpch=false" | tee -a "$GITHUB_OUTPUT"
fi
if file_changed_regression_p0; then
echo "changed_p0=true" | tee -a "$GITHUB_OUTPUT"
echo "changed_external=true" | tee -a "$GITHUB_OUTPUT"
Expand All @@ -123,8 +114,6 @@ jobs:
echo "INFO: failed to _get_pr_changed_files, default trigger all"
echo "changed_fe_ut=true" | tee -a "$GITHUB_OUTPUT"
echo "changed_be_ut=true" | tee -a "$GITHUB_OUTPUT"
echo "changed_ckb=true" | tee -a "$GITHUB_OUTPUT"
echo "changed_tpch=true" | tee -a "$GITHUB_OUTPUT"
echo "changed_p0=true" | tee -a "$GITHUB_OUTPUT"
echo "changed_external=true" | tee -a "$GITHUB_OUTPUT"
echo "changed_pipelinex_p0=true" | tee -a "$GITHUB_OUTPUT"
Expand Down Expand Up @@ -167,8 +156,13 @@ jobs:
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
set -x
if [[ "${{ steps.changes.outputs.changed_p0 }}" == "true" ]] || [[ "${{ steps.changes.outputs.changed_cloud_p0 }}" == "true" ]]; then
changed="true"
else
changed="false"
fi
trigger_or_skip_build \
"${{ steps.changes.outputs.changed_p0 }}" \
"${changed}" \
"${{ steps.parse.outputs.PULL_REQUEST_NUM }}" \
"${{ steps.parse.outputs.COMMIT_ID_FROM_TRIGGER }}" \
"compile" \
Expand Down Expand Up @@ -247,52 +241,40 @@ jobs:
"arm" \
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip clickbench"
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["clickbench", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
set -x
trigger_or_skip_build \
"${{ steps.changes.outputs.changed_ckb }}" \
"${{ steps.parse.outputs.PULL_REQUEST_NUM }}" \
"${{ steps.parse.outputs.COMMIT_ID_FROM_TRIGGER }}" \
"clickbench" \
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip tpch"
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["tpch", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
if [[ ${{ steps.parse.outputs.COMMENT_TRIGGER_TYPE }} == "buildall" ]]; then
echo "COMMENT_TRIGGER_TYPE is buildall, trigger clickbench is enough, clickbench will trigger tpch" && exit
fi
set -x
trigger_or_skip_build \
"${{ steps.changes.outputs.changed_tpch }}" \
"${{ steps.parse.outputs.PULL_REQUEST_NUM }}" \
"${{ steps.parse.outputs.COMMIT_ID_FROM_TRIGGER }}" \
"tpch" \
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip performance"
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["performance", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
set -x
if [[ "${{ steps.parse.outputs.TARGET_BRANCH }}" == "'master'" ]]; then
echo "PR target branch is master, need run performance"
if [[ "${{ steps.parse.outputs.TARGET_BRANCH }}" == "'master'" ||
"${{ steps.parse.outputs.TARGET_BRANCH }}" == "'branch-2.0'" ]]; then
echo "PR target branch in (master, branch-2.0), need run performance"
trigger_or_skip_build \
"${{ steps.changes.outputs.changed_performance }}" \
"${{ steps.parse.outputs.PULL_REQUEST_NUM }}" \
"${{ steps.parse.outputs.COMMIT_ID_FROM_TRIGGER }}" \
"performance" \
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

trigger_or_skip_build \
"${{ steps.changes.outputs.changed_performance }}" \
"${{ steps.parse.outputs.PULL_REQUEST_NUM }}" \
"${{ steps.parse.outputs.COMMIT_ID_FROM_TRIGGER }}" \
"perf" \
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"
else
echo "PR target branch is not master, skip run performance"
echo "PR target branch not in (master, branch-2.0), skip run performance"
trigger_or_skip_build \
"false" \
"${{ steps.parse.outputs.PULL_REQUEST_NUM }}" \
"${{ steps.parse.outputs.COMMIT_ID_FROM_TRIGGER }}" \
"performance" \
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

trigger_or_skip_build \
"false" \
"${{ steps.parse.outputs.PULL_REQUEST_NUM }}" \
"${{ steps.parse.outputs.COMMIT_ID_FROM_TRIGGER }}" \
"perf" \
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"
fi
51 changes: 17 additions & 34 deletions .github/workflows/pr-approve-status.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,42 +19,25 @@ name: Need_2_Approval

on:
pull_request_review:
types: [submitted]
types: [ submitted ]

jobs:
Need_2_Approval:
runs-on: ubuntu-latest
timeout-minutes: 3
timeout-minutes: 5
steps:
- uses: actions/checkout@v3
- run: |
pr_num=${{ github.event.pull_request.number }}
echo $pr_num
if [ -z "$pr_num" ]; then
echo "PR number is not set"
exit 1
fi
response=$(curl -s -H "Authorization: token ${{ secrets.GITHUB_TOKEN }} " "https://api.github.com/repos/apache/doris/pulls/${pr_num}/reviews?per_page=100")
# shellcheck disable=SC2207
reviewers=($(echo $response | jq -r '.[] | .user.login'))
# shellcheck disable=SC2207
statuses=($(echo $response | jq -r '.[] | .state'))
echo "${reviewers[@]}"
echo "${statuses[@]}"
approves=()
reviewers_unique=()
for ((i=${#reviewers[@]}-1;i>=0;i--)); do
if ! echo "${reviewers_unique[@]}" | grep -q -w "${reviewers[$i]}" && [ "${statuses[$i]}" != "COMMENTED" ]; then
reviewers_unique+=( "${reviewers[$i]}" )
if [ "${statuses[$i]}" == "APPROVED" ]; then
approves+=( "${reviewers[$i]}" )
fi
fi
done
echo "${approves[@]}"
if [ ${#approves[@]} -lt 2 ]; then
echo "PR ${pr_num} has not been approved by at least 2 reviewers"
# shellcheck disable=SC2242
exit 1
fi
echo "Thanks for your contribution to Doris."
exit 0
- name: Install Python dependencies
uses: actions/setup-python@v5
with:
python-version: '3.10' # Adjust if needed
- name: Install match library
run: |
pip install --upgrade pip
pip install match
pip install requests
- name: Run Python script
run: |
python tools/maintainers/check_review.py ${{ github.event.pull_request.number }} ${{secrets.GITHUB_TOKEN}}
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -54,6 +54,8 @@ thirdparty/installed*
thirdparty/doris-thirdparty*.tar.xz

docker/thirdparties/docker-compose/mysql/data
docker/thirdparties/docker-compose/hive/scripts/tpch1.db/
docker/thirdparties/docker-compose/hive/scripts/paimon1

fe_plugins/output
fe_plugins/**/.factorypath
Expand All @@ -79,6 +81,7 @@ samples/doris-demo/remote-udf-cpp-demo/function_server_demo

# FE
fe/mocked/
fe/gen/
fe/fe-core/gen/
fe/fe-core/src/main/resources/static/
fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisLexer.tokens
Expand Down
3 changes: 0 additions & 3 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,3 @@
path = be/src/clucene
url = https://github.com/apache/doris-thirdparty.git
branch = clucene
[submodule ".github/actions/create-or-update-comment"]
path = .github/actions/create-or-update-comment
url = https://github.com/peter-evans/create-or-update-comment.git
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,9 +35,9 @@ Apache Doris is an easy-to-use, high-performance and real-time analytical databa

All this makes Apache Doris an ideal tool for scenarios including report analysis, ad-hoc query, unified data warehouse, and data lake query acceleration. On Apache Doris, users can build various applications, such as user behavior analysis, AB test platform, log retrieval analysis, user portrait analysis, and order analysis.

🎉 Version 2.0.3 released now. Check out the 🔗[Release Notes](https://doris.apache.org/docs/dev/releasenotes/release-2.0.3) here. The 2.0 version has achieved over 10x performance improvements on standard Benchmark, comprehensive enhancement in log analysis and lakehouse scenarios, more efficient and stable data update and write efficiency, support for more comprehensive multi-tenant and resource isolation mechanisms, and take a new step in the direction of resource elasticity and storage computing separation. It has also been added a series of usability features for enterprise users. We welcome all users who have requirements for the new features of the 2.0 version to deploy and upgrade.
🎉 Version 2.1.0 released now. Check out the 🔗[Release Notes](https://doris.apache.org/docs/releasenotes/release-2.1.0) here. The 2.1 verison delivers exceptional performance with 100% higher out-of-the-box queries proven by TPC-DS 1TB tests, enhanced data lake analytics that are 4-6 times speedier than Trino and Spark, solid support for semi-structured data analysis with new Variant types and suite of analytical functions, asynchronous materialized views for query acceleration, optimized real-time writing at scale, and better workload management with stability and runtime SQL resource tracking.

🎉 Version 1.2.7 released now! It is fully evolved release and all users are encouraged to upgrade to this release. Check out the 🔗[Release Notes](https://doris.apache.org/docs/releasenotes/release-1.2.7) here.
🎉 Version 2.0.6 is now released ! This fully evolved and stable release is ready for all users to upgrade. Check out the 🔗[Release Notes](https://doris.apache.org/docs/releasenotes/release-2.0.6) here.

👀 Have a look at the 🔗[Official Website](https://doris.apache.org/) for a comprehensive list of Apache Doris's core features, blogs and user cases.

Expand Down Expand Up @@ -151,13 +151,13 @@ Apache Doris now has a wide user base in China and around the world, and as of t

The users of Apache Doris: 🔗[Users](https://doris.apache.org/users)

Add your company logo at Apache Doris Website: 🔗[Add Your Company](https://github.com/apache/doris/issues/10229)
Add your company logo at Apache Doris Website: 🔗[Add Your Company](https://github.com/apache/doris/discussions/27683)

## 👣 Get Started

### 📚 Docs

All Documentation 🔗[Docs](https://doris.apache.org/docs/dev/get-starting/)
All Documentation 🔗[Docs](https://doris.apache.org/docs/get-starting/quick-start)

### ⬇️ Download

Expand Down
Loading