Skip to content

[fix](cloud) ensure afterCommit/afterAbort will always be called when commit/abort transaction fails#41267

Merged
liaoxin01 merged 1 commit intoapache:masterfrom
sollhui:cloud_rl_stuck
Sep 28, 2024
Merged

[fix](cloud) ensure afterCommit/afterAbort will always be called when commit/abort transaction fails#41267
liaoxin01 merged 1 commit intoapache:masterfrom
sollhui:cloud_rl_stuck

Conversation

@sollhui
Copy link
Copy Markdown
Contributor

@sollhui sollhui commented Sep 25, 2024

Ensure afterCommit/afterAbort will always be called when commit/abort transaction fails. Otherwise, it may cause some problems, such as the routing load getting stuck.

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 25, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 25, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 25, 2024

TPC-H: Total hot run time: 41066 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 74846959f71e699c1bf6dd0f072861aa8b64ae17, data reload: false

------ Round 1 ----------------------------------
q1	17590	7344	7262	7262
q2	2027	291	285	285
q3	12189	1033	1211	1033
q4	10578	687	751	687
q5	7768	2904	2767	2767
q6	241	149	148	148
q7	980	615	603	603
q8	9349	1923	1967	1923
q9	6579	6457	6385	6385
q10	7983	2360	2322	2322
q11	440	252	246	246
q12	407	222	220	220
q13	17778	3001	3040	3001
q14	254	217	218	217
q15	593	540	523	523
q16	675	616	590	590
q17	973	570	536	536
q18	7281	6761	6843	6761
q19	1405	1008	1017	1008
q20	585	284	278	278
q21	3954	3309	3267	3267
q22	1104	1004	1012	1004
Total cold run time: 110733 ms
Total hot run time: 41066 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7325	7266	7298	7266
q2	346	244	258	244
q3	3201	3065	3069	3065
q4	2080	1901	1881	1881
q5	5854	5851	5913	5851
q6	230	148	150	148
q7	2325	1886	1887	1886
q8	3404	3481	3499	3481
q9	8987	9054	8878	8878
q10	3664	3495	3570	3495
q11	577	483	472	472
q12	845	630	603	603
q13	14155	3179	3187	3179
q14	309	272	289	272
q15	579	529	521	521
q16	708	671	656	656
q17	1828	1615	1617	1615
q18	8284	7766	7929	7766
q19	1711	1515	1549	1515
q20	2097	1910	1889	1889
q21	5623	5130	5258	5130
q22	1204	1045	1022	1022
Total cold run time: 75336 ms
Total hot run time: 60835 ms

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 25, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 25, 2024

TPC-H: Total hot run time: 41279 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a7edc86be1fd28fdd29a99414041d024b005a5be, data reload: false

------ Round 1 ----------------------------------
q1	17575	7383	7253	7253
q2	2055	155	161	155
q3	10587	1173	1180	1173
q4	10221	764	767	764
q5	7776	2889	2824	2824
q6	237	150	149	149
q7	975	632	603	603
q8	9339	1980	1992	1980
q9	6663	6508	6433	6433
q10	7033	2315	2357	2315
q11	448	240	244	240
q12	510	226	221	221
q13	17831	3018	3011	3011
q14	253	218	221	218
q15	570	523	524	523
q16	679	613	624	613
q17	1010	526	532	526
q18	7174	6759	6777	6759
q19	1386	1018	1137	1018
q20	579	285	305	285
q21	3988	3246	3211	3211
q22	1114	1005	1050	1005
Total cold run time: 108003 ms
Total hot run time: 41279 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7284	7255	7200	7200
q2	330	225	233	225
q3	2935	2738	2790	2738
q4	1968	1714	1763	1714
q5	5408	5476	5525	5476
q6	230	139	140	139
q7	2136	1695	1707	1695
q8	3286	3401	3414	3401
q9	8589	8532	8530	8530
q10	3485	3436	3454	3436
q11	590	491	479	479
q12	775	595	602	595
q13	10895	2988	3029	2988
q14	290	262	258	258
q15	567	501	502	501
q16	724	657	657	657
q17	1805	1578	1542	1542
q18	7834	7450	7332	7332
q19	1653	1551	1297	1297
q20	2001	1835	1818	1818
q21	5456	5199	5229	5199
q22	1138	1013	1055	1013
Total cold run time: 69379 ms
Total hot run time: 58233 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 25, 2024

TPC-DS: Total hot run time: 191939 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a7edc86be1fd28fdd29a99414041d024b005a5be, data reload: false

query1	953	375	367	367
query2	6426	2132	2059	2059
query3	5697	219	227	219
query4	33392	23361	23553	23361
query5	3987	479	469	469
query6	241	174	162	162
query7	4327	316	319	316
query8	298	215	233	215
query9	9079	2647	2636	2636
query10	424	288	273	273
query11	17310	15165	15266	15165
query12	161	102	107	102
query13	1573	432	414	414
query14	9714	7406	7437	7406
query15	308	176	179	176
query16	8081	471	480	471
query17	987	569	566	566
query18	2122	316	320	316
query19	210	147	150	147
query20	118	107	108	107
query21	218	108	103	103
query22	4827	4476	4488	4476
query23	34981	34074	34092	34074
query24	11480	2922	2877	2877
query25	693	404	403	403
query26	1808	166	172	166
query27	2681	294	300	294
query28	8139	2459	2458	2458
query29	1031	430	448	430
query30	327	162	161	161
query31	1045	814	835	814
query32	98	65	68	65
query33	766	307	296	296
query34	996	504	495	495
query35	899	714	722	714
query36	1078	964	972	964
query37	197	91	85	85
query38	4019	3883	3849	3849
query39	1498	1401	1420	1401
query40	287	105	99	99
query41	52	51	51	51
query42	122	96	99	96
query43	515	473	487	473
query44	1243	836	805	805
query45	196	169	177	169
query46	1149	735	737	735
query47	1961	1870	1859	1859
query48	475	384	374	374
query49	1261	425	414	414
query50	817	425	432	425
query51	7068	6998	6833	6833
query52	102	90	91	90
query53	264	188	187	187
query54	1051	478	482	478
query55	80	80	81	80
query56	289	273	273	273
query57	1263	1110	1111	1110
query58	269	246	250	246
query59	3091	2925	2994	2925
query60	305	276	278	276
query61	128	122	126	122
query62	874	681	670	670
query63	234	194	194	194
query64	5192	662	618	618
query65	3265	3202	3187	3187
query66	1411	305	305	305
query67	16132	15722	15497	15497
query68	4512	584	577	577
query69	581	296	296	296
query70	1168	1132	1120	1120
query71	349	271	280	271
query72	7421	4130	4034	4034
query73	763	349	357	349
query74	10320	9046	9008	9008
query75	3557	2668	2656	2656
query76	3147	990	881	881
query77	662	308	291	291
query78	10035	9376	9307	9307
query79	2094	589	602	589
query80	1050	458	439	439
query81	572	244	246	244
query82	700	133	147	133
query83	326	134	137	134
query84	290	86	91	86
query85	2046	300	279	279
query86	462	296	301	296
query87	4474	4244	4310	4244
query88	3776	2450	2371	2371
query89	406	285	291	285
query90	2068	194	190	190
query91	195	158	142	142
query92	64	51	52	51
query93	1724	570	547	547
query94	1051	299	287	287
query95	360	256	257	256
query96	605	289	291	289
query97	3291	3169	3134	3134
query98	216	195	192	192
query99	1565	1298	1301	1298
Total cold run time: 301135 ms
Total hot run time: 191939 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 25, 2024

ClickBench: Total hot run time: 32.63 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a7edc86be1fd28fdd29a99414041d024b005a5be, data reload: false

query1	0.05	0.05	0.04
query2	0.07	0.03	0.03
query3	0.22	0.07	0.06
query4	1.64	0.11	0.10
query5	0.51	0.52	0.51
query6	1.13	0.73	0.73
query7	0.02	0.01	0.03
query8	0.04	0.03	0.02
query9	0.56	0.51	0.50
query10	0.54	0.58	0.55
query11	0.13	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	3.01	2.94	3.01
query15	0.91	0.83	0.83
query16	0.39	0.38	0.36
query17	1.05	1.07	1.01
query18	0.19	0.20	0.20
query19	1.98	1.88	2.01
query20	0.01	0.01	0.01
query21	15.35	0.61	0.57
query22	2.52	1.91	1.72
query23	17.47	0.80	0.91
query24	2.50	0.96	1.55
query25	0.29	0.11	0.04
query26	0.38	0.13	0.12
query27	0.04	0.05	0.05
query28	10.66	1.10	1.07
query29	12.61	3.21	3.19
query30	0.27	0.06	0.07
query31	2.86	0.38	0.38
query32	3.26	0.47	0.46
query33	2.98	2.95	3.04
query34	17.31	4.44	4.50
query35	4.49	4.45	4.47
query36	0.69	0.50	0.49
query37	0.08	0.06	0.05
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.35 s
Total hot run time: 32.63 s

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 25, 2024

run buildall

liaoxin01
liaoxin01 reviewed Sep 25, 2024
View reviewed changes
Comment thread fe/fe-core/src/main/java/org/apache/doris/cloud/transaction/CloudGlobalTransactionMgr.java Outdated
Comment thread fe/fe-core/src/main/java/org/apache/doris/cloud/transaction/CloudGlobalTransactionMgr.java Outdated
Comment thread fe/fe-core/src/main/java/org/apache/doris/cloud/transaction/CloudGlobalTransactionMgr.java Outdated
@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 25, 2024

TPC-H: Total hot run time: 40904 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cd130d8463227463036329c53626b546b8b3501b, data reload: false

------ Round 1 ----------------------------------
q1	17585	7418	7270	7270
q2	2016	279	268	268
q3	12187	1053	1132	1053
q4	10575	725	778	725
q5	7749	2875	2833	2833
q6	236	153	154	153
q7	977	613	599	599
q8	9373	1908	1932	1908
q9	6571	6425	6383	6383
q10	6988	2278	2330	2278
q11	435	250	244	244
q12	413	218	225	218
q13	17796	2974	3001	2974
q14	250	211	219	211
q15	579	540	532	532
q16	663	606	606	606
q17	969	584	566	566
q18	7777	6597	6758	6597
q19	1399	983	979	979
q20	602	282	273	273
q21	4071	3373	3229	3229
q22	1097	1021	1005	1005
Total cold run time: 110308 ms
Total hot run time: 40904 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7350	7362	7305	7305
q2	330	240	229	229
q3	3043	2977	2943	2943
q4	2082	1875	1840	1840
q5	5724	5693	5775	5693
q6	234	153	151	151
q7	2250	1815	1856	1815
q8	3446	3654	3623	3623
q9	9183	9340	9297	9297
q10	3636	3601	3647	3601
q11	591	489	491	489
q12	842	649	648	648
q13	14744	3180	3135	3135
q14	322	282	299	282
q15	596	520	565	520
q16	701	694	666	666
q17	1847	1623	1644	1623
q18	8310	7835	7891	7835
q19	1720	1511	1568	1511
q20	2092	1905	1881	1881
q21	5631	5244	5466	5244
q22	1133	1042	1020	1020
Total cold run time: 75807 ms
Total hot run time: 61351 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 25, 2024

TPC-DS: Total hot run time: 192368 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cd130d8463227463036329c53626b546b8b3501b, data reload: false

query1	939	380	372	372
query2	6414	2035	1980	1980
query3	8684	195	203	195
query4	34143	23366	23441	23366
query5	3599	473	466	466
query6	295	160	159	159
query7	4203	301	302	301
query8	285	214	221	214
query9	9446	2658	2653	2653
query10	451	269	271	269
query11	17975	15236	15190	15190
query12	153	97	103	97
query13	1530	435	408	408
query14	9716	7366	7386	7366
query15	268	172	177	172
query16	7927	459	473	459
query17	1683	619	582	582
query18	2172	329	334	329
query19	361	156	156	156
query20	120	110	116	110
query21	212	115	107	107
query22	4755	4558	4652	4558
query23	35355	34492	34445	34445
query24	11351	2899	2861	2861
query25	620	406	426	406
query26	1255	159	165	159
query27	2528	288	307	288
query28	7829	2447	2441	2441
query29	848	431	434	431
query30	254	156	164	156
query31	998	815	785	785
query32	93	53	58	53
query33	753	296	305	296
query34	916	491	486	486
query35	904	737	741	737
query36	1108	948	949	948
query37	153	86	91	86
query38	4049	3923	3949	3923
query39	1474	1456	1419	1419
query40	253	97	96	96
query41	50	47	48	47
query42	119	96	94	94
query43	533	479	488	479
query44	1184	812	792	792
query45	199	164	163	163
query46	1138	722	711	711
query47	1951	1814	1862	1814
query48	464	370	365	365
query49	897	428	410	410
query50	808	414	403	403
query51	7046	6917	6952	6917
query52	96	85	87	85
query53	251	181	178	178
query54	1030	456	457	456
query55	77	72	76	72
query56	278	277	256	256
query57	1252	1114	1105	1105
query58	228	219	225	219
query59	3125	2851	2934	2851
query60	287	275	280	275
query61	104	101	103	101
query62	847	670	663	663
query63	223	190	183	183
query64	4138	659	655	655
query65	3281	3197	3211	3197
query66	1180	308	302	302
query67	15961	15598	15586	15586
query68	5120	547	553	547
query69	632	291	289	289
query70	1140	1115	1151	1115
query71	427	301	267	267
query72	7769	4004	3995	3995
query73	758	333	341	333
query74	10629	9002	9101	9002
query75	4482	2687	2637	2637
query76	3666	890	882	882
query77	758	295	311	295
query78	10032	9597	9562	9562
query79	2327	594	621	594
query80	1004	438	455	438
query81	561	243	242	242
query82	582	144	138	138
query83	373	134	144	134
query84	293	86	76	76
query85	1361	289	283	283
query86	416	307	292	292
query87	4447	4416	4341	4341
query88	3510	2418	2374	2374
query89	403	287	287	287
query90	2146	187	188	187
query91	183	141	142	141
query92	60	50	49	49
query93	1918	531	538	531
query94	1084	292	306	292
query95	359	254	255	254
query96	613	279	281	279
query97	3262	3201	3115	3115
query98	222	204	194	194
query99	1635	1299	1314	1299
Total cold run time: 304991 ms
Total hot run time: 192368 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 25, 2024

ClickBench: Total hot run time: 32.06 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cd130d8463227463036329c53626b546b8b3501b, data reload: false

query1	0.05	0.05	0.04
query2	0.06	0.03	0.04
query3	0.23	0.06	0.06
query4	1.65	0.10	0.10
query5	0.52	0.50	0.51
query6	1.14	0.72	0.71
query7	0.02	0.03	0.02
query8	0.03	0.03	0.03
query9	0.56	0.51	0.48
query10	0.54	0.58	0.55
query11	0.13	0.10	0.10
query12	0.13	0.10	0.11
query13	0.61	0.60	0.60
query14	3.08	2.92	2.96
query15	0.91	0.81	0.83
query16	0.38	0.41	0.39
query17	1.06	1.05	1.04
query18	0.20	0.20	0.19
query19	1.84	1.74	2.02
query20	0.01	0.01	0.02
query21	15.36	0.59	0.59
query22	2.74	1.69	1.32
query23	17.11	0.88	0.76
query24	3.43	0.86	0.73
query25	0.23	0.15	0.07
query26	0.42	0.15	0.14
query27	0.04	0.05	0.03
query28	10.90	1.09	1.08
query29	12.54	3.27	3.26
query30	0.24	0.05	0.06
query31	2.89	0.38	0.38
query32	3.26	0.47	0.47
query33	2.99	3.01	3.07
query34	16.87	4.48	4.52
query35	4.52	4.50	4.50
query36	0.67	0.48	0.47
query37	0.08	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.15	0.14	0.13
query41	0.08	0.01	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.81 s
Total hot run time: 32.06 s

@sollhui sollhui marked this pull request as draft September 25, 2024 09:07
@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 26, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 26, 2024

TPC-H: Total hot run time: 40855 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 57a7df1ba50b2511d5d29646c1c1da00df5f7af2, data reload: false

------ Round 1 ----------------------------------
q1	17593	7340	7274	7274
q2	2022	282	264	264
q3	12128	1086	1148	1086
q4	10573	759	746	746
q5	7752	2845	2757	2757
q6	241	155	154	154
q7	989	620	612	612
q8	9385	1964	1961	1961
q9	7545	6429	6380	6380
q10	6997	2294	2251	2251
q11	443	260	254	254
q12	408	226	218	218
q13	17792	2986	2983	2983
q14	233	220	218	218
q15	567	509	526	509
q16	676	602	602	602
q17	969	574	561	561
q18	7171	6557	6772	6557
q19	1399	1046	1058	1046
q20	462	212	202	202
q21	3956	3223	3349	3223
q22	1098	1004	997	997
Total cold run time: 110399 ms
Total hot run time: 40855 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7292	7237	7250	7237
q2	339	225	234	225
q3	3057	2951	2910	2910
q4	2076	1757	1850	1757
q5	5649	5634	5769	5634
q6	236	144	145	144
q7	2249	1836	1843	1836
q8	3384	3541	3475	3475
q9	8916	8982	8950	8950
q10	3553	3573	3582	3573
q11	589	478	499	478
q12	855	642	616	616
q13	10801	3183	3148	3148
q14	301	277	283	277
q15	563	534	520	520
q16	713	664	655	655
q17	1881	1639	1570	1570
q18	8241	7798	7927	7798
q19	1692	1600	1623	1600
q20	2157	1868	1928	1868
q21	5428	5478	5396	5396
q22	1169	1045	1038	1038
Total cold run time: 71141 ms
Total hot run time: 60705 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 26, 2024

TPC-DS: Total hot run time: 192589 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 57a7df1ba50b2511d5d29646c1c1da00df5f7af2, data reload: false

query1	960	387	384	384
query2	6176	2119	2034	2034
query3	8688	201	200	200
query4	33868	23392	23444	23392
query5	3577	452	456	452
query6	257	163	157	157
query7	4181	300	303	300
query8	276	216	211	211
query9	9473	2633	2635	2633
query10	455	278	284	278
query11	17835	15098	15135	15098
query12	154	99	103	99
query13	1536	438	412	412
query14	9563	7448	7610	7448
query15	247	174	178	174
query16	8084	444	469	444
query17	1699	619	601	601
query18	2173	321	319	319
query19	363	156	159	156
query20	122	111	111	111
query21	206	107	114	107
query22	4781	4542	4636	4542
query23	34910	34984	34396	34396
query24	11203	2999	2877	2877
query25	620	397	408	397
query26	1165	167	165	165
query27	2590	299	297	297
query28	7589	2449	2425	2425
query29	828	451	434	434
query30	258	157	154	154
query31	989	760	801	760
query32	98	53	56	53
query33	747	320	289	289
query34	903	494	514	494
query35	844	744	722	722
query36	1086	961	975	961
query37	158	88	86	86
query38	4007	3843	3907	3843
query39	1461	1416	1435	1416
query40	210	96	101	96
query41	53	48	53	48
query42	114	98	98	98
query43	543	496	475	475
query44	1227	814	795	795
query45	195	169	166	166
query46	1163	733	726	726
query47	1944	1838	1850	1838
query48	468	371	385	371
query49	868	428	428	428
query50	833	411	416	411
query51	7080	6957	6725	6725
query52	105	93	83	83
query53	257	197	175	175
query54	1125	465	465	465
query55	77	77	75	75
query56	279	261	250	250
query57	1223	1116	1112	1112
query58	225	232	268	232
query59	3310	3107	3150	3107
query60	280	272	269	269
query61	100	106	107	106
query62	833	649	687	649
query63	223	185	180	180
query64	4030	649	623	623
query65	3260	3200	3224	3200
query66	742	307	317	307
query67	16145	15647	15609	15609
query68	4523	562	558	558
query69	572	296	294	294
query70	1159	1128	1111	1111
query71	408	282	281	281
query72	7522	4090	4022	4022
query73	769	346	357	346
query74	10447	9131	9041	9041
query75	4561	2649	2691	2649
query76	3384	953	951	951
query77	730	301	287	287
query78	11451	10109	9541	9541
query79	3198	602	625	602
query80	2114	445	449	445
query81	590	238	235	235
query82	654	150	142	142
query83	305	141	137	137
query84	300	79	83	79
query85	1016	296	281	281
query86	492	295	258	258
query87	4449	4433	4323	4323
query88	3622	2436	2412	2412
query89	413	293	294	293
query90	2160	186	188	186
query91	177	145	140	140
query92	66	48	48	48
query93	2629	549	539	539
query94	1006	290	312	290
query95	357	253	258	253
query96	635	292	295	292
query97	3274	3146	3130	3130
query98	216	198	192	192
query99	1596	1322	1291	1291
Total cold run time: 305837 ms
Total hot run time: 192589 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 26, 2024

ClickBench: Total hot run time: 32.42 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 57a7df1ba50b2511d5d29646c1c1da00df5f7af2, data reload: false

query1	0.05	0.04	0.04
query2	0.06	0.02	0.03
query3	0.23	0.06	0.06
query4	1.64	0.10	0.10
query5	0.52	0.49	0.50
query6	1.13	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.02	0.03
query9	0.56	0.50	0.51
query10	0.55	0.58	0.55
query11	0.14	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.59	0.60
query14	2.94	2.97	2.99
query15	0.90	0.82	0.82
query16	0.38	0.39	0.38
query17	1.01	1.06	0.98
query18	0.20	0.19	0.19
query19	1.88	1.90	1.97
query20	0.01	0.01	0.01
query21	15.34	0.60	0.57
query22	2.47	2.36	1.58
query23	17.50	0.90	0.79
query24	2.89	0.75	0.79
query25	0.27	0.16	0.06
query26	0.37	0.14	0.13
query27	0.04	0.03	0.03
query28	11.02	1.09	1.07
query29	12.54	3.35	3.35
query30	0.24	0.06	0.07
query31	2.87	0.38	0.38
query32	3.27	0.47	0.46
query33	2.97	2.96	3.04
query34	17.12	4.52	4.42
query35	4.50	4.51	4.49
query36	0.68	0.47	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.14	0.12
query41	0.07	0.02	0.02
query42	0.02	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 107.53 s
Total hot run time: 32.42 s

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 26, 2024

run buildall

1 similar comment
@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 26, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 26, 2024

TPC-H: Total hot run time: 40606 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 64d5e60d078386aa63b6ff1c42958002b875cc44, data reload: false

------ Round 1 ----------------------------------
q1	17558	7360	7206	7206
q2	2041	282	266	266
q3	12248	1065	1152	1065
q4	10564	706	712	706
q5	7747	2906	2809	2809
q6	239	154	150	150
q7	976	604	599	599
q8	9557	1921	1959	1921
q9	7700	6428	6365	6365
q10	6998	2280	2295	2280
q11	450	248	243	243
q12	407	219	217	217
q13	17791	3003	3030	3003
q14	231	211	200	200
q15	577	532	518	518
q16	677	621	610	610
q17	963	508	544	508
q18	7104	6742	6712	6712
q19	1420	992	1072	992
q20	470	196	207	196
q21	4161	3066	3213	3066
q22	1076	974	985	974
Total cold run time: 110955 ms
Total hot run time: 40606 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7237	7239	7236	7236
q2	327	232	228	228
q3	3078	2949	2938	2938
q4	2070	1852	1800	1800
q5	5657	5652	5658	5652
q6	239	144	146	144
q7	2266	1850	1818	1818
q8	3377	3559	3510	3510
q9	8897	9083	9084	9083
q10	3569	3553	3526	3526
q11	590	502	497	497
q12	846	598	603	598
q13	7727	3163	3144	3144
q14	295	294	300	294
q15	571	546	519	519
q16	717	683	674	674
q17	1848	1636	1619	1619
q18	8274	7887	7885	7885
q19	1713	1585	1427	1427
q20	2112	1885	1879	1879
q21	5478	5179	5429	5179
q22	1108	1043	1060	1043
Total cold run time: 67996 ms
Total hot run time: 60693 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 26, 2024

TPC-DS: Total hot run time: 192900 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 64d5e60d078386aa63b6ff1c42958002b875cc44, data reload: false

query1	930	373	382	373
query2	6374	2060	2037	2037
query3	8724	199	206	199
query4	34599	23713	23413	23413
query5	3882	469	454	454
query6	288	171	159	159
query7	4188	308	300	300
query8	298	246	230	230
query9	9338	2678	2669	2669
query10	452	273	270	270
query11	17896	15245	15120	15120
query12	146	98	97	97
query13	1535	434	401	401
query14	9763	7644	7645	7644
query15	268	170	182	170
query16	8079	512	477	477
query17	1659	624	604	604
query18	2191	315	320	315
query19	356	171	163	163
query20	125	112	119	112
query21	214	107	106	106
query22	4678	4756	4425	4425
query23	36091	35320	34900	34900
query24	10987	2841	2916	2841
query25	531	405	411	405
query26	712	168	166	166
query27	2146	298	305	298
query28	7430	2490	2415	2415
query29	680	436	426	426
query30	257	155	162	155
query31	1027	750	810	750
query32	93	56	61	56
query33	753	302	298	298
query34	915	500	483	483
query35	881	794	717	717
query36	1112	955	943	943
query37	147	88	93	88
query38	4056	3941	4019	3941
query39	1484	1422	1434	1422
query40	223	96	98	96
query41	53	47	48	47
query42	121	95	98	95
query43	521	487	486	486
query44	1268	814	787	787
query45	197	171	168	168
query46	1147	723	718	718
query47	1913	1810	1873	1810
query48	454	373	371	371
query49	878	413	400	400
query50	833	414	434	414
query51	7187	6919	6747	6747
query52	96	88	88	88
query53	254	180	187	180
query54	1085	475	490	475
query55	77	76	79	76
query56	306	271	272	271
query57	1231	1098	1096	1096
query58	233	245	262	245
query59	3117	2986	2856	2856
query60	279	266	275	266
query61	103	101	102	101
query62	818	663	666	663
query63	229	185	185	185
query64	3895	640	628	628
query65	3252	3212	3209	3209
query66	702	302	308	302
query67	15950	15722	15654	15654
query68	4581	579	573	573
query69	590	292	300	292
query70	1187	1128	1064	1064
query71	419	284	278	278
query72	7832	4112	3793	3793
query73	762	340	341	340
query74	10220	8961	9180	8961
query75	4344	2694	2721	2694
query76	3994	943	917	917
query77	762	294	299	294
query78	10550	9653	9581	9581
query79	2776	602	626	602
query80	2551	461	462	461
query81	594	243	237	237
query82	661	146	142	142
query83	320	160	133	133
query84	301	85	73	73
query85	2103	293	298	293
query86	482	298	306	298
query87	4486	4445	4339	4339
query88	3760	2431	2409	2409
query89	420	295	288	288
query90	2090	189	187	187
query91	178	142	149	142
query92	66	48	49	48
query93	2220	553	547	547
query94	1091	302	311	302
query95	362	262	259	259
query96	620	281	291	281
query97	3236	3122	3125	3122
query98	217	195	195	195
query99	1534	1309	1279	1279
Total cold run time: 307016 ms
Total hot run time: 192900 ms

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 26, 2024

run buildall

@sollhui sollhui marked this pull request as ready for review September 26, 2024 08:07
@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 26, 2024

TPC-H: Total hot run time: 41089 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bb6db988296bba69bfeb96024e9a59beb29129e1, data reload: false

------ Round 1 ----------------------------------
q1	17572	7549	7259	7259
q2	2009	295	301	295
q3	12251	1096	1150	1096
q4	10569	712	771	712
q5	7766	2913	2904	2904
q6	241	154	155	154
q7	1002	628	619	619
q8	9390	1972	1999	1972
q9	6728	6487	6424	6424
q10	6969	2318	2337	2318
q11	443	249	252	249
q12	423	228	223	223
q13	17914	2988	2956	2956
q14	236	211	221	211
q15	577	529	511	511
q16	637	591	586	586
q17	997	590	625	590
q18	7350	6794	6635	6635
q19	1411	1040	1046	1040
q20	502	200	199	199
q21	4120	3405	3145	3145
q22	1123	991	1020	991
Total cold run time: 110230 ms
Total hot run time: 41089 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7318	7231	7250	7231
q2	334	241	232	232
q3	3071	2970	2934	2934
q4	2060	1799	1780	1780
q5	5657	5674	5716	5674
q6	233	153	149	149
q7	2205	1827	1812	1812
q8	3398	3569	3553	3553
q9	8946	9109	8981	8981
q10	3615	3572	3570	3570
q11	597	486	481	481
q12	855	596	606	596
q13	8766	3164	3156	3156
q14	305	289	280	280
q15	591	534	527	527
q16	700	668	637	637
q17	1841	1624	1613	1613
q18	8375	7772	7770	7770
q19	1770	1581	1571	1571
q20	2131	1895	1881	1881
q21	5651	5186	5453	5186
q22	1142	1073	1006	1006
Total cold run time: 69561 ms
Total hot run time: 60620 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 26, 2024

TPC-DS: Total hot run time: 191924 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bb6db988296bba69bfeb96024e9a59beb29129e1, data reload: false

query1	931	384	389	384
query2	6413	2124	2014	2014
query3	8687	193	201	193
query4	34041	23513	23475	23475
query5	3574	487	478	478
query6	273	172	168	168
query7	4188	316	314	314
query8	311	231	236	231
query9	9551	2694	2679	2679
query10	473	279	281	279
query11	17903	15108	15217	15108
query12	152	100	97	97
query13	1540	427	429	427
query14	9784	6961	6932	6932
query15	248	170	171	170
query16	8013	432	456	432
query17	1621	587	570	570
query18	2132	308	322	308
query19	252	160	150	150
query20	120	116	118	116
query21	214	111	104	104
query22	4702	4521	4592	4521
query23	35319	34546	34266	34266
query24	10806	2833	2906	2833
query25	593	399	401	399
query26	717	163	166	163
query27	2063	300	298	298
query28	6181	2459	2448	2448
query29	759	442	432	432
query30	270	157	162	157
query31	1045	779	813	779
query32	99	54	54	54
query33	668	305	300	300
query34	914	499	506	499
query35	888	753	715	715
query36	1113	945	959	945
query37	145	90	87	87
query38	4077	3856	3975	3856
query39	1464	1418	1423	1418
query40	203	98	99	98
query41	52	47	51	47
query42	121	97	102	97
query43	543	498	497	497
query44	1190	827	805	805
query45	196	166	168	166
query46	1170	727	697	697
query47	1949	1856	1850	1850
query48	461	365	370	365
query49	882	408	412	408
query50	816	431	411	411
query51	7061	6969	6862	6862
query52	103	91	87	87
query53	261	190	179	179
query54	1122	496	485	485
query55	83	78	79	78
query56	297	270	268	268
query57	1237	1120	1112	1112
query58	260	252	247	247
query59	3139	2937	3041	2937
query60	305	280	310	280
query61	106	109	111	109
query62	813	664	663	663
query63	228	184	192	184
query64	3816	672	623	623
query65	3276	3210	3182	3182
query66	766	302	310	302
query67	15823	15580	15624	15580
query68	4488	587	575	575
query69	581	296	295	295
query70	1203	1120	1135	1120
query71	423	269	270	269
query72	7633	4079	3964	3964
query73	790	347	354	347
query74	10374	9057	9034	9034
query75	4319	2648	2688	2648
query76	3465	997	851	851
query77	738	296	292	292
query78	10516	9652	9527	9527
query79	3076	608	606	606
query80	2666	466	447	447
query81	578	236	241	236
query82	686	144	139	139
query83	318	147	135	135
query84	290	88	81	81
query85	1572	297	287	287
query86	447	294	290	290
query87	4571	4397	4338	4338
query88	4103	2448	2397	2397
query89	417	292	287	287
query90	2075	189	184	184
query91	177	146	143	143
query92	59	49	48	48
query93	2697	559	549	549
query94	1103	294	276	276
query95	370	256	260	256
query96	646	282	284	282
query97	3230	3124	3162	3124
query98	231	205	198	198
query99	1596	1301	1281	1281
Total cold run time: 303961 ms
Total hot run time: 191924 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 26, 2024

ClickBench: Total hot run time: 32.25 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bb6db988296bba69bfeb96024e9a59beb29129e1, data reload: false

query1	0.05	0.05	0.04
query2	0.06	0.03	0.02
query3	0.23	0.06	0.06
query4	1.64	0.11	0.10
query5	0.58	0.51	0.50
query6	1.12	0.72	0.72
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.57	0.49	0.48
query10	0.54	0.57	0.54
query11	0.13	0.11	0.10
query12	0.13	0.10	0.10
query13	0.61	0.61	0.61
query14	2.82	2.82	2.74
query15	0.90	0.83	0.82
query16	0.43	0.37	0.40
query17	1.05	1.07	0.98
query18	0.19	0.20	0.20
query19	1.93	1.86	2.05
query20	0.01	0.00	0.01
query21	15.36	0.57	0.61
query22	2.62	2.86	1.58
query23	17.22	0.95	0.78
query24	2.51	1.02	0.85
query25	0.16	0.20	0.08
query26	0.46	0.14	0.14
query27	0.04	0.04	0.04
query28	11.39	1.09	1.08
query29	12.59	3.26	3.32
query30	0.26	0.06	0.06
query31	2.88	0.36	0.38
query32	3.29	0.47	0.47
query33	2.98	2.98	3.02
query34	16.97	4.46	4.46
query35	4.51	4.54	4.48
query36	0.66	0.49	0.49
query37	0.08	0.06	0.05
query38	0.04	0.03	0.04
query39	0.03	0.02	0.03
query40	0.15	0.12	0.13
query41	0.08	0.02	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.4 s
Total hot run time: 32.25 s

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 27, 2024

run buildall

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 27, 2024

run buildall

1 similar comment
@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 27, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

TPC-H: Total hot run time: 40924 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fe13566ee652e236af7824cc82ce08788a67b243, data reload: false

------ Round 1 ----------------------------------
q1	17928	7507	7351	7351
q2	2034	295	290	290
q3	11612	1091	1216	1091
q4	10540	715	697	697
q5	7756	2862	2703	2703
q6	239	153	149	149
q7	1015	653	613	613
q8	9357	1941	1944	1941
q9	6663	6445	6427	6427
q10	6997	2275	2329	2275
q11	439	260	249	249
q12	410	222	217	217
q13	17799	3007	2991	2991
q14	243	212	212	212
q15	578	523	519	519
q16	666	589	586	586
q17	994	560	600	560
q18	7319	6709	6770	6709
q19	1402	947	954	947
q20	490	201	202	201
q21	4231	3219	3193	3193
q22	1089	1003	1010	1003
Total cold run time: 109801 ms
Total hot run time: 40924 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7266	7212	7192	7192
q2	330	229	230	229
q3	3028	2942	2966	2942
q4	2075	1867	1745	1745
q5	5753	5721	5780	5721
q6	228	143	146	143
q7	2177	1825	1810	1810
q8	3383	3585	3485	3485
q9	8875	8855	8874	8855
q10	3581	3562	3531	3531
q11	587	481	490	481
q12	847	618	591	591
q13	8174	3185	3230	3185
q14	316	269	282	269
q15	595	530	543	530
q16	698	638	618	618
q17	1846	1612	1602	1602
q18	8230	7848	7560	7560
q19	1711	1424	1534	1424
q20	2103	1899	1904	1899
q21	5644	5433	5511	5433
q22	1122	1077	1080	1077
Total cold run time: 68569 ms
Total hot run time: 60322 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

TPC-DS: Total hot run time: 194635 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fe13566ee652e236af7824cc82ce08788a67b243, data reload: false

query1	938	419	423	419
query2	6269	2183	2091	2091
query3	8685	202	209	202
query4	33573	23817	23836	23817
query5	3419	473	460	460
query6	265	172	169	169
query7	4213	303	320	303
query8	304	233	236	233
query9	9513	2668	2662	2662
query10	453	284	295	284
query11	17932	15478	15637	15478
query12	160	105	102	102
query13	1542	420	418	418
query14	10002	7691	7754	7691
query15	249	174	177	174
query16	8126	503	520	503
query17	1632	606	568	568
query18	2177	331	332	331
query19	367	158	157	157
query20	122	129	119	119
query21	206	111	111	111
query22	4862	4668	4293	4293
query23	35348	34270	34609	34270
query24	11091	2997	2906	2906
query25	609	418	412	412
query26	1002	172	171	171
query27	2146	306	301	301
query28	7315	2417	2403	2403
query29	839	445	438	438
query30	328	166	167	166
query31	1034	810	793	793
query32	99	56	58	56
query33	768	313	304	304
query34	965	532	495	495
query35	892	734	725	725
query36	1133	953	975	953
query37	150	92	97	92
query38	4052	3931	3954	3931
query39	1501	1463	1458	1458
query40	217	102	101	101
query41	54	51	50	50
query42	120	98	103	98
query43	549	497	498	497
query44	1264	808	818	808
query45	197	164	173	164
query46	1145	758	703	703
query47	1953	1825	1832	1825
query48	470	384	372	372
query49	1002	419	411	411
query50	843	426	431	426
query51	7199	7057	7041	7041
query52	105	87	89	87
query53	257	187	189	187
query54	1255	484	486	484
query55	82	80	84	80
query56	308	280	273	273
query57	1230	1111	1097	1097
query58	247	254	295	254
query59	3427	3080	2972	2972
query60	330	302	302	302
query61	127	123	121	121
query62	902	690	663	663
query63	234	202	197	197
query64	3972	789	626	626
query65	3399	3258	3296	3258
query66	796	317	300	300
query67	15888	15782	15612	15612
query68	4439	569	587	569
query69	544	326	312	312
query70	1208	1048	1132	1048
query71	393	286	281	281
query72	7556	4274	4136	4136
query73	774	355	348	348
query74	10289	9075	9014	9014
query75	3778	2712	2750	2712
query76	3367	935	993	935
query77	665	302	300	300
query78	11010	9952	9770	9770
query79	3729	610	607	607
query80	2145	460	470	460
query81	619	263	266	263
query82	690	146	141	141
query83	322	138	144	138
query84	295	83	81	81
query85	2128	301	292	292
query86	475	305	316	305
query87	4489	4352	4372	4352
query88	4793	2394	2389	2389
query89	417	300	299	299
query90	2120	194	190	190
query91	185	147	147	147
query92	70	51	51	51
query93	3311	579	548	548
query94	1192	312	306	306
query95	360	263	264	263
query96	656	282	284	282
query97	3272	3123	3160	3123
query98	218	205	217	205
query99	1626	1341	1300	1300
Total cold run time: 308988 ms
Total hot run time: 194635 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

ClickBench: Total hot run time: 32.64 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fe13566ee652e236af7824cc82ce08788a67b243, data reload: false

query1	0.05	0.05	0.04
query2	0.06	0.03	0.02
query3	0.23	0.07	0.07
query4	1.65	0.11	0.10
query5	0.50	0.50	0.51
query6	1.13	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.57	0.49	0.51
query10	0.55	0.56	0.54
query11	0.14	0.11	0.11
query12	0.14	0.11	0.11
query13	0.62	0.58	0.59
query14	2.70	2.70	2.69
query15	0.90	0.83	0.83
query16	0.38	0.42	0.37
query17	1.00	1.02	1.06
query18	0.20	0.19	0.19
query19	1.89	1.87	1.94
query20	0.02	0.01	0.01
query21	15.36	0.61	0.59
query22	2.57	2.06	1.68
query23	17.24	0.83	0.86
query24	2.75	1.22	1.06
query25	0.22	0.15	0.06
query26	0.43	0.14	0.15
query27	0.04	0.03	0.04
query28	10.41	1.10	1.07
query29	12.56	3.22	3.26
query30	0.24	0.06	0.06
query31	2.97	0.38	0.37
query32	3.69	0.47	0.47
query33	3.03	3.02	3.04
query34	17.18	4.47	4.50
query35	4.53	4.47	4.49
query36	0.65	0.50	0.48
query37	0.08	0.06	0.05
query38	0.04	0.04	0.04
query39	0.04	0.02	0.02
query40	0.15	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.11 s
Total hot run time: 32.64 s

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 27, 2024

run buildall

1 similar comment
@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 27, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

TPC-H: Total hot run time: 40868 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 19a1c927e3ea70a48032403e25d6a623f728c762, data reload: false

------ Round 1 ----------------------------------
q1	17598	7631	7308	7308
q2	2020	299	277	277
q3	12207	1083	1169	1083
q4	10536	745	742	742
q5	7754	2954	2833	2833
q6	237	151	150	150
q7	969	621	612	612
q8	9350	1934	1990	1934
q9	6656	6505	6421	6421
q10	6964	2264	2293	2264
q11	440	258	260	258
q12	425	215	216	215
q13	17756	3039	2969	2969
q14	240	210	215	210
q15	603	543	531	531
q16	636	595	571	571
q17	968	590	504	504
q18	7427	6680	6627	6627
q19	1411	1027	1136	1027
q20	483	217	202	202
q21	4120	3284	3156	3156
q22	1111	1013	974	974
Total cold run time: 109911 ms
Total hot run time: 40868 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7370	7369	7344	7344
q2	339	234	230	230
q3	3126	2980	2943	2943
q4	2158	1884	1873	1873
q5	5780	5866	5781	5781
q6	246	157	145	145
q7	2278	1903	1827	1827
q8	3442	3593	3430	3430
q9	9012	8932	8957	8932
q10	3642	3615	3589	3589
q11	585	490	518	490
q12	822	627	609	609
q13	10741	3177	3207	3177
q14	318	276	290	276
q15	601	538	532	532
q16	696	649	657	649
q17	1910	1659	1598	1598
q18	8575	7937	7737	7737
q19	1744	1424	1474	1424
q20	2143	1886	1901	1886
q21	5788	5549	5552	5549
q22	1101	1013	1064	1013
Total cold run time: 72417 ms
Total hot run time: 61034 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

TPC-DS: Total hot run time: 191365 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 19a1c927e3ea70a48032403e25d6a623f728c762, data reload: false

query1	917	382	401	382
query2	6255	2169	2041	2041
query3	8688	197	198	197
query4	33545	23493	23423	23423
query5	3820	478	471	471
query6	289	171	171	171
query7	4185	304	313	304
query8	297	220	223	220
query9	9175	2648	2634	2634
query10	476	290	301	290
query11	17812	15205	15311	15205
query12	153	101	100	100
query13	1526	435	421	421
query14	9794	7567	7236	7236
query15	263	178	177	177
query16	7374	475	488	475
query17	1728	610	597	597
query18	1923	324	320	320
query19	364	161	150	150
query20	122	115	117	115
query21	215	108	106	106
query22	4606	4415	4492	4415
query23	35241	34050	33779	33779
query24	11050	2852	2850	2850
query25	621	414	420	414
query26	1033	159	161	159
query27	2277	301	303	301
query28	7423	2423	2390	2390
query29	751	434	423	423
query30	255	149	154	149
query31	1043	816	795	795
query32	97	54	56	54
query33	778	296	320	296
query34	936	490	496	490
query35	880	757	739	739
query36	1101	962	962	962
query37	157	90	87	87
query38	4070	3833	3879	3833
query39	1480	1422	1410	1410
query40	208	97	99	97
query41	50	49	48	48
query42	121	99	95	95
query43	529	501	488	488
query44	1278	810	790	790
query45	197	166	164	164
query46	1158	722	718	718
query47	1909	1823	1823	1823
query48	453	374	378	374
query49	878	400	403	400
query50	833	409	407	407
query51	7030	6963	6923	6923
query52	99	88	90	88
query53	253	177	180	177
query54	1246	462	468	462
query55	77	74	76	74
query56	281	255	241	241
query57	1212	1085	1074	1074
query58	230	225	239	225
query59	3147	3018	2926	2926
query60	295	276	267	267
query61	110	104	101	101
query62	856	676	672	672
query63	216	185	179	179
query64	4016	661	628	628
query65	3257	3183	3204	3183
query66	841	344	312	312
query67	15802	15426	15464	15426
query68	4985	562	557	557
query69	465	285	303	285
query70	1111	1100	1130	1100
query71	351	271	262	262
query72	7161	4027	4039	4027
query73	776	344	343	343
query74	10412	9004	8977	8977
query75	3382	2696	2667	2667
query76	2782	978	857	857
query77	430	294	283	283
query78	10459	9587	9560	9560
query79	2799	589	610	589
query80	1176	443	462	443
query81	576	238	237	237
query82	614	139	141	139
query83	227	145	136	136
query84	240	79	88	79
query85	1487	317	291	291
query86	438	315	313	313
query87	4400	4317	4282	4282
query88	4302	2362	2344	2344
query89	404	290	291	290
query90	1966	189	190	189
query91	196	146	143	143
query92	75	49	48	48
query93	2433	547	542	542
query94	928	311	309	309
query95	351	255	253	253
query96	617	269	287	269
query97	3247	3184	3124	3124
query98	236	217	194	194
query99	1794	1331	1290	1290
Total cold run time: 300122 ms
Total hot run time: 191365 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

ClickBench: Total hot run time: 32.75 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 19a1c927e3ea70a48032403e25d6a623f728c762, data reload: false

query1	0.05	0.04	0.04
query2	0.06	0.02	0.03
query3	0.23	0.07	0.06
query4	1.65	0.10	0.10
query5	0.54	0.51	0.51
query6	1.15	0.73	0.73
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.57	0.49	0.49
query10	0.54	0.56	0.56
query11	0.13	0.11	0.10
query12	0.13	0.11	0.11
query13	0.60	0.59	0.59
query14	2.72	2.72	2.82
query15	0.91	0.81	0.82
query16	0.37	0.40	0.38
query17	1.05	1.01	0.99
query18	0.20	0.19	0.20
query19	1.86	1.80	1.92
query20	0.01	0.01	0.02
query21	15.38	0.63	0.59
query22	2.47	2.31	1.86
query23	17.10	1.00	0.82
query24	2.87	1.09	0.99
query25	0.25	0.08	0.06
query26	0.49	0.14	0.13
query27	0.04	0.05	0.04
query28	10.87	1.10	1.07
query29	12.58	3.32	3.29
query30	0.24	0.06	0.06
query31	2.89	0.39	0.38
query32	3.26	0.46	0.48
query33	2.97	3.02	3.05
query34	16.98	4.47	4.50
query35	4.47	4.50	4.50
query36	0.69	0.49	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.83 s
Total hot run time: 32.75 s

@sollhui
Copy link
Copy Markdown
Contributor Author

sollhui commented Sep 27, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

TPC-H: Total hot run time: 40761 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 50db4a857182b85200cc8374b7abbd71711e42c4, data reload: false

------ Round 1 ----------------------------------
q1	17578	8611	7347	7347
q2	2034	279	271	271
q3	11834	1076	1148	1076
q4	10584	786	697	697
q5	7747	2847	2785	2785
q6	243	154	150	150
q7	965	613	620	613
q8	9369	1897	1933	1897
q9	6624	6402	6387	6387
q10	6974	2315	2311	2311
q11	443	245	238	238
q12	419	217	223	217
q13	17786	2992	2980	2980
q14	235	213	210	210
q15	571	522	519	519
q16	661	585	597	585
q17	973	512	573	512
q18	7236	6699	6639	6639
q19	1404	1071	1041	1041
q20	489	207	198	198
q21	3966	3238	3104	3104
q22	1101	997	984	984
Total cold run time: 109236 ms
Total hot run time: 40761 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7338	7317	7288	7288
q2	323	227	233	227
q3	3029	2927	2994	2927
q4	2098	1876	1837	1837
q5	5732	5735	5712	5712
q6	235	144	149	144
q7	2231	1865	1801	1801
q8	3386	3556	3449	3449
q9	8856	8917	8837	8837
q10	3632	3557	3530	3530
q11	586	496	496	496
q12	864	621	617	617
q13	8598	3198	3185	3185
q14	307	276	275	275
q15	589	529	533	529
q16	694	660	647	647
q17	1864	1620	1617	1617
q18	8393	8156	7560	7560
q19	1721	1564	1544	1544
q20	2115	1880	1878	1878
q21	5623	5416	5468	5416
q22	1150	1035	1045	1035
Total cold run time: 69364 ms
Total hot run time: 60551 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

TPC-DS: Total hot run time: 190984 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 50db4a857182b85200cc8374b7abbd71711e42c4, data reload: false

query1	917	383	398	383
query2	6231	2117	2054	2054
query3	8682	198	198	198
query4	33472	23697	23314	23314
query5	3306	474	459	459
query6	270	177	157	157
query7	4187	296	307	296
query8	287	220	217	217
query9	9493	2641	2640	2640
query10	437	274	278	274
query11	17732	15102	15179	15102
query12	153	98	98	98
query13	1524	432	403	403
query14	9961	7099	6935	6935
query15	261	167	171	167
query16	8004	469	486	469
query17	1628	593	600	593
query18	2140	320	315	315
query19	269	170	156	156
query20	120	115	114	114
query21	218	110	109	109
query22	4689	4706	4531	4531
query23	35003	33921	33979	33921
query24	11064	2837	2788	2788
query25	622	415	397	397
query26	1327	163	165	163
query27	2644	299	288	288
query28	7728	2423	2390	2390
query29	864	431	431	431
query30	256	159	146	146
query31	1047	789	792	789
query32	105	63	56	56
query33	770	312	301	301
query34	921	508	499	499
query35	893	762	707	707
query36	1101	937	961	937
query37	163	92	90	90
query38	4000	3934	3999	3934
query39	1462	1420	1420	1420
query40	266	98	96	96
query41	49	45	48	45
query42	122	93	96	93
query43	527	492	496	492
query44	1203	794	792	792
query45	198	168	165	165
query46	1139	709	693	693
query47	1911	1825	1837	1825
query48	463	368	385	368
query49	947	411	387	387
query50	835	423	410	410
query51	7042	7013	7009	7009
query52	105	87	88	87
query53	256	181	177	177
query54	1368	463	470	463
query55	79	74	75	74
query56	293	264	265	264
query57	1258	1114	1088	1088
query58	246	250	242	242
query59	3157	2982	3028	2982
query60	294	266	257	257
query61	100	103	107	103
query62	853	668	662	662
query63	216	179	180	179
query64	5139	643	612	612
query65	3248	3153	3214	3153
query66	1390	308	307	307
query67	15811	15439	15655	15439
query68	4688	563	569	563
query69	520	279	299	279
query70	1185	1143	1156	1143
query71	369	270	263	263
query72	7131	3968	3980	3968
query73	785	340	335	335
query74	10436	8952	8945	8945
query75	3470	2663	2681	2663
query76	3022	889	952	889
query77	449	294	283	283
query78	10392	9535	9523	9523
query79	1620	569	582	569
query80	1169	443	467	443
query81	595	239	244	239
query82	716	139	136	136
query83	258	134	130	130
query84	250	79	78	78
query85	1604	294	289	289
query86	440	293	310	293
query87	4485	4319	4308	4308
query88	3394	2385	2329	2329
query89	404	309	292	292
query90	2146	186	181	181
query91	182	142	146	142
query92	61	51	46	46
query93	1289	537	532	532
query94	1240	294	283	283
query95	357	251	252	251
query96	620	277	278	277
query97	3229	3133	3128	3128
query98	213	214	196	196
query99	1660	1283	1298	1283
Total cold run time: 300845 ms
Total hot run time: 190984 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 27, 2024

ClickBench: Total hot run time: 32.48 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 50db4a857182b85200cc8374b7abbd71711e42c4, data reload: false

query1	0.05	0.04	0.04
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.65	0.10	0.10
query5	0.52	0.51	0.52
query6	1.14	0.73	0.71
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.56	0.52	0.49
query10	0.56	0.56	0.54
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.70	2.73	2.73
query15	0.89	0.82	0.82
query16	0.38	0.39	0.38
query17	0.97	0.97	1.01
query18	0.20	0.20	0.20
query19	1.87	1.81	1.91
query20	0.01	0.01	0.01
query21	15.36	0.62	0.60
query22	2.36	2.12	2.32
query23	17.19	0.87	0.96
query24	2.84	0.46	1.47
query25	0.37	0.12	0.05
query26	0.30	0.13	0.13
query27	0.03	0.05	0.04
query28	10.93	1.10	1.07
query29	12.52	3.35	3.37
query30	0.25	0.06	0.05
query31	2.89	0.39	0.37
query32	3.26	0.46	0.47
query33	2.99	3.00	3.00
query34	17.30	4.43	4.44
query35	4.55	4.49	4.52
query36	0.65	0.48	0.48
query37	0.08	0.05	0.07
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.15	0.13	0.11
query41	0.08	0.01	0.03
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.97 s
Total hot run time: 32.48 s

liaoxin01
liaoxin01 approved these changes Sep 27, 2024
View reviewed changes
Copy link
Copy Markdown
Contributor

@liaoxin01 liaoxin01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 27, 2024
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Sep 27, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Sep 27, 2024

PR approved by anyone and no changes requested.

@liaoxin01 liaoxin01 merged commit 700b2c4 into apache:master Sep 28, 2024
gavinchou pushed a commit that referenced this pull request Sep 29, 2024
@sollhui @gavinchou
[fix](cloud) ensure afterCommit/afterAbort will always be called when…
39520b4 
… commit/abort transaction fails (#41267)

Ensure afterCommit/afterAbort will always be called when commit/abort
transaction fails. Otherwise, it may cause some problems, such as the
routing load getting stuck.
cjj2010 pushed a commit to cjj2010/doris that referenced this pull request Oct 12, 2024
@sollhui @cjj2010
[fix](cloud) ensure afterCommit/afterAbort will always be called when…
a5a52dd 
… commit/abort transaction fails (apache#41267)

Ensure afterCommit/afterAbort will always be called when commit/abort
transaction fails. Otherwise, it may cause some problems, such as the
routing load getting stuck.
amorynan pushed a commit to amorynan/doris that referenced this pull request Oct 12, 2024
@sollhui
[fix](cloud) ensure afterCommit/afterAbort will always be called when…
3f578c5 
… commit/abort transaction fails (apache#41267)

Ensure afterCommit/afterAbort will always be called when commit/abort
transaction fails. Otherwise, it may cause some problems, such as the
routing load getting stuck.
@gavinchou gavinchou mentioned this pull request Oct 13, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@liaoxin01 liaoxin01 liaoxin01 approved these changes

+1 more reviewer

@kaijchen kaijchen kaijchen approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.2-merged p0_b reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@sollhui @doris-robot @kaijchen @liaoxin01 @gavinchou @dataroaring