Skip to content

[fix](cloud tvf) Fix tvf query run in cloud multi cluster#37157

Merged
dataroaring merged 9 commits intoapache:masterfrom
deardeng:fix-numbers
Jul 30, 2024
Merged

[fix](cloud tvf) Fix tvf query run in cloud multi cluster#37157
dataroaring merged 9 commits intoapache:masterfrom
deardeng:fix-numbers

Conversation

@deardeng
Copy link
Copy Markdown
Collaborator

@deardeng deardeng commented Jul 2, 2024

Fix

mysql> select * from numbers("number" = "10");
ERROR 1105 (HY000): errCode = 2, detailMessage = There is no scanNode Backend available.[10002: not exist]

@doris-robot
Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@deardeng
Copy link
Copy Markdown
Collaborator Author

deardeng commented Jul 2, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 39891 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b9387abdac40cbe5a3f9c5239aafe5be98ea3012, data reload: false

------ Round 1 ----------------------------------
q1	18317	4570	4393	4393
q2	2026	189	186	186
q3	10525	1183	1116	1116
q4	10216	736	820	736
q5	7540	2654	2742	2654
q6	223	143	139	139
q7	969	603	621	603
q8	9214	2067	2061	2061
q9	8647	6464	6474	6464
q10	8937	3745	3695	3695
q11	453	236	237	236
q12	436	241	234	234
q13	18667	2976	2975	2975
q14	275	219	217	217
q15	543	499	492	492
q16	517	384	371	371
q17	970	703	652	652
q18	8063	7619	7360	7360
q19	6028	1523	1504	1504
q20	655	331	334	331
q21	4890	3136	4013	3136
q22	399	336	344	336
Total cold run time: 118510 ms
Total hot run time: 39891 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4454	4320	4273	4273
q2	375	264	270	264
q3	2986	2759	2708	2708
q4	1859	1613	1596	1596
q5	5260	5280	5279	5279
q6	220	131	136	131
q7	2134	1784	1714	1714
q8	3192	3354	3293	3293
q9	8320	8305	8309	8305
q10	3824	3657	3670	3657
q11	587	478	486	478
q12	812	610	607	607
q13	17406	2970	2989	2970
q14	291	266	269	266
q15	508	487	493	487
q16	472	424	415	415
q17	1757	1481	1460	1460
q18	7618	7777	7345	7345
q19	1734	1509	1520	1509
q20	1994	1810	1787	1787
q21	9568	4602	4623	4602
q22	597	552	532	532
Total cold run time: 75968 ms
Total hot run time: 53678 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 172070 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b9387abdac40cbe5a3f9c5239aafe5be98ea3012, data reload: false

query1	926	392	375	375
query2	6457	2553	2476	2476
query3	6654	210	216	210
query4	19384	17526	17182	17182
query5	4226	493	505	493
query6	259	179	170	170
query7	4591	291	291	291
query8	319	294	331	294
query9	8567	2376	2367	2367
query10	622	288	280	280
query11	10363	10130	10000	10000
query12	131	83	80	80
query13	1625	359	354	354
query14	10263	6534	6855	6534
query15	234	186	184	184
query16	7837	271	259	259
query17	1685	532	515	515
query18	1965	271	272	271
query19	189	151	150	150
query20	90	81	80	80
query21	214	133	129	129
query22	4385	4065	3915	3915
query23	33744	33222	33227	33222
query24	12186	2921	2771	2771
query25	661	351	373	351
query26	1834	160	164	160
query27	2997	313	317	313
query28	7561	2037	2024	2024
query29	1146	612	623	612
query30	281	151	151	151
query31	972	737	719	719
query32	92	52	55	52
query33	767	282	317	282
query34	939	472	473	472
query35	736	638	607	607
query36	1066	946	929	929
query37	210	78	74	74
query38	2838	2756	2750	2750
query39	853	796	792	792
query40	293	124	123	123
query41	53	53	57	53
query42	119	100	101	100
query43	599	572	544	544
query44	1245	722	727	722
query45	197	160	171	160
query46	1068	753	717	717
query47	1825	1733	1762	1733
query48	364	295	296	295
query49	1194	405	403	403
query50	775	393	393	393
query51	6874	6777	6730	6730
query52	105	93	96	93
query53	357	297	287	287
query54	886	434	437	434
query55	76	75	77	75
query56	331	267	279	267
query57	1132	1046	1072	1046
query58	259	241	253	241
query59	3468	3149	3297	3149
query60	318	287	286	286
query61	98	97	90	90
query62	667	451	448	448
query63	320	294	293	293
query64	9876	2247	1750	1750
query65	3152	3118	3086	3086
query66	1375	340	332	332
query67	15490	14870	14868	14868
query68	5930	545	549	545
query69	653	473	343	343
query70	1216	1033	1111	1033
query71	444	273	281	273
query72	6915	5466	5278	5278
query73	764	330	330	330
query74	5897	5484	5487	5484
query75	3719	2641	2699	2641
query76	3512	1008	965	965
query77	679	310	310	310
query78	10332	9695	9659	9659
query79	2338	517	517	517
query80	1347	463	463	463
query81	541	219	218	218
query82	754	110	105	105
query83	199	168	170	168
query84	275	86	84	84
query85	1401	311	351	311
query86	416	317	313	313
query87	3245	3077	3116	3077
query88	3696	2365	2359	2359
query89	472	385	373	373
query90	1837	192	195	192
query91	129	99	99	99
query92	58	50	51	50
query93	1889	497	495	495
query94	1155	189	192	189
query95	398	328	320	320
query96	584	267	266	266
query97	3207	3013	2990	2990
query98	221	192	194	192
query99	1219	837	820	820
Total cold run time: 277827 ms
Total hot run time: 172070 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 31.41 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b9387abdac40cbe5a3f9c5239aafe5be98ea3012, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.07	0.08
query5	0.49	0.48	0.48
query6	1.14	0.73	0.74
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.50	0.49
query10	0.53	0.54	0.54
query11	0.16	0.11	0.11
query12	0.16	0.12	0.12
query13	0.60	0.59	0.59
query14	0.78	0.80	0.78
query15	0.84	0.81	0.81
query16	0.35	0.37	0.35
query17	1.03	1.05	1.02
query18	0.22	0.26	0.23
query19	1.81	1.68	1.75
query20	0.01	0.01	0.02
query21	15.45	0.78	0.67
query22	4.28	6.63	2.68
query23	18.27	1.34	1.29
query24	2.06	0.24	0.23
query25	0.16	0.08	0.08
query26	0.26	0.18	0.17
query27	0.08	0.09	0.07
query28	13.28	1.02	0.99
query29	12.62	3.27	3.29
query30	0.25	0.07	0.06
query31	2.87	0.40	0.40
query32	3.25	0.46	0.46
query33	2.86	2.90	2.91
query34	17.18	4.44	4.44
query35	4.52	4.51	4.50
query36	0.64	0.44	0.48
query37	0.18	0.15	0.16
query38	0.15	0.15	0.16
query39	0.04	0.03	0.04
query40	0.18	0.15	0.14
query41	0.10	0.04	0.05
query42	0.05	0.04	0.04
query43	0.05	0.03	0.04
Total cold run time: 109.52 s
Total hot run time: 31.41 s

@deardeng
Copy link
Copy Markdown
Collaborator Author

deardeng commented Jul 2, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 39952 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 515e10f827b8b518923fe00dbdd9a947f228f56b, data reload: false

------ Round 1 ----------------------------------
q1	17907	4514	4435	4435
q2	2367	192	184	184
q3	10487	1141	1139	1139
q4	10195	778	819	778
q5	7524	2616	2557	2557
q6	223	138	139	138
q7	932	600	605	600
q8	9212	2060	2053	2053
q9	8760	6464	6451	6451
q10	8983	3742	3712	3712
q11	463	231	234	231
q12	409	241	227	227
q13	17790	2987	2968	2968
q14	260	223	226	223
q15	526	485	486	485
q16	516	381	373	373
q17	958	664	680	664
q18	8105	7520	7489	7489
q19	6023	1475	1396	1396
q20	664	343	331	331
q21	4887	3228	3187	3187
q22	383	331	335	331
Total cold run time: 117574 ms
Total hot run time: 39952 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4430	4310	4212	4212
q2	373	264	273	264
q3	2977	2739	2651	2651
q4	1908	1594	1628	1594
q5	5213	5252	5272	5252
q6	222	132	132	132
q7	2107	1670	1748	1670
q8	3158	3350	3296	3296
q9	8365	8338	8318	8318
q10	3865	3676	3649	3649
q11	576	492	487	487
q12	760	600	665	600
q13	17578	2942	2987	2942
q14	278	270	250	250
q15	511	475	467	467
q16	470	404	411	404
q17	1769	1505	1474	1474
q18	7660	7651	7404	7404
q19	1771	1620	1574	1574
q20	1999	1786	1764	1764
q21	4936	4680	4695	4680
q22	609	529	557	529
Total cold run time: 71535 ms
Total hot run time: 53613 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 172481 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 515e10f827b8b518923fe00dbdd9a947f228f56b, data reload: false

query1	911	368	359	359
query2	6454	2357	2254	2254
query3	6658	214	215	214
query4	18961	17537	17265	17265
query5	4172	510	477	477
query6	265	185	173	173
query7	4605	291	292	291
query8	319	303	282	282
query9	8477	2368	2354	2354
query10	609	300	286	286
query11	10705	9994	10005	9994
query12	133	86	86	86
query13	1660	363	362	362
query14	10238	7453	7233	7233
query15	242	188	184	184
query16	8036	260	269	260
query17	1910	538	507	507
query18	2043	267	265	265
query19	191	156	148	148
query20	87	77	81	77
query21	211	130	128	128
query22	4238	3999	4036	3999
query23	33455	32876	33014	32876
query24	11799	2847	2788	2788
query25	643	358	362	358
query26	1776	150	158	150
query27	2983	314	314	314
query28	7171	2055	2048	2048
query29	1069	652	593	593
query30	267	148	148	148
query31	992	743	735	735
query32	92	52	52	52
query33	757	288	287	287
query34	951	461	475	461
query35	749	625	612	612
query36	1051	915	900	900
query37	205	73	74	73
query38	2869	2722	2781	2722
query39	874	785	796	785
query40	280	121	121	121
query41	48	49	52	49
query42	115	98	101	98
query43	616	565	550	550
query44	1184	715	719	715
query45	186	164	171	164
query46	1066	758	718	718
query47	1851	1762	1776	1762
query48	366	300	301	300
query49	1189	419	407	407
query50	762	396	387	387
query51	6885	6746	6778	6746
query52	103	91	92	91
query53	393	295	293	293
query54	973	444	436	436
query55	76	75	71	71
query56	279	262	291	262
query57	1164	1052	1052	1052
query58	252	236	253	236
query59	3512	3302	3235	3235
query60	297	279	283	279
query61	95	96	93	93
query62	673	470	435	435
query63	326	292	295	292
query64	9911	2266	1731	1731
query65	3158	3308	3094	3094
query66	1385	350	325	325
query67	15323	14972	14884	14884
query68	4550	544	544	544
query69	455	317	302	302
query70	1175	1142	1138	1138
query71	409	280	278	278
query72	7139	5601	5420	5420
query73	738	324	326	324
query74	5961	5472	5444	5444
query75	3475	2628	2641	2628
query76	2885	936	912	912
query77	461	306	306	306
query78	10295	9908	9675	9675
query79	2179	504	509	504
query80	1032	577	463	463
query81	584	216	221	216
query82	777	103	107	103
query83	235	165	171	165
query84	246	84	90	84
query85	2044	277	276	276
query86	502	335	328	328
query87	3235	3060	3101	3060
query88	4335	2363	2361	2361
query89	470	387	387	387
query90	1832	184	190	184
query91	128	99	100	99
query92	69	52	51	51
query93	2438	501	500	500
query94	1198	184	188	184
query95	407	315	315	315
query96	597	264	264	264
query97	3199	3021	3016	3016
query98	222	208	189	189
query99	1176	835	838	835
Total cold run time: 275744 ms
Total hot run time: 172481 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 515e10f827b8b518923fe00dbdd9a947f228f56b, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.22	0.05	0.06
query4	1.67	0.07	0.08
query5	0.50	0.49	0.49
query6	1.13	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.05	0.05
query9	0.54	0.49	0.47
query10	0.56	0.55	0.54
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.60	0.58	0.59
query14	0.76	0.79	0.78
query15	0.85	0.81	0.82
query16	0.37	0.36	0.35
query17	0.95	0.99	0.95
query18	0.20	0.27	0.25
query19	1.75	1.83	1.75
query20	0.01	0.02	0.01
query21	15.45	0.75	0.66
query22	4.03	7.61	1.91
query23	18.28	1.34	1.21
query24	2.14	0.23	0.23
query25	0.15	0.09	0.08
query26	0.25	0.17	0.18
query27	0.08	0.07	0.09
query28	13.24	1.03	0.99
query29	12.60	3.27	3.28
query30	0.25	0.06	0.06
query31	2.89	0.40	0.39
query32	3.25	0.49	0.47
query33	2.93	2.89	2.93
query34	17.25	4.44	4.44
query35	4.47	4.60	4.54
query36	0.65	0.49	0.47
query37	0.18	0.16	0.15
query38	0.16	0.15	0.16
query39	0.05	0.04	0.03
query40	0.17	0.16	0.15
query41	0.09	0.04	0.05
query42	0.06	0.05	0.04
query43	0.05	0.04	0.03
Total cold run time: 109.26 s
Total hot run time: 30.61 s

@deardeng
Copy link
Copy Markdown
Collaborator Author

deardeng commented Jul 5, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 39860 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4f1eb8fd796a1740f41192938eaa184ec94b2546, data reload: false

------ Round 1 ----------------------------------
q1	17613	4549	4302	4302
q2	2026	199	190	190
q3	10450	1184	1069	1069
q4	10187	813	936	813
q5	7553	2705	2617	2617
q6	224	138	139	138
q7	951	595	603	595
q8	9252	2111	2102	2102
q9	8903	6556	6500	6500
q10	8988	3800	3722	3722
q11	446	242	238	238
q12	440	219	224	219
q13	17774	2977	2995	2977
q14	263	224	226	224
q15	544	503	483	483
q16	515	373	375	373
q17	970	668	715	668
q18	8179	7407	7360	7360
q19	5243	1452	1449	1449
q20	682	320	330	320
q21	4971	3163	4067	3163
q22	404	338	346	338
Total cold run time: 116578 ms
Total hot run time: 39860 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4372	4254	4267	4254
q2	362	257	270	257
q3	2990	2820	2867	2820
q4	2018	1762	1766	1762
q5	5638	5506	5496	5496
q6	222	131	130	130
q7	2216	1876	1880	1876
q8	3282	3438	3479	3438
q9	8692	8754	8881	8754
q10	4081	3955	3718	3718
q11	600	519	489	489
q12	826	621	659	621
q13	17321	3182	3177	3177
q14	327	288	284	284
q15	529	508	484	484
q16	496	438	432	432
q17	1837	1501	1506	1501
q18	8073	8136	7861	7861
q19	1825	1552	1734	1552
q20	2099	1893	1844	1844
q21	9553	4865	4679	4679
q22	648	541	561	541
Total cold run time: 78007 ms
Total hot run time: 55970 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 171193 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4f1eb8fd796a1740f41192938eaa184ec94b2546, data reload: false

query1	920	372	378	372
query2	6457	2449	2286	2286
query3	6633	207	215	207
query4	23846	17397	17402	17397
query5	3658	482	468	468
query6	274	168	164	164
query7	4584	299	315	299
query8	319	290	292	290
query9	8676	2419	2409	2409
query10	568	310	288	288
query11	11843	10112	10022	10022
query12	118	94	82	82
query13	1643	386	383	383
query14	10235	7740	7693	7693
query15	259	183	185	183
query16	7792	317	312	312
query17	1795	562	538	538
query18	1949	286	282	282
query19	198	153	155	153
query20	90	87	85	85
query21	207	134	129	129
query22	4296	4085	3944	3944
query23	34588	33727	33300	33300
query24	11920	2841	2790	2790
query25	662	416	406	406
query26	1669	156	160	156
query27	2863	325	335	325
query28	7725	2185	2152	2152
query29	1069	671	676	671
query30	246	156	156	156
query31	973	782	790	782
query32	96	57	60	57
query33	769	321	299	299
query34	982	507	500	500
query35	736	658	653	653
query36	1121	978	996	978
query37	202	90	88	88
query38	2926	2914	2844	2844
query39	922	846	852	846
query40	264	130	126	126
query41	56	54	55	54
query42	121	102	106	102
query43	588	549	526	526
query44	1183	742	769	742
query45	205	163	161	161
query46	1085	742	733	733
query47	1854	1784	1839	1784
query48	368	309	299	299
query49	912	508	413	413
query50	786	383	388	383
query51	6875	6865	6760	6760
query52	103	95	91	91
query53	367	288	289	288
query54	867	449	463	449
query55	75	75	74	74
query56	289	260	266	260
query57	1142	1028	1068	1028
query58	253	242	248	242
query59	3461	3146	3211	3146
query60	303	267	269	267
query61	113	94	96	94
query62	562	432	444	432
query63	326	294	293	293
query64	10258	2130	1651	1651
query65	3164	3098	3120	3098
query66	1076	327	332	327
query67	15731	14879	15085	14879
query68	8573	552	561	552
query69	760	424	378	378
query70	1221	1136	1152	1136
query71	523	294	268	268
query72	8657	5158	2768	2768
query73	1559	323	327	323
query74	5845	5484	5461	5461
query75	5222	2674	2685	2674
query76	5025	1035	1024	1024
query77	796	312	304	304
query78	9780	9025	8951	8951
query79	10281	530	523	523
query80	1255	484	474	474
query81	576	217	217	217
query82	652	105	104	104
query83	332	162	162	162
query84	270	87	84	84
query85	1320	302	290	290
query86	374	343	301	301
query87	3336	3118	3081	3081
query88	4576	2376	2370	2370
query89	544	389	387	387
query90	2198	190	183	183
query91	129	105	100	100
query92	63	50	52	50
query93	7225	526	522	522
query94	1436	208	205	205
query95	401	307	312	307
query96	607	265	258	258
query97	3161	3055	3028	3028
query98	222	201	195	195
query99	1195	822	865	822
Total cold run time: 306330 ms
Total hot run time: 171193 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.67 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4f1eb8fd796a1740f41192938eaa184ec94b2546, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.08	0.08
query5	0.48	0.46	0.48
query6	1.13	0.72	0.73
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.55	0.50	0.48
query10	0.55	0.55	0.53
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.59	0.58	0.59
query14	0.80	0.78	0.77
query15	0.85	0.81	0.82
query16	0.36	0.37	0.38
query17	0.95	0.95	0.98
query18	0.21	0.23	0.28
query19	1.79	1.72	1.65
query20	0.01	0.01	0.01
query21	15.38	0.77	0.65
query22	4.33	7.60	2.22
query23	18.29	1.39	1.24
query24	2.08	0.24	0.23
query25	0.16	0.10	0.09
query26	0.30	0.21	0.20
query27	0.45	0.24	0.23
query28	13.25	1.01	1.00
query29	12.58	3.31	3.25
query30	0.25	0.06	0.05
query31	2.87	0.40	0.38
query32	3.28	0.47	0.47
query33	2.86	2.92	2.93
query34	17.05	4.32	4.38
query35	4.40	4.40	4.37
query36	0.65	0.46	0.45
query37	0.18	0.15	0.15
query38	0.15	0.14	0.15
query39	0.04	0.04	0.03
query40	0.16	0.11	0.13
query41	0.09	0.05	0.05
query42	0.05	0.05	0.04
query43	0.04	0.03	0.04
Total cold run time: 109.55 s
Total hot run time: 30.67 s

@deardeng
Copy link
Copy Markdown
Collaborator Author

deardeng commented Jul 8, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 40127 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4f1eb8fd796a1740f41192938eaa184ec94b2546, data reload: false

------ Round 1 ----------------------------------
q1	18069	4495	4452	4452
q2	2179	204	185	185
q3	10455	1200	1104	1104
q4	10195	768	720	720
q5	7495	2667	2661	2661
q6	224	143	139	139
q7	976	596	617	596
q8	9226	2117	2081	2081
q9	8986	6557	6537	6537
q10	8830	3778	3714	3714
q11	480	242	243	242
q12	405	231	219	219
q13	17764	2947	2971	2947
q14	284	222	240	222
q15	521	501	501	501
q16	520	381	386	381
q17	979	653	618	618
q18	8067	7583	7471	7471
q19	4860	1417	1526	1417
q20	685	316	330	316
q21	4940	3272	3886	3272
q22	392	336	332	332
Total cold run time: 116532 ms
Total hot run time: 40127 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4386	4263	4267	4263
q2	363	274	273	273
q3	2986	2759	2766	2759
q4	1842	1635	1608	1608
q5	5254	5252	5274	5252
q6	220	131	131	131
q7	2142	1772	1749	1749
q8	3254	3290	3307	3290
q9	8379	8271	8340	8271
q10	3841	3678	3691	3678
q11	616	485	489	485
q12	800	597	611	597
q13	17599	2966	2994	2966
q14	291	255	260	255
q15	515	465	489	465
q16	463	407	426	407
q17	1796	1485	1471	1471
q18	7600	7547	7454	7454
q19	1710	1542	1608	1542
q20	1966	1758	1796	1758
q21	4784	4820	4742	4742
q22	611	529	540	529
Total cold run time: 71418 ms
Total hot run time: 53945 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 173892 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4f1eb8fd796a1740f41192938eaa184ec94b2546, data reload: false

query1	906	376	378	376
query2	6466	2401	2376	2376
query3	6649	204	212	204
query4	28266	17616	17355	17355
query5	4235	490	485	485
query6	264	171	157	157
query7	4587	296	306	296
query8	328	302	304	302
query9	8563	2397	2378	2378
query10	617	328	289	289
query11	11620	9875	9979	9875
query12	141	89	83	83
query13	1652	388	389	388
query14	10322	7789	7683	7683
query15	267	188	186	186
query16	7838	325	319	319
query17	1780	563	547	547
query18	2000	285	289	285
query19	203	154	153	153
query20	88	82	83	82
query21	206	129	134	129
query22	4219	4077	4107	4077
query23	33802	33108	33096	33096
query24	12112	2854	2829	2829
query25	672	385	390	385
query26	1799	154	150	150
query27	2940	276	271	271
query28	7589	2102	2095	2095
query29	1081	648	639	639
query30	294	149	151	149
query31	1024	735	760	735
query32	101	58	59	58
query33	789	320	314	314
query34	932	490	502	490
query35	702	571	586	571
query36	1137	905	958	905
query37	283	86	82	82
query38	2881	2757	2723	2723
query39	871	799	818	799
query40	284	127	121	121
query41	59	56	55	55
query42	117	102	103	102
query43	574	566	564	564
query44	1201	748	747	747
query45	196	163	162	162
query46	1101	771	761	761
query47	1867	1783	1796	1783
query48	390	311	305	305
query49	1217	431	440	431
query50	803	413	414	413
query51	6850	6738	6783	6738
query52	112	99	91	91
query53	363	293	293	293
query54	1012	459	459	459
query55	82	76	75	75
query56	312	285	289	285
query57	1135	1063	1045	1045
query58	272	255	362	255
query59	3352	3236	3113	3113
query60	327	275	286	275
query61	100	93	91	91
query62	821	646	655	646
query63	329	294	305	294
query64	10464	2202	1634	1634
query65	3229	3126	3112	3112
query66	1392	363	326	326
query67	15782	15041	14980	14980
query68	8671	578	575	575
query69	730	459	370	370
query70	1206	1150	1159	1150
query71	560	285	286	285
query72	8364	4939	5616	4939
query73	1470	324	326	324
query74	5948	5534	5506	5506
query75	5382	2681	2693	2681
query76	5119	1000	926	926
query77	767	310	304	304
query78	9669	9191	9638	9191
query79	7895	516	515	515
query80	981	476	471	471
query81	580	214	217	214
query82	689	138	139	138
query83	339	162	166	162
query84	271	85	130	85
query85	1378	300	292	292
query86	396	328	312	312
query87	3312	3100	3149	3100
query88	4593	2487	2443	2443
query89	512	394	370	370
query90	2011	182	190	182
query91	134	101	102	101
query92	67	52	50	50
query93	5907	522	509	509
query94	1244	214	207	207
query95	397	320	315	315
query96	619	281	271	271
query97	3158	3004	3002	3002
query98	211	200	198	198
query99	1543	1232	1293	1232
Total cold run time: 308092 ms
Total hot run time: 173892 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4f1eb8fd796a1740f41192938eaa184ec94b2546, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.06
query4	1.67	0.08	0.07
query5	0.51	0.48	0.50
query6	1.15	0.75	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.49	0.51
query10	0.55	0.54	0.55
query11	0.15	0.11	0.12
query12	0.14	0.12	0.13
query13	0.58	0.58	0.58
query14	0.76	0.77	0.79
query15	0.85	0.82	0.83
query16	0.38	0.38	0.37
query17	0.95	1.01	1.01
query18	0.22	0.22	0.21
query19	1.79	1.67	1.69
query20	0.02	0.01	0.01
query21	15.40	0.76	0.65
query22	4.28	7.15	2.11
query23	18.28	1.43	1.23
query24	2.09	0.23	0.22
query25	0.16	0.09	0.08
query26	0.29	0.21	0.20
query27	0.45	0.22	0.23
query28	13.28	1.02	0.99
query29	12.66	3.29	3.26
query30	0.24	0.06	0.06
query31	2.90	0.39	0.38
query32	3.25	0.46	0.48
query33	2.86	2.88	2.89
query34	17.08	4.34	4.38
query35	4.40	4.44	4.41
query36	0.65	0.47	0.48
query37	0.19	0.15	0.16
query38	0.16	0.14	0.14
query39	0.05	0.03	0.04
query40	0.16	0.13	0.13
query41	0.09	0.04	0.04
query42	0.05	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.69 s
Total hot run time: 30.68 s

@deardeng
Copy link
Copy Markdown
Collaborator Author

deardeng commented Jul 9, 2024

run buildall

1 similar comment
@deardeng
Copy link
Copy Markdown
Collaborator Author

deardeng commented Jul 9, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 39835 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6244bd19e934fd46299e57b4dcc478c1eb72d2b6, data reload: false

------ Round 1 ----------------------------------
q1	17857	4490	4339	4339
q2	2353	191	192	191
q3	10434	1207	1148	1148
q4	10199	749	742	742
q5	7482	2613	2635	2613
q6	219	138	143	138
q7	971	591	611	591
q8	9222	2051	2092	2051
q9	8916	6498	6433	6433
q10	8878	3723	3680	3680
q11	450	246	241	241
q12	390	232	231	231
q13	18970	2936	2987	2936
q14	258	240	231	231
q15	543	485	490	485
q16	511	382	373	373
q17	970	698	770	698
q18	8082	7482	7472	7472
q19	5312	1489	1499	1489
q20	673	335	328	328
q21	4916	3087	3935	3087
q22	422	338	346	338
Total cold run time: 118028 ms
Total hot run time: 39835 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4385	4257	4289	4257
q2	350	253	254	253
q3	2984	2721	2728	2721
q4	1878	1544	1641	1544
q5	5267	5271	5272	5271
q6	218	131	131	131
q7	2109	1789	1779	1779
q8	3210	3319	3325	3319
q9	8391	8268	8333	8268
q10	3875	3621	3695	3621
q11	599	509	488	488
q12	774	605	590	590
q13	17289	2995	2985	2985
q14	292	272	268	268
q15	517	480	474	474
q16	455	403	414	403
q17	1752	1469	1443	1443
q18	7552	7728	7355	7355
q19	2173	1666	1624	1624
q20	2016	1781	1764	1764
q21	4840	4732	4785	4732
q22	632	536	572	536
Total cold run time: 71558 ms
Total hot run time: 53826 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 174540 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6244bd19e934fd46299e57b4dcc478c1eb72d2b6, data reload: false

query1	919	366	367	366
query2	6475	2400	2320	2320
query3	6676	209	225	209
query4	28530	17516	17332	17332
query5	4204	484	465	465
query6	264	167	153	153
query7	4590	291	290	290
query8	320	298	303	298
query9	8432	2447	2436	2436
query10	452	274	277	274
query11	11259	10148	10087	10087
query12	137	84	88	84
query13	1642	368	367	367
query14	10427	7672	7513	7513
query15	254	187	189	187
query16	7843	325	311	311
query17	1793	552	535	535
query18	1998	279	284	279
query19	207	151	153	151
query20	92	81	83	81
query21	204	127	126	126
query22	4244	4042	4005	4005
query23	33616	32881	33074	32881
query24	12054	2797	2795	2795
query25	666	391	387	387
query26	1739	149	149	149
query27	2955	270	273	270
query28	7399	2071	2049	2049
query29	1045	644	623	623
query30	289	148	151	148
query31	950	748	737	737
query32	100	56	54	54
query33	781	327	310	310
query34	893	488	475	475
query35	691	568	587	568
query36	1098	937	938	937
query37	256	82	82	82
query38	2874	2718	2707	2707
query39	846	803	829	803
query40	278	124	122	122
query41	56	53	54	53
query42	120	99	103	99
query43	563	566	538	538
query44	1150	728	726	726
query45	189	167	169	167
query46	1082	720	765	720
query47	1856	1764	1763	1763
query48	374	301	302	301
query49	1209	413	411	411
query50	773	400	398	398
query51	6811	6854	6765	6765
query52	105	95	93	93
query53	359	291	293	291
query54	1028	456	449	449
query55	77	74	75	74
query56	305	279	278	278
query57	1166	1062	1049	1049
query58	272	257	262	257
query59	3501	3049	3326	3049
query60	301	284	280	280
query61	92	90	93	90
query62	824	646	645	645
query63	327	291	289	289
query64	10474	2202	7416	2202
query65	3172	3083	3116	3083
query66	1375	326	330	326
query67	15753	14978	14873	14873
query68	8954	545	535	535
query69	764	458	370	370
query70	1423	1165	1062	1062
query71	538	278	271	271
query72	8766	5548	5692	5548
query73	1749	325	330	325
query74	5994	5534	5526	5526
query75	5371	2675	2683	2675
query76	5579	1010	930	930
query77	788	305	314	305
query78	9504	9604	9585	9585
query79	8693	521	527	521
query80	840	477	471	471
query81	581	217	226	217
query82	298	141	134	134
query83	328	186	168	168
query84	272	86	90	86
query85	968	300	324	300
query86	345	302	305	302
query87	3287	3124	3094	3094
query88	4305	2449	2426	2426
query89	491	369	374	369
query90	2039	184	185	184
query91	131	104	101	101
query92	67	50	51	50
query93	5521	506	498	498
query94	1398	210	206	206
query95	401	315	306	306
query96	612	274	267	267
query97	3166	3048	3022	3022
query98	213	204	203	203
query99	1487	1275	1248	1248
Total cold run time: 307679 ms
Total hot run time: 174540 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.99 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6244bd19e934fd46299e57b4dcc478c1eb72d2b6, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.08	0.07
query5	0.50	0.47	0.48
query6	1.15	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.05	0.05
query9	0.54	0.47	0.49
query10	0.54	0.54	0.54
query11	0.15	0.11	0.11
query12	0.14	0.11	0.12
query13	0.60	0.59	0.60
query14	0.77	0.78	0.78
query15	0.85	0.82	0.82
query16	0.36	0.36	0.38
query17	1.04	1.03	0.97
query18	0.24	0.23	0.21
query19	1.87	1.68	1.69
query20	0.01	0.02	0.02
query21	15.44	0.77	0.66
query22	4.71	6.38	2.30
query23	18.32	1.34	1.28
query24	2.16	0.23	0.22
query25	0.16	0.08	0.08
query26	0.30	0.21	0.21
query27	0.45	0.23	0.24
query28	13.26	1.01	1.00
query29	12.59	3.40	3.34
query30	0.26	0.06	0.05
query31	2.88	0.39	0.39
query32	3.26	0.48	0.47
query33	2.91	2.89	2.87
query34	16.99	4.31	4.30
query35	4.36	4.42	4.41
query36	0.65	0.50	0.48
query37	0.19	0.16	0.16
query38	0.16	0.15	0.15
query39	0.04	0.03	0.04
query40	0.15	0.12	0.12
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 110.28 s
Total hot run time: 30.99 s

Comment thread regression-test/suites/cloud_p0/multi_cluster/test_tvf.groovy Outdated
@deardeng
Copy link
Copy Markdown
Collaborator Author

run buildall

Copy link
Copy Markdown
Contributor

@yujun777 yujun777 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@deardeng
Copy link
Copy Markdown
Collaborator Author

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 41336 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dd493aa7954ee675b482f8351c095839765a9c29, data reload: false

------ Round 1 ----------------------------------
q1	17618	4092	4031	4031
q2	2024	209	209	209
q3	10454	1295	1364	1295
q4	10187	829	892	829
q5	7604	2939	2946	2939
q6	219	136	135	135
q7	1031	609	615	609
q8	9436	1839	1899	1839
q9	8547	6614	6584	6584
q10	8726	3834	3816	3816
q11	438	254	253	253
q12	398	222	217	217
q13	17769	2917	2914	2914
q14	268	245	248	245
q15	524	479	468	468
q16	506	384	384	384
q17	952	893	869	869
q18	8010	7207	7329	7207
q19	1385	1213	1209	1209
q20	560	319	332	319
q21	5273	4745	4676	4676
q22	354	290	289	289
Total cold run time: 112283 ms
Total hot run time: 41336 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4029	4018	3989	3989
q2	324	228	220	220
q3	2967	3017	3061	3017
q4	2002	1960	2012	1960
q5	5529	5521	5444	5444
q6	233	137	136	136
q7	2101	1763	1790	1763
q8	3330	3441	3332	3332
q9	8673	8634	8686	8634
q10	4045	3992	4064	3992
q11	548	438	446	438
q12	724	558	610	558
q13	16500	3130	3086	3086
q14	326	277	259	259
q15	549	483	502	483
q16	462	398	405	398
q17	1746	1719	1702	1702
q18	8101	7699	7679	7679
q19	1721	1719	1696	1696
q20	2064	1836	1881	1836
q21	5815	5520	5332	5332
q22	516	470	450	450
Total cold run time: 72305 ms
Total hot run time: 56404 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 170730 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dd493aa7954ee675b482f8351c095839765a9c29, data reload: false

query1	915	369	372	369
query2	6469	1728	1657	1657
query3	6648	215	231	215
query4	20218	17717	17432	17432
query5	3632	524	524	524
query6	285	184	169	169
query7	4599	305	297	297
query8	255	199	201	199
query9	8527	2418	2383	2383
query10	429	271	258	258
query11	10567	10200	9972	9972
query12	116	86	87	86
query13	1628	378	390	378
query14	10322	8223	7757	7757
query15	194	163	160	160
query16	6815	432	427	427
query17	941	552	543	543
query18	1882	287	278	278
query19	192	138	147	138
query20	94	87	90	87
query21	203	103	111	103
query22	4180	4073	4046	4046
query23	33890	33660	33589	33589
query24	10291	3100	3138	3100
query25	722	420	408	408
query26	1711	156	156	156
query27	2967	288	299	288
query28	7297	2058	2020	2020
query29	1266	432	445	432
query30	231	152	154	152
query31	957	764	749	749
query32	102	53	55	53
query33	684	323	329	323
query34	898	507	489	489
query35	875	752	791	752
query36	1032	876	907	876
query37	300	83	79	79
query38	2951	2877	2863	2863
query39	855	815	807	807
query40	253	110	112	110
query41	47	47	43	43
query42	118	100	97	97
query43	472	420	438	420
query44	1169	725	727	725
query45	206	179	177	177
query46	1092	805	775	775
query47	1819	1743	1728	1728
query48	361	297	293	293
query49	936	430	414	414
query50	910	432	440	432
query51	6916	6663	6643	6643
query52	104	89	92	89
query53	254	176	175	175
query54	609	458	450	450
query55	75	75	72	72
query56	274	253	284	253
query57	1137	1037	1057	1037
query58	271	256	270	256
query59	2661	2508	2328	2328
query60	290	274	275	274
query61	93	94	95	94
query62	889	662	649	649
query63	213	185	181	181
query64	5661	1931	1940	1931
query65	3156	3073	3066	3066
query66	1332	345	326	326
query67	15301	14824	14661	14661
query68	4270	577	574	574
query69	592	370	301	301
query70	1132	1054	1084	1054
query71	418	286	275	275
query72	7111	2747	2494	2494
query73	773	329	338	329
query74	6005	5764	5694	5694
query75	3392	2731	2766	2731
query76	2205	1356	1389	1356
query77	551	313	304	304
query78	9413	8889	8906	8889
query79	1300	532	524	524
query80	924	509	505	505
query81	568	223	229	223
query82	530	131	127	127
query83	257	168	173	168
query84	267	83	79	79
query85	1208	311	305	305
query86	433	323	286	286
query87	3344	3130	3139	3130
query88	2953	2476	2470	2470
query89	381	291	289	289
query90	1676	189	188	188
query91	125	103	100	100
query92	59	49	50	49
query93	2070	637	635	635
query94	794	298	308	298
query95	383	266	266	266
query96	607	288	285	285
query97	3236	3056	3013	3013
query98	215	203	199	199
query99	1589	1277	1298	1277
Total cold run time: 261540 ms
Total hot run time: 170730 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.08 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dd493aa7954ee675b482f8351c095839765a9c29, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.69	0.07	0.06
query5	0.47	0.49	0.48
query6	1.15	0.72	0.71
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.56	0.51	0.52
query10	0.56	0.57	0.57
query11	0.16	0.11	0.11
query12	0.14	0.12	0.12
query13	0.61	0.60	0.59
query14	0.78	0.78	0.79
query15	0.88	0.88	0.85
query16	0.35	0.35	0.36
query17	0.99	1.03	1.00
query18	0.22	0.21	0.21
query19	1.83	1.76	1.74
query20	0.02	0.01	0.01
query21	15.39	0.78	0.65
query22	3.79	7.40	1.32
query23	17.87	1.35	1.32
query24	2.25	0.23	0.23
query25	0.18	0.09	0.09
query26	0.32	0.21	0.22
query27	0.46	0.24	0.23
query28	13.16	0.99	0.98
query29	12.55	3.36	3.30
query30	0.25	0.06	0.05
query31	2.87	0.40	0.41
query32	3.25	0.48	0.48
query33	2.96	2.94	2.94
query34	15.44	4.28	4.27
query35	4.27	4.26	4.30
query36	0.68	0.47	0.49
query37	0.19	0.17	0.16
query38	0.17	0.16	0.15
query39	0.04	0.04	0.04
query40	0.16	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 107.28 s
Total hot run time: 30.08 s

Copy link
Copy Markdown
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 29, 2024
@github-actions
Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@dataroaring dataroaring merged commit 67c79a7 into apache:master Jul 30, 2024
feiniaofeiafei pushed a commit to feiniaofeiafei/doris that referenced this pull request Aug 9, 2024
Fix
```
mysql> select * from numbers("number" = "10");
ERROR 1105 (HY000): errCode = 2, detailMessage = There is no scanNode Backend available.[10002: not exist]
```
beIdToRespFuture.put(beId, responseFuture);
}
} catch (RpcException e) {
} catch (RpcException | UserException e) {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

UserException is not a RPC exception

deardeng added a commit to deardeng/incubator-doris that referenced this pull request Aug 12, 2024
Fix
```
mysql> select * from numbers("number" = "10");
ERROR 1105 (HY000): errCode = 2, detailMessage = There is no scanNode Backend available.[10002: not exist]
```
deardeng added a commit to deardeng/incubator-doris that referenced this pull request Aug 12, 2024
Fix
```
mysql> select * from numbers("number" = "10");
ERROR 1105 (HY000): errCode = 2, detailMessage = There is no scanNode Backend available.[10002: not exist]
```
dataroaring pushed a commit that referenced this pull request Aug 13, 2024
dataroaring pushed a commit that referenced this pull request Aug 16, 2024
dataroaring pushed a commit that referenced this pull request Jun 9, 2025
before #37157, replay wal select be
by the input `backend_id`.
after, should set cloud cluster name of `backend_id`. if not, fe wil use
default cluster and replay wal may fail because of `No Alive backends`
mymeiyi added a commit to mymeiyi/doris that referenced this pull request Jun 12, 2025
before apache#37157, replay wal select be
by the input `backend_id`.
after, should set cloud cluster name of `backend_id`. if not, fe wil use
default cluster and replay wal may fail because of `No Alive backends`
mymeiyi added a commit to mymeiyi/doris that referenced this pull request Jun 20, 2025
before apache#37157, replay wal select be
by the input `backend_id`.
after, should set cloud cluster name of `backend_id`. if not, fe wil use
default cluster and replay wal may fail because of `No Alive backends`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.2-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants