Skip to content

[fix](Nereids) system default decimalv3 scale should be 9#32756

Merged
morrySnow merged 1 commit intoapache:branch-2.0from
morrySnow:change_default_v3_scale_2.0
Mar 25, 2024
Merged

[fix](Nereids) system default decimalv3 scale should be 9#32756
morrySnow merged 1 commit intoapache:branch-2.0from
morrySnow:change_default_v3_scale_2.0

Conversation

@morrySnow
Copy link
Copy Markdown
Contributor

@morrySnow morrySnow commented Mar 25, 2024

pick from master #32754

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link
Copy Markdown

doris-robot commented Mar 25, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Copy Markdown
Contributor Author

morrySnow commented Mar 25, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Mar 25, 2024

TPC-H: Total hot run time: 50208 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 11002c3c848413771e565ca5dcab712ad447ad0c, data reload: false

------ Round 1 ----------------------------------
q1	17742	4426	4425	4425
q2	2111	153	142	142
q3	10307	1897	1915	1897
q4	10169	1230	1304	1230
q5	8569	3980	3989	3980
q6	220	124	124	124
q7	2027	1586	1600	1586
q8	9285	2723	2731	2723
q9	11381	11012	10700	10700
q10	8657	3539	3521	3521
q11	418	247	247	247
q12	462	291	308	291
q13	18318	3979	4052	3979
q14	348	317	322	317
q15	500	447	454	447
q16	702	590	596	590
q17	1144	964	964	964
q18	7328	6871	6776	6776
q19	1683	1617	1498	1498
q20	532	316	299	299
q21	4472	4085	4074	4074
q22	484	418	398	398
Total cold run time: 116859 ms
Total hot run time: 50208 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4316	4282	4455	4282
q2	320	218	215	215
q3	4169	4121	4141	4121
q4	2757	2755	2767	2755
q5	7286	7272	7219	7219
q6	236	116	117	116
q7	3279	2861	2841	2841
q8	4320	4461	4446	4446
q9	17614	17317	17294	17294
q10	4221	4292	4250	4250
q11	754	687	664	664
q12	1041	838	857	838
q13	6998	3763	3725	3725
q14	459	427	421	421
q15	493	456	463	456
q16	734	706	680	680
q17	3811	3800	3807	3800
q18	8866	8817	8714	8714
q19	1720	1729	1641	1641
q20	2372	2151	2141	2141
q21	8589	8507	8477	8477
q22	1041	964	965	964
Total cold run time: 85396 ms
Total hot run time: 80060 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Mar 25, 2024

TPC-DS: Total hot run time: 200734 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 11002c3c848413771e565ca5dcab712ad447ad0c, data reload: false

query1	953	402	377	377
query2	6528	2287	2071	2071
query3	6939	205	202	202
query4	21146	17779	17817	17779
query5	19722	6512	6578	6512
query6	289	204	215	204
query7	4159	293	297	293
query8	235	253	255	253
query9	3123	2672	2600	2600
query10	426	289	295	289
query11	11243	10648	10647	10647
query12	117	75	71	71
query13	5572	635	623	623
query14	17862	13229	13131	13131
query15	353	236	237	236
query16	6446	268	256	256
query17	1731	1448	841	841
query18	2343	405	400	400
query19	195	148	147	147
query20	79	76	77	76
query21	186	91	97	91
query22	5300	5154	5161	5154
query23	32481	31836	31842	31836
query24	6973	6417	6480	6417
query25	532	423	409	409
query26	524	158	152	152
query27	1913	291	288	288
query28	6111	2263	2226	2226
query29	2897	2770	2738	2738
query30	239	163	167	163
query31	891	747	724	724
query32	65	62	58	58
query33	378	240	244	240
query34	858	468	467	467
query35	1117	918	887	887
query36	1469	1202	1102	1102
query37	89	60	61	60
query38	3122	2936	2874	2874
query39	1360	1309	1305	1305
query40	209	98	94	94
query41	33	33	31	31
query42	93	83	87	83
query43	618	515	607	515
query44	1147	721	725	721
query45	237	224	231	224
query46	1218	978	1003	978
query47	1867	1764	1640	1640
query48	974	675	682	675
query49	608	375	358	358
query50	868	625	646	625
query51	4798	4630	4594	4594
query52	91	74	82	74
query53	446	310	313	310
query54	2621	2450	2465	2450
query55	87	72	85	72
query56	211	200	200	200
query57	1129	1087	1142	1087
query58	211	202	206	202
query59	3429	3172	3332	3172
query60	205	179	195	179
query61	85	81	82	81
query62	817	483	506	483
query63	468	332	328	328
query64	2426	1484	1356	1356
query65	3643	3528	3545	3528
query66	808	375	370	370
query67	16262	15398	15961	15398
query68	10067	672	660	660
query69	574	352	362	352
query70	1871	1409	1358	1358
query71	411	290	304	290
query72	6490	3474	3428	3428
query73	741	318	323	318
query74	6324	5882	5793	5793
query75	5392	3642	3738	3642
query76	6634	1194	1205	1194
query77	1100	243	241	241
query78	12827	12533	11880	11880
query79	10920	645	630	630
query80	718	383	389	383
query81	488	226	228	226
query82	1083	93	89	89
query83	167	131	131	131
query84	328	68	65	65
query85	810	292	278	278
query86	338	294	296	294
query87	3252	3056	2994	2994
query88	4808	2344	2343	2343
query89	426	270	277	270
query90	1961	199	209	199
query91	148	125	117	117
query92	59	49	45	45
query93	5782	562	554	554
query94	702	205	202	202
query95	1077	1050	1035	1035
query96	652	327	321	321
query97	6516	6364	6437	6364
query98	186	182	169	169
query99	2867	916	842	842
Total cold run time: 317294 ms
Total hot run time: 200734 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Mar 25, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 11002c3c848413771e565ca5dcab712ad447ad0c with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.6 seconds inserted 10000000 Rows, about 442K ops/s

@morrySnow morrySnow force-pushed the change_default_v3_scale_2.0 branch from 11002c3 to 6e6d7c0 Compare March 25, 2024 10:36
@morrySnow
Copy link
Copy Markdown
Contributor Author

morrySnow commented Mar 25, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Mar 25, 2024

TPC-H: Total hot run time: 50071 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6e6d7c04b6442f1b617d3cd19757961bd62cb2f0, data reload: false

------ Round 1 ----------------------------------
q1	17715	4431	4378	4378
q2	2042	151	145	145
q3	10362	1916	1967	1916
q4	10152	1246	1336	1246
q5	8476	3914	3990	3914
q6	234	124	124	124
q7	2033	1610	1608	1608
q8	9336	2741	2722	2722
q9	11100	10537	10386	10386
q10	8607	3607	3548	3548
q11	418	248	247	247
q12	468	298	302	298
q13	18342	3976	4041	3976
q14	356	328	325	325
q15	501	450	457	450
q16	705	584	580	580
q17	1138	964	959	959
q18	7294	6876	6819	6819
q19	1713	1605	1583	1583
q20	544	323	311	311
q21	4481	4144	4146	4144
q22	489	404	392	392
Total cold run time: 116506 ms
Total hot run time: 50071 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4340	4302	4316	4302
q2	324	229	217	217
q3	4159	4169	4176	4169
q4	2734	2775	2741	2741
q5	7327	7225	7222	7222
q6	241	117	121	117
q7	3237	2794	2939	2794
q8	4363	4499	4512	4499
q9	17152	16938	17105	16938
q10	4224	4276	4262	4262
q11	768	701	696	696
q12	1042	853	850	850
q13	6965	3729	3756	3729
q14	458	429	407	407
q15	508	454	447	447
q16	779	695	708	695
q17	3823	3853	3819	3819
q18	8868	8757	8930	8757
q19	1763	1721	1654	1654
q20	2430	2132	2137	2132
q21	8567	8533	8545	8533
q22	1030	954	910	910
Total cold run time: 85102 ms
Total hot run time: 79890 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Mar 25, 2024

TPC-DS: Total hot run time: 200345 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6e6d7c04b6442f1b617d3cd19757961bd62cb2f0, data reload: false

query1	925	398	383	383
query2	6542	2227	1966	1966
query3	6924	206	205	205
query4	21598	17899	17927	17899
query5	19716	6547	6495	6495
query6	295	211	228	211
query7	4166	290	293	290
query8	246	246	270	246
query9	3131	2700	2608	2608
query10	413	289	295	289
query11	11307	10715	10721	10715
query12	119	77	69	69
query13	5571	632	645	632
query14	17657	13560	13234	13234
query15	385	246	235	235
query16	6442	277	271	271
query17	1817	1430	864	864
query18	2299	407	391	391
query19	197	147	150	147
query20	66	75	73	73
query21	186	98	93	93
query22	5300	5090	5056	5056
query23	32368	31979	31930	31930
query24	6939	6466	6441	6441
query25	521	431	419	419
query26	523	155	156	155
query27	1901	293	289	289
query28	6121	2259	2218	2218
query29	2977	2599	2827	2599
query30	247	162	166	162
query31	895	726	744	726
query32	67	59	62	59
query33	377	253	248	248
query34	836	463	485	463
query35	1139	937	943	937
query36	1316	1390	1267	1267
query37	88	60	61	60
query38	3013	2937	2913	2913
query39	1355	1308	1307	1307
query40	200	95	98	95
query41	36	33	31	31
query42	88	89	83	83
query43	575	569	579	569
query44	1128	725	732	725
query45	243	227	228	227
query46	1238	991	991	991
query47	1794	1639	1798	1639
query48	968	679	664	664
query49	626	365	368	365
query50	861	598	581	581
query51	4780	4660	4742	4660
query52	77	85	73	73
query53	448	317	315	315
query54	2653	2459	2442	2442
query55	86	80	79	79
query56	205	204	202	202
query57	1242	1087	1125	1087
query58	210	196	199	196
query59	3405	3162	3048	3048
query60	198	213	189	189
query61	84	84	87	84
query62	879	486	446	446
query63	478	333	334	333
query64	2390	1479	1335	1335
query65	3651	3563	3589	3563
query66	760	366	347	347
query67	15473	15006	17697	15006
query68	10854	675	676	675
query69	578	329	342	329
query70	2053	1435	1474	1435
query71	415	306	297	297
query72	6383	3434	3380	3380
query73	756	330	331	330
query74	6391	5855	5752	5752
query75	5589	3735	3642	3642
query76	6949	1142	1217	1142
query77	1173	254	240	240
query78	12554	11543	12708	11543
query79	12381	631	635	631
query80	1067	386	378	378
query81	458	230	228	228
query82	699	98	94	94
query83	193	136	133	133
query84	249	70	67	67
query85	915	290	285	285
query86	323	291	282	282
query87	3266	3012	3007	3007
query88	4957	2367	2340	2340
query89	477	294	287	287
query90	2650	208	214	208
query91	148	117	117	117
query92	53	49	48	48
query93	6993	550	576	550
query94	1247	208	210	208
query95	1110	1068	1033	1033
query96	647	333	329	329
query97	6382	6394	6377	6377
query98	190	174	167	167
query99	2936	983	871	871
Total cold run time: 321797 ms
Total hot run time: 200345 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Mar 25, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 6e6d7c04b6442f1b617d3cd19757961bd62cb2f0 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.4 seconds inserted 10000000 Rows, about 446K ops/s

@morrySnow morrySnow merged commit e930123 into apache:branch-2.0 Mar 25, 2024
@morrySnow morrySnow deleted the change_default_v3_scale_2.0 branch April 30, 2024 06:22
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@morrySnow
[fix](Nereids) system default decimalv3 scale should be 9 (apache#32756)
79e6893 
pick from master apache#32754
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

area/nereids

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@morrySnow @doris-robot