Skip to content

[opt](memory) BE memory info compatible with CgroupV2#39256

Merged
yiguolei merged 10 commits intoapache:masterfrom
xinyiZzz:20240807_fix_memory_cgroup
Aug 14, 2024
Merged

[opt](memory) BE memory info compatible with CgroupV2#39256
yiguolei merged 10 commits intoapache:masterfrom
xinyiZzz:20240807_fix_memory_cgroup

Conversation

@xinyiZzz
Copy link
Copy Markdown
Contributor

@xinyiZzz xinyiZzz commented Aug 12, 2024

/* Cgroup debugging steps

  • CgroupV1:
  • sudo cgcreate -t username:username -g memory:test
  • sudo sh -c "echo 6000M > /sys/fs/cgroup/memory/test/memory.limit_in_bytes"
  • // process started by the current terminal will join Cgroup test
  • sudo sh -c "echo $$ >> /sys/fs/cgroup/memory/test/cgroup.procs"
  • CgroupV2:
  • sudo mkdir /sys/fs/cgroup/test
  • sudo echo 3000M > /sys/fs/cgroup/test/memory.max
  • // process started by the current terminal will join Cgroup test
  • sudo sh -c "echo $$ >> /sys/fs/cgroup/test/cgroup.procs"
  • or
  • // only memory allocated after joining the Cgroup is counted in memory.current.
  • sudo echo pid > /sys/fs/cgroup/test/cgroup.procs

debug string

CGroup Info: Process CGroup Memory Info (cgroups path: /sys/fs/cgroup/memory/test, cgroup version: v1): memory limit: 2097152000, memory usage: 500969472

@doris-robot
Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions github-actions bot added the doing label Aug 12, 2024
@github-actions
Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@xinyiZzz xinyiZzz force-pushed the 20240807_fix_memory_cgroup branch from bb57830 to 2e8c877 Compare August 12, 2024 14:56
@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions
Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 39895 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2e8c8778d0371abf18a6720d23174922a3436a29, data reload: false

------ Round 1 ----------------------------------
q1	17604	4337	4234	4234
q2	2018	180	175	175
q3	10591	1191	1047	1047
q4	10301	763	747	747
q5	7567	2579	2559	2559
q6	231	140	141	140
q7	980	612	607	607
q8	9281	1933	1931	1931
q9	8957	6663	6637	6637
q10	7518	2215	2179	2179
q11	476	263	249	249
q12	452	219	219	219
q13	18731	2964	2981	2964
q14	279	251	243	243
q15	519	490	484	484
q16	528	383	382	382
q17	985	698	719	698
q18	8080	7568	7536	7536
q19	6106	1084	982	982
q20	704	328	349	328
q21	5429	4549	4529	4529
q22	1122	1034	1025	1025
Total cold run time: 118459 ms
Total hot run time: 39895 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4465	4226	4257	4226
q2	371	274	270	270
q3	2890	2616	2631	2616
q4	1950	1692	1630	1630
q5	5301	5258	5261	5258
q6	223	132	128	128
q7	2055	1689	1726	1689
q8	3153	3364	3318	3318
q9	8428	8303	8317	8303
q10	3395	3139	3169	3139
q11	587	498	494	494
q12	795	647	619	619
q13	16495	2958	2998	2958
q14	300	272	287	272
q15	526	476	481	476
q16	460	415	415	415
q17	1763	1461	1467	1461
q18	7651	7594	7349	7349
q19	1633	1598	1640	1598
q20	2003	1814	1782	1782
q21	5328	5206	5163	5163
q22	1112	1047	1053	1047
Total cold run time: 70884 ms
Total hot run time: 54211 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 200417 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2e8c8778d0371abf18a6720d23174922a3436a29, data reload: false

query1	899	358	355	355
query2	6460	2037	1900	1900
query3	6646	207	216	207
query4	29319	23218	23260	23218
query5	4246	472	494	472
query6	308	175	183	175
query7	4583	299	291	291
query8	246	204	190	190
query9	8546	2523	2479	2479
query10	546	452	477	452
query11	17658	14947	15026	14947
query12	143	96	99	96
query13	1644	375	360	360
query14	8803	7164	7632	7164
query15	247	209	218	209
query16	7719	500	524	500
query17	1725	574	538	538
query18	1950	287	277	277
query19	186	139	135	135
query20	111	104	102	102
query21	204	99	94	94
query22	4271	4209	4120	4120
query23	34002	33121	33222	33121
query24	11935	2581	2511	2511
query25	659	363	358	358
query26	1776	150	148	148
query27	3101	276	278	276
query28	8048	2057	2041	2041
query29	1109	403	405	403
query30	284	142	146	142
query31	967	744	752	744
query32	94	51	51	51
query33	731	276	277	276
query34	1009	458	469	458
query35	962	814	845	814
query36	1093	928	946	928
query37	285	78	78	78
query38	4271	4223	4015	4015
query39	1431	1383	1354	1354
query40	275	112	114	112
query41	46	43	45	43
query42	113	93	94	93
query43	513	474	472	472
query44	1157	719	727	719
query45	237	207	221	207
query46	1084	715	698	698
query47	1859	1794	1807	1794
query48	373	299	288	288
query49	1192	420	413	413
query50	817	411	401	401
query51	6731	6706	6660	6660
query52	137	85	92	85
query53	254	179	176	176
query54	1006	445	436	436
query55	74	72	72	72
query56	256	250	235	235
query57	1196	1081	1062	1062
query58	234	220	228	220
query59	2939	2802	2722	2722
query60	282	253	257	253
query61	97	95	94	94
query62	823	657	650	650
query63	217	182	180	180
query64	10476	2306	1762	1762
query65	3214	3182	3134	3134
query66	1433	321	333	321
query67	15209	15018	14739	14739
query68	4585	530	545	530
query69	426	351	347	347
query70	1142	1142	1055	1055
query71	456	269	274	269
query72	18033	17577	16664	16664
query73	770	325	328	325
query74	9229	8843	8688	8688
query75	3441	2661	2611	2611
query76	3155	1006	984	984
query77	652	310	313	310
query78	10752	9117	8820	8820
query79	1962	519	518	518
query80	2275	506	514	506
query81	604	223	221	221
query82	727	139	137	137
query83	297	151	147	147
query84	266	88	79	79
query85	2103	327	358	327
query86	464	280	296	280
query87	4794	4580	4602	4580
query88	3922	2483	2476	2476
query89	400	292	290	290
query90	1822	195	195	195
query91	117	95	94	94
query92	60	54	50	50
query93	2137	537	523	523
query94	943	301	303	301
query95	362	259	260	259
query96	607	286	274	274
query97	3207	3069	3036	3036
query98	235	255	204	204
query99	1582	1294	1277	1277
Total cold run time: 311988 ms
Total hot run time: 200417 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.83 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2e8c8778d0371abf18a6720d23174922a3436a29, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.03	0.04
query3	0.23	0.05	0.05
query4	1.67	0.08	0.07
query5	0.47	0.49	0.50
query6	1.13	0.73	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.49	0.48
query10	0.56	0.55	0.55
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.59	0.61	0.60
query14	0.76	0.78	0.76
query15	0.86	0.81	0.82
query16	0.37	0.37	0.37
query17	1.04	1.04	1.02
query18	0.24	0.21	0.21
query19	1.82	1.71	1.66
query20	0.01	0.01	0.01
query21	15.39	0.79	0.66
query22	4.23	7.14	2.23
query23	18.30	1.42	1.22
query24	2.42	0.22	0.22
query25	0.16	0.09	0.08
query26	0.29	0.20	0.22
query27	0.46	0.22	0.23
query28	13.30	1.01	1.00
query29	12.64	3.31	3.30
query30	0.24	0.06	0.04
query31	2.88	0.39	0.38
query32	3.27	0.48	0.46
query33	2.88	2.92	2.81
query34	17.08	4.40	4.36
query35	4.43	4.45	4.46
query36	0.64	0.48	0.46
query37	0.18	0.15	0.16
query38	0.16	0.14	0.15
query39	0.06	0.04	0.04
query40	0.16	0.12	0.13
query41	0.09	0.05	0.05
query42	0.06	0.05	0.06
query43	0.05	0.04	0.05
Total cold run time: 110.17 s
Total hot run time: 30.83 s

Comment thread be/src/util/cgroup_util.cpp
Comment thread be/src/common/cgroup_memory_ctl.cpp
Comment thread be/src/common/cgroup_memory_ctl.h
Comment thread be/src/agent/cgroup_cpu_ctl.h Outdated
Comment thread be/src/util/mem_info.cpp
Comment thread be/src/util/cgroup_util.h
Comment thread be/src/agent/cgroup_cpu_ctl.cpp Outdated
@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions
Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 39781 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fe0e3034a1c7952f9d04e931553d2cffc971f093, data reload: false

------ Round 1 ----------------------------------
q1	17643	4445	4317	4317
q2	2021	175	177	175
q3	11791	1019	1114	1019
q4	10509	741	757	741
q5	7760	2839	2808	2808
q6	235	135	136	135
q7	964	587	597	587
q8	9523	2028	2075	2028
q9	10220	6564	6513	6513
q10	7042	2213	2188	2188
q11	470	247	247	247
q12	444	219	218	218
q13	18961	2999	2972	2972
q14	266	238	232	232
q15	518	485	498	485
q16	508	397	402	397
q17	975	691	677	677
q18	7903	7334	7491	7334
q19	4292	1031	921	921
q20	657	329	320	320
q21	5293	4478	4671	4478
q22	1122	1015	989	989
Total cold run time: 119117 ms
Total hot run time: 39781 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4540	4342	4305	4305
q2	389	280	268	268
q3	2873	2876	2803	2803
q4	1946	1790	1787	1787
q5	5623	5606	5541	5541
q6	232	140	136	136
q7	2205	1769	1790	1769
q8	3272	3484	3419	3419
q9	8751	8880	8735	8735
q10	3490	3141	3258	3141
q11	616	515	528	515
q12	811	643	656	643
q13	16683	3167	3175	3167
q14	323	309	310	309
q15	536	475	499	475
q16	527	468	448	448
q17	1808	1521	1523	1521
q18	8305	7942	7925	7925
q19	8010	1632	1717	1632
q20	3050	1861	1883	1861
q21	9200	5125	5296	5125
q22	1122	1022	1072	1022
Total cold run time: 84312 ms
Total hot run time: 56547 ms

@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions
Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 39722 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 89564f79b1bb2a4c788d663b10b97042d83a4528, data reload: false

------ Round 1 ----------------------------------
q1	17669	4461	4318	4318
q2	2031	189	192	189
q3	11796	983	1078	983
q4	10509	730	665	665
q5	7769	2805	2741	2741
q6	225	142	141	141
q7	971	593	609	593
q8	9527	2039	2066	2039
q9	9357	6526	6559	6526
q10	7008	2215	2192	2192
q11	466	247	248	247
q12	390	222	221	221
q13	17870	2966	2953	2953
q14	290	245	245	245
q15	532	491	483	483
q16	510	420	390	390
q17	965	683	659	659
q18	8003	7499	7385	7385
q19	4246	1162	983	983
q20	693	332	322	322
q21	5691	4442	4679	4442
q22	1091	1051	1005	1005
Total cold run time: 117609 ms
Total hot run time: 39722 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4431	4259	4285	4259
q2	379	279	265	265
q3	2823	2748	2784	2748
q4	2026	1641	1756	1641
q5	5684	5558	5523	5523
q6	235	134	133	133
q7	2174	1775	1778	1775
q8	3265	3431	3429	3429
q9	8787	8776	8771	8771
q10	3553	3255	3192	3192
q11	600	484	519	484
q12	816	661	643	643
q13	17183	3191	3127	3127
q14	316	294	280	280
q15	519	492	491	491
q16	503	456	440	440
q17	1838	1555	1497	1497
q18	8075	8038	7852	7852
q19	1918	1581	1685	1581
q20	2136	1886	1893	1886
q21	5463	5500	5096	5096
q22	1165	1075	1042	1042
Total cold run time: 73889 ms
Total hot run time: 56155 ms

@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions
Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 39958 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 086d0273c46b72154878ce8761d8522b489b1604, data reload: false

------ Round 1 ----------------------------------
q1	19313	4512	4286	4286
q2	2008	184	177	177
q3	10569	1162	1066	1066
q4	10140	673	760	673
q5	7769	2802	2771	2771
q6	222	138	140	138
q7	964	591	576	576
q8	9348	2066	2072	2066
q9	8688	6561	6550	6550
q10	7021	2151	2285	2151
q11	473	249	252	249
q12	388	226	221	221
q13	18086	2987	2960	2960
q14	272	244	243	243
q15	532	484	489	484
q16	495	396	380	380
q17	968	684	746	684
q18	8178	7510	7451	7451
q19	5288	1080	1096	1080
q20	699	340	347	340
q21	5232	4628	4424	4424
q22	1116	999	988	988
Total cold run time: 117769 ms
Total hot run time: 39958 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4478	4248	4253	4248
q2	378	277	266	266
q3	2817	2637	2609	2609
q4	1892	1590	1585	1585
q5	5361	5385	5381	5381
q6	219	137	135	135
q7	2077	1655	1694	1655
q8	3202	3331	3321	3321
q9	8418	8383	8401	8383
q10	3408	3186	3148	3148
q11	598	507	514	507
q12	759	610	590	590
q13	16535	2988	3005	2988
q14	301	276	280	276
q15	514	487	492	487
q16	481	424	408	408
q17	1784	1503	1473	1473
q18	7738	7519	7406	7406
q19	1683	1543	1641	1543
q20	2028	1825	1802	1802
q21	5233	5064	5223	5064
q22	1088	1054	1009	1009
Total cold run time: 70992 ms
Total hot run time: 54284 ms

@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

yiguolei
yiguolei previously approved these changes Aug 13, 2024
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 13, 2024
@github-actions
Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Aug 13, 2024
@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

@xinyiZzz
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 40390 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ecb93627237b5b8a13e8a8a42afac0d0457f2e76, data reload: false

------ Round 1 ----------------------------------
q1	18710	4498	4304	4304
q2	2033	186	176	176
q3	10522	1205	1147	1147
q4	10170	774	770	770
q5	7757	2873	2809	2809
q6	229	138	137	137
q7	981	590	600	590
q8	9351	2059	2070	2059
q9	8684	6609	6638	6609
q10	7066	2242	2215	2215
q11	455	254	248	248
q12	392	220	222	220
q13	17904	2996	2998	2996
q14	294	246	233	233
q15	517	484	482	482
q16	515	392	379	379
q17	993	652	732	652
q18	8192	7493	7535	7493
q19	3932	994	1125	994
q20	667	336	337	336
q21	5402	4630	4530	4530
q22	1133	1038	1011	1011
Total cold run time: 115899 ms
Total hot run time: 40390 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4507	4277	4257	4257
q2	388	278	261	261
q3	2883	2714	2778	2714
q4	1961	1680	1668	1668
q5	5610	5716	5746	5716
q6	224	134	132	132
q7	2167	1780	1788	1780
q8	3316	3475	3554	3475
q9	8873	8764	8669	8669
q10	3526	3283	3308	3283
q11	609	513	543	513
q12	817	657	644	644
q13	16141	3181	3191	3181
q14	320	286	298	286
q15	543	498	485	485
q16	523	476	448	448
q17	1838	1534	1551	1534
q18	8220	8125	7954	7954
q19	1787	1686	1527	1527
q20	2155	1908	1859	1859
q21	5781	5268	5310	5268
q22	1148	1046	1027	1027
Total cold run time: 73337 ms
Total hot run time: 56681 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 191149 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ecb93627237b5b8a13e8a8a42afac0d0457f2e76, data reload: false

query1	1260	914	864	864
query2	6283	1846	1844	1844
query3	10758	3935	3969	3935
query4	59017	24979	23222	23222
query5	5575	488	510	488
query6	433	160	157	157
query7	5806	300	291	291
query8	291	210	208	208
query9	8811	2483	2445	2445
query10	487	275	269	269
query11	17750	14915	15009	14915
query12	168	103	120	103
query13	1549	391	386	386
query14	11146	7963	7850	7850
query15	312	175	178	175
query16	7620	538	567	538
query17	1211	582	592	582
query18	1959	311	308	308
query19	297	173	158	158
query20	126	113	112	112
query21	208	118	105	105
query22	4603	4493	4367	4367
query23	34214	33475	33087	33087
query24	6017	2876	2871	2871
query25	555	412	416	412
query26	685	159	159	159
query27	1779	274	276	274
query28	3871	2070	2054	2054
query29	688	430	428	428
query30	353	155	150	150
query31	917	767	768	767
query32	78	58	60	58
query33	452	295	287	287
query34	853	457	469	457
query35	808	727	725	725
query36	1074	923	941	923
query37	135	84	84	84
query38	3973	3793	3792	3792
query39	1437	1384	1399	1384
query40	219	125	119	119
query41	49	45	46	45
query42	122	99	100	99
query43	507	468	474	468
query44	1112	749	746	746
query45	198	167	166	166
query46	1085	742	730	730
query47	1850	1768	1766	1766
query48	364	294	296	294
query49	773	443	439	439
query50	803	399	405	399
query51	6919	6715	6710	6710
query52	100	97	97	97
query53	257	184	192	184
query54	580	559	447	447
query55	76	74	75	74
query56	263	249	251	249
query57	1153	1081	1104	1081
query58	219	234	242	234
query59	2897	2742	2614	2614
query60	287	299	284	284
query61	109	93	95	93
query62	745	663	632	632
query63	220	186	186	186
query64	3247	1768	1724	1724
query65	3199	3188	3134	3134
query66	679	340	329	329
query67	15751	15038	15081	15038
query68	6054	560	553	553
query69	616	269	285	269
query70	1198	1147	1054	1054
query71	542	278	293	278
query72	7835	2272	2038	2038
query73	856	325	321	321
query74	9317	8875	8839	8839
query75	4576	2700	2680	2680
query76	3910	1001	1003	1001
query77	724	341	303	303
query78	12305	9686	9017	9017
query79	10930	519	533	519
query80	1355	493	486	486
query81	578	228	228	228
query82	395	135	135	135
query83	361	142	143	142
query84	267	77	75	75
query85	763	273	303	273
query86	359	304	285	285
query87	4371	4251	4204	4204
query88	4959	2389	2426	2389
query89	409	285	279	279
query90	2467	192	193	192
query91	121	98	93	93
query92	61	50	51	50
query93	3518	536	536	536
query94	1192	302	298	298
query95	365	264	265	264
query96	615	271	268	268
query97	3235	2992	3073	2992
query98	241	202	209	202
query99	1527	1282	1271	1271
Total cold run time: 333364 ms
Total hot run time: 191149 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.35 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ecb93627237b5b8a13e8a8a42afac0d0457f2e76, data reload: false

query1	0.05	0.04	0.03
query2	0.07	0.04	0.04
query3	0.23	0.05	0.04
query4	1.66	0.06	0.07
query5	0.50	0.48	0.49
query6	1.14	0.73	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.54	0.49	0.48
query10	0.54	0.55	0.54
query11	0.15	0.11	0.11
query12	0.15	0.11	0.12
query13	0.60	0.61	0.58
query14	0.77	0.77	0.78
query15	0.85	0.82	0.82
query16	0.37	0.36	0.37
query17	0.95	1.05	1.04
query18	0.23	0.22	0.22
query19	1.77	1.76	1.82
query20	0.01	0.01	0.01
query21	15.43	0.76	0.67
query22	4.49	7.49	1.61
query23	18.27	1.38	1.22
query24	2.10	0.24	0.21
query25	0.15	0.09	0.09
query26	0.31	0.20	0.21
query27	0.45	0.22	0.22
query28	13.39	1.03	1.01
query29	12.60	3.31	3.25
query30	0.24	0.05	0.04
query31	2.90	0.37	0.40
query32	3.27	0.48	0.47
query33	2.96	2.90	3.03
query34	17.25	4.37	4.41
query35	4.50	4.43	4.44
query36	0.67	0.48	0.47
query37	0.19	0.16	0.16
query38	0.16	0.15	0.15
query39	0.04	0.03	0.03
query40	0.15	0.12	0.13
query41	0.09	0.05	0.04
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.37 s
Total hot run time: 30.35 s

Copy link
Copy Markdown
Contributor

@wangbo wangbo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 14, 2024
@github-actions
Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@yiguolei yiguolei merged commit 0a98217 into apache:master Aug 14, 2024
dataroaring pushed a commit that referenced this pull request Aug 17, 2024
/* Cgroup debugging steps
 * CgroupV1:
 *  sudo cgcreate -t username:username -g memory:test
* sudo sh -c "echo 6000M >
/sys/fs/cgroup/memory/test/memory.limit_in_bytes"
 *  // process started by the current terminal will join Cgroup test
 *  sudo sh -c "echo $$ >> /sys/fs/cgroup/memory/test/cgroup.procs"
 *
 * CgroupV2:
 *  sudo mkdir /sys/fs/cgroup/test
 *  sudo echo 3000M > /sys/fs/cgroup/test/memory.max
 *  // process started by the current terminal will join Cgroup test
 *  sudo sh -c "echo $$ >> /sys/fs/cgroup/test/cgroup.procs"
 *  or
* // only memory allocated after joining the Cgroup is counted in
`memory.current`.
 *  sudo echo pid > /sys/fs/cgroup/test/cgroup.procs

debug string
```
CGroup Info: Process CGroup Memory Info (cgroups path: /sys/fs/cgroup/memory/test, cgroup version: v1): memory limit: 2097152000, memory usage: 500969472
```
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request Aug 22, 2024
/* Cgroup debugging steps
 * CgroupV1:
 *  sudo cgcreate -t username:username -g memory:test
* sudo sh -c "echo 6000M >
/sys/fs/cgroup/memory/test/memory.limit_in_bytes"
 *  // process started by the current terminal will join Cgroup test
 *  sudo sh -c "echo $$ >> /sys/fs/cgroup/memory/test/cgroup.procs"
 *
 * CgroupV2:
 *  sudo mkdir /sys/fs/cgroup/test
 *  sudo echo 3000M > /sys/fs/cgroup/test/memory.max
 *  // process started by the current terminal will join Cgroup test
 *  sudo sh -c "echo $$ >> /sys/fs/cgroup/test/cgroup.procs"
 *  or
* // only memory allocated after joining the Cgroup is counted in
`memory.current`.
 *  sudo echo pid > /sys/fs/cgroup/test/cgroup.procs

debug string
```
CGroup Info: Process CGroup Memory Info (cgroups path: /sys/fs/cgroup/memory/test, cgroup version: v1): memory limit: 2097152000, memory usage: 500969472
```
@gavinchou gavinchou mentioned this pull request Oct 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged doing reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants