[improvement](cloud) manage node via sql like non cloud mode#40264
[improvement](cloud) manage node via sql like non cloud mode#40264dataroaring merged 18 commits intoapache:masterfrom
Conversation
|
Thank you for your contribution to Apache Doris. Since 2024-03-18, the Document has been moved to doris-website. |
bdf9d4a to
68e9c9d
Compare
2e4f889 to
f43e7e7
Compare
|
run buildall |
f43e7e7 to
31fc019
Compare
31fc019 to
7cd8aaa
Compare
|
run buildall |
1 similar comment
|
run buildall |
|
run buildall |
|
TeamCity be ut coverage result: |
|
run buildall |
|
TeamCity be ut coverage result: |
TPC-H: Total hot run time: 38370 ms |
TPC-DS: Total hot run time: 187461 ms |
ClickBench: Total hot run time: 32.71 s |
5767a7d to
3a1bfb2
Compare
|
run buildall |
|
TeamCity be ut coverage result: |
TPC-H: Total hot run time: 38003 ms |
TPC-DS: Total hot run time: 192166 ms |
ClickBench: Total hot run time: 31.89 s |
|
TeamCity be ut coverage result: |
TPC-H: Total hot run time: 38747 ms |
TPC-DS: Total hot run time: 199431 ms |
ClickBench: Total hot run time: 32.08 s |
|
run buildall |
TPC-H: Total hot run time: 40423 ms |
|
TeamCity be ut coverage result: |
TPC-DS: Total hot run time: 199116 ms |
ClickBench: Total hot run time: 30.93 s |
|
PR approved by at least one committer and no changes requested. |
|
PR approved by anyone and no changes requested. |
1. add a config deploy_mode to enable disaggregated mode. In this mode users have to config cloud_instance_id and meta_service_endpoint. 2. When a fe starts from empty, it would try to create instance. 3. If the instance does not exists, it creates and starts from master role. If the instance exists, then it stats with its role got from ms. 4. Frontends are added via sql alter system add frontend. Backends are added via sql alter system add backend. 5. Users do not need config cloud_instance_id and meta_service_endpoint in be.conf, because fe sends them to be via heartbeat. 6. Builtin vault is not needed any more, internal tabels are stored in default vault. TODO: 1. decomission fe and be via sql 2. change cloud_instance_id to cluster id. doc pr apache/doris-website#1072
Proposed changes
add a config deploy_mode to enable disaggregated mode. In this mode users have to config cloud_instance_id and meta_service_endpoint.
When a fe starts from empty, it would try to create instance.
If the instance does not exists, it creates and starts from master role. If the instance exists, then it stats with its role got from ms.
Frontends are added via sql alter system add frontend. Backends are added via sql alter system add backend.
Users do not need config cloud_instance_id and meta_service_endpoint in be.conf, because fe sends them to be via heartbeat.
Builtin vault is not needed any more, internal tabels are stored in default vault.
TODO:
doc pr apache/doris-website#1072